-- Logs begin at Wed 2022-03-30 06:35:16 UTC, end at Wed 2022-03-30 07:32:57 UTC. -- Mar 30 07:01:06.531163 dv-cinder-835778-2-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Mar 30 07:01:06.540169 dv-cinder-835778-2-iscsi devstack@keystone.service[79949]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Mar 30 07:01:06.542293 dv-cinder-835778-2-iscsi devstack@keystone.service[79949]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Mar 30 07:01:06 2022] *** Mar 30 07:01:06.542293 dv-cinder-835778-2-iscsi devstack@keystone.service[79949]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Mar 30 07:01:06.542293 dv-cinder-835778-2-iscsi devstack@keystone.service[79949]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Mar 30 07:01:06.542293 dv-cinder-835778-2-iscsi devstack@keystone.service[79949]: nodename: dv-cinder-835778-2-iscsi Mar 30 07:01:06.542293 dv-cinder-835778-2-iscsi devstack@keystone.service[79949]: machine: x86_64 Mar 30 07:01:06.542293 dv-cinder-835778-2-iscsi devstack@keystone.service[79949]: clock source: unix Mar 30 07:01:06.542293 dv-cinder-835778-2-iscsi devstack@keystone.service[79949]: pcre jit disabled Mar 30 07:01:06.542293 dv-cinder-835778-2-iscsi devstack@keystone.service[79949]: detected number of CPU cores: 4 Mar 30 07:01:06.542293 dv-cinder-835778-2-iscsi devstack@keystone.service[79949]: current working directory: / Mar 30 07:01:06.542293 dv-cinder-835778-2-iscsi devstack@keystone.service[79949]: detected binary path: /usr/bin/uwsgi-core Mar 30 07:01:06.542293 dv-cinder-835778-2-iscsi devstack@keystone.service[79949]: your processes number limit is 47680 Mar 30 07:01:06.542293 dv-cinder-835778-2-iscsi devstack@keystone.service[79949]: your memory page size is 4096 bytes Mar 30 07:01:06.542941 dv-cinder-835778-2-iscsi devstack@keystone.service[79949]: detected max file descriptor number: 2048 Mar 30 07:01:06.542941 dv-cinder-835778-2-iscsi devstack@keystone.service[79949]: lock engine: pthread robust mutexes Mar 30 07:01:06.542941 dv-cinder-835778-2-iscsi devstack@keystone.service[79949]: thunder lock: enabled Mar 30 07:01:06.542941 dv-cinder-835778-2-iscsi devstack@keystone.service[79949]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Mar 30 07:01:06.542941 dv-cinder-835778-2-iscsi devstack@keystone.service[79949]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Mar 30 07:01:06.587401 dv-cinder-835778-2-iscsi devstack@keystone.service[79949]: Python main interpreter initialized at 0x5601d24609c0 Mar 30 07:01:06.587401 dv-cinder-835778-2-iscsi devstack@keystone.service[79949]: python threads support enabled Mar 30 07:01:06.587401 dv-cinder-835778-2-iscsi devstack@keystone.service[79949]: your server socket listen backlog is limited to 100 connections Mar 30 07:01:06.587401 dv-cinder-835778-2-iscsi devstack@keystone.service[79949]: your mercy for graceful operations on workers is 90 seconds Mar 30 07:01:06.587776 dv-cinder-835778-2-iscsi devstack@keystone.service[79949]: mapped 403077 bytes (393 KB) for 2 cores Mar 30 07:01:06.587881 dv-cinder-835778-2-iscsi devstack@keystone.service[79949]: *** Operational MODE: preforking *** Mar 30 07:01:06.588129 dv-cinder-835778-2-iscsi devstack@keystone.service[79949]: *** uWSGI is running in multiple interpreter mode *** Mar 30 07:01:06.588129 dv-cinder-835778-2-iscsi devstack@keystone.service[79949]: spawned uWSGI master process (pid: 79949) Mar 30 07:01:06.588336 dv-cinder-835778-2-iscsi systemd[1]: Started Devstack devstack@keystone.service. Mar 30 07:01:06.590662 dv-cinder-835778-2-iscsi devstack@keystone.service[79949]: spawned uWSGI worker 1 (pid: 79960, cores: 1) Mar 30 07:01:06.590662 dv-cinder-835778-2-iscsi devstack@keystone.service[79949]: spawned uWSGI worker 2 (pid: 79961, cores: 1) Mar 30 07:01:06.590662 dv-cinder-835778-2-iscsi devstack@keystone.service[79949]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Mar 30 07:01:12.374105 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 30 07:01:12.374105 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: from cryptography.utils import int_from_bytes Mar 30 07:01:12.374895 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 30 07:01:12.374895 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: from cryptography.utils import int_from_bytes Mar 30 07:01:12.374895 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 30 07:01:12.374895 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: from cryptography.utils import int_from_bytes Mar 30 07:01:12.375412 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 30 07:01:12.375412 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: from cryptography.utils import int_from_bytes Mar 30 07:01:12.419244 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Mar 30 07:01:12.419430 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Mar 30 07:01:12.419497 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Mar 30 07:01:12.419573 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] command line args: [] {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Mar 30 07:01:12.419642 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Mar 30 07:01:12.419886 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] command line args: [] {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Mar 30 07:01:12.419980 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Mar 30 07:01:12.420049 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] ================================================================================ {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Mar 30 07:01:12.420112 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Mar 30 07:01:12.420268 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] admin_token = **** {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:01:12.420352 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] ================================================================================ {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Mar 30 07:01:12.420504 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] config_dir = [] {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:01:12.420589 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] admin_token = **** {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:01:12.420720 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:01:12.420797 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] config_dir = [] {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:01:12.420867 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] config_source = [] {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:01:12.420933 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:01:12.421080 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] debug = True {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:01:12.421157 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] config_source = [] {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:01:12.421222 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:01:12.421522 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] debug = True {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:01:12.421522 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:01:12.421671 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:01:12.421846 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:01:12.422917 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:01:12.422917 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:01:12.422917 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] list_limit = None {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:01:12.422917 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] log_config_append = None {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:01:12.422917 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:01:12.423217 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] log_dir = None {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:01:12.423285 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:01:12.423351 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] log_file = None {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:01:12.423414 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:01:12.423472 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:01:12.423693 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:01:12.423779 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:01:12.423989 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:01:12.424117 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:01:12.424195 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:01:12.424262 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:01:12.424408 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:01:12.424537 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] list_limit = None {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:01:12.424673 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:01:12.424842 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] log_config_append = None {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:01:12.424985 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:01:12.425112 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:01:12.425241 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:01:12.425385 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:01:12.425522 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] log_dir = None {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:01:12.425660 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:01:12.425794 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] log_file = None {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:01:12.425921 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:01:12.426045 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:01:12.426169 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:01:12.426305 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:01:12.426432 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:01:12.426581 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:01:12.426907 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:01:12.427076 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.20/identity {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:01:12.427076 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] publish_errors = False {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:01:12.427428 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:01:12.427428 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:01:12.427716 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:01:12.427889 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:01:12.428076 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:01:12.428215 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:01:12.428347 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:01:12.428473 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:01:12.428604 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:01:12.428765 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:01:12.428895 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:01:12.429020 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:01:12.429157 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:01:12.429287 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] standard_threads = False {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:01:12.429412 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:01:12.429545 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:01:12.429677 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:01:12.429802 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:01:12.429926 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:01:12.430088 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:01:12.430088 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] use_journal = False {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:01:12.430414 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:01:12.430552 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] use_json = False {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:01:12.430552 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] use_stderr = False {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:01:12.430552 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] use_syslog = False {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:01:12.430897 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.20/identity {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:01:12.431043 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:01:12.431170 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] publish_errors = False {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:01:12.431300 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.431431 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:01:12.431431 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:01:12.431681 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.431823 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:01:12.431964 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.432093 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:01:12.432326 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.432542 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:01:12.432799 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.433008 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] standard_threads = False {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:01:12.433153 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.433286 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:01:12.433419 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.433556 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:01:12.433683 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.433808 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:01:12.433947 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.434079 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] use_journal = False {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:01:12.434212 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.434347 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] use_json = False {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:01:12.434347 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] use_stderr = False {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:01:12.434583 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.434707 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] use_syslog = False {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:01:12.434831 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.434970 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 30 07:01:12.435181 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.435317 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.435451 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.435579 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.435705 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.435868 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.436025 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.436158 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.436285 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.436416 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.436547 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.436686 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.436824 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.436957 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.437097 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.437234 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.437362 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.437497 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.437497 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.437739 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.437864 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.438056 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.438186 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.438186 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.438432 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.438557 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.438692 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.438817 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.438942 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.438942 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.439192 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.439317 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.439448 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.439580 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.439705 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.439897 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.440030 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.440156 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.440288 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.440425 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.440557 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.440691 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.440823 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.440949 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.441073 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.441204 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.441330 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.441537 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.441665 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.441790 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.441921 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.442047 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.442186 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.442321 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.442447 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.442578 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.442704 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.442828 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.442953 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.443086 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.443217 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.443343 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.443468 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.443592 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.443717 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.443879 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.444020 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.444146 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.444277 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.444407 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.444542 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.444668 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.444793 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.444916 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.445041 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.445165 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.445298 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.445429 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.445558 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.445683 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.446074 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.446207 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.446343 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.446470 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.446596 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.446937 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.447130 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.447318 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.447511 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.447706 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.448000 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.448323 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.448653 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.448832 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.449058 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.449254 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.449416 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.449726 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.449890 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.450078 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.450298 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.450460 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.450680 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.450880 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.451044 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.451229 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.451463 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.451661 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.451861 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.452037 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.452205 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.452335 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.452335 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.452335 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.452335 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.452879 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.453006 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.453006 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.453245 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.453377 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.453563 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.453693 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.453820 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.453946 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.454072 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.454206 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.454334 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.454567 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.454697 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.454869 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.454869 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.455114 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.455250 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.455394 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.455532 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.455659 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.455791 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.455967 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.456106 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.456241 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.456368 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.456495 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.456621 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.456748 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.456959 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.457088 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.457215 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.457361 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.457518 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.457674 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.457810 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.457944 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.458071 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.458203 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.458332 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.458458 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.458593 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.458593 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.458839 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.458965 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.459101 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.459227 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.459363 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.459490 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.459616 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.459742 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.459898 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.460040 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.460177 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.460316 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.460445 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.460571 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.460736 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.460873 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.461011 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.461146 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.461280 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.461407 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.461534 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.461659 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] auth.external = None {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.461784 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.461918 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.462045 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.462170 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.462298 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.462423 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.462551 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.462689 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] auth.password = None {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.462826 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.462957 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] auth.token = None {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.463086 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.463212 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.463338 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.463519 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.463702 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.463948 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.464159 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.464324 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.464454 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.464591 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.464720 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.464883 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.465025 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.465162 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.465289 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.465421 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] credential.caching = True {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.465555 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.465692 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.465821 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.465948 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.466076 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.466211 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.466424 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.466578 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.466719 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] auth.external = None {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.466859 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.466988 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.467115 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.467242 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.467380 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.467509 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.467636 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.467765 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] auth.password = None {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.467914 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.468055 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] auth.token = None {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.468184 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.468311 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.468438 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.468575 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.468702 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.468843 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.468972 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.469099 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.469226 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.469353 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.469481 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.469616 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.469751 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] federation.caching = True {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.469880 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.470007 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.470134 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] credential.caching = True {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.470261 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.470406 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.470535 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.470663 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.470790 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.470918 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.471046 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.471182 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.471310 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.471438 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.471564 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.471692 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.471852 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.472000 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.472140 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.472269 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.472396 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.472523 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.472651 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.472858 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.472990 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] identity.caching = True {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.472990 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.473230 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.473356 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.473482 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.473617 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.473745 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.473872 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.474020 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.474157 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.474285 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.474421 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.474549 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] federation.caching = True {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.474676 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.474806 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.474933 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.475062 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.475197 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.475326 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.475459 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.475588 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.475715 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.475934 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.476092 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.476225 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.476360 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.476488 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.476621 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.476750 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.476888 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.477025 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.477153 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.477282 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.477410 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.477538 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.477683 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.477812 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] identity.caching = True {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.477940 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.478067 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.478194 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.478328 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.478465 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.478594 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.478724 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.478851 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.478980 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.479126 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.479265 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.479469 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.479685 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.479909 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.480048 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.480196 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.480328 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.480457 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.480584 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.480713 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.480841 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.480977 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.481105 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.481233 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.481360 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.481499 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.481627 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.481768 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.481897 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.482025 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.482169 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.482303 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.482434 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.482605 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.482768 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.482768 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.483013 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.483140 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.483267 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.483418 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.483548 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.483675 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.483851 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.483988 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.484125 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.484262 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.484390 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.484390 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.484629 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.484629 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.484868 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.485003 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.485141 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.485269 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.485400 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.485532 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.485660 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.485796 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.485925 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.486053 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.486180 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.486307 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.486434 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.486569 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] ldap.user = None {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.486698 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.487197 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.487341 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.487469 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.487598 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.487734 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.487882 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.488013 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.488140 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.488267 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.488394 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.488532 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.488662 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.488790 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.488917 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.489044 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.489181 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.489316 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.489445 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.489572 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.489698 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.489832 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.489960 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.490095 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.490223 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.490350 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.490477 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.490605 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.490732 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.490878 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.491007 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.491134 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.491262 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.491388 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.491515 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.491650 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.491778 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.491928 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.492056 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] ldap.user = None {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.492183 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.492310 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.492448 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.492576 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.492712 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.492840 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.492968 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.493095 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.493229 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.493364 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.493492 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.493619 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.493745 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.493881 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.494011 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.494138 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.494264 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.494397 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.494534 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.494669 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.494904 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.495118 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.495334 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.495504 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.495637 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.495775 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.495952 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.496084 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.496212 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.496340 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.496468 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.496618 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.496747 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.496875 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.497002 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] resource.caching = True {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.497131 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.497258 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.497395 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.497524 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.497652 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.497779 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.497906 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.498033 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.498170 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.498299 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.498436 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.498564 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.498692 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.498821 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.499029 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.499159 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.499288 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.499422 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.499551 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.499678 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] role.caching = True {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.499831 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.499966 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] role.driver = sql {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.500096 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.500225 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.500364 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.500492 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.500631 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.500761 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.500890 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.501018 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.501145 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.501273 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.501410 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.501540 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.501668 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.501795 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.501923 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.502060 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.502198 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] resource.caching = True {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.502328 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.502456 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.502584 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.502712 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.502838 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.502974 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.503103 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.503231 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.503364 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.503495 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.503622 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.503759 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.503917 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.504047 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.504175 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.504302 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.504430 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.504570 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.504699 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.504827 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] role.caching = True {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.504954 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.505081 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] role.driver = sql {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.505208 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.505344 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.505482 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.505621 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.505748 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.505877 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.506012 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.506141 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.506269 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.506396 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.506524 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.506653 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.506789 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.506918 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.507045 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.507172 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.507317 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.507446 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.507583 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.507712 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.507882 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.508016 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.508144 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.508271 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.508410 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.508539 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.508668 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.508795 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.508922 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] token.caching = True {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.508922 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.509182 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.509311 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.509438 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.509438 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.509685 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.509814 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.509950 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.510080 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.510207 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.510365 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.510540 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.510752 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.510985 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.511154 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.511284 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.511413 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.511540 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.511668 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.511822 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.511960 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.512088 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.512215 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.512343 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.512470 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.512609 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.512738 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.512867 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.513005 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.513133 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.513260 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.513396 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.513525 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.513653 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.513781 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.513910 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] database.connection = **** {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.514051 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.514051 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] token.caching = True {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.514310 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.514439 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.514567 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.514704 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.514831 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.514960 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.515096 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.515096 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.515338 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.515475 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.515604 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.515732 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.515934 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.516068 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.516196 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.516325 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.516453 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.516591 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.516727 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.516856 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.516983 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.517112 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.517240 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.517367 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.517502 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.517630 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.517759 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.517886 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.518013 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.518141 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.518277 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.518415 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.518543 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.518670 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.518798 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.518924 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Mar 30 07:01:12.519061 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] database.connection = **** {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.519061 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.519061 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.519061 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.519061 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.519061 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.519061 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.519061 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.519061 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.520238 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.520238 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.520238 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.520238 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.520238 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.520238 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.520238 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.520238 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.520238 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.521279 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 30 07:01:12.521279 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Mar 30 07:01:12.534568 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79960) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 07:01:12.534862 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79960) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 07:01:12.535045 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79960) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 07:01:12.542154 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79961) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 07:01:12.542472 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79961) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 07:01:12.542675 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79961) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 07:01:12.544288 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79960) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 07:01:12.551453 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79961) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 07:01:12.572633 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79960) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 07:01:12.573121 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79960) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 07:01:12.577968 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79961) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 07:01:12.578184 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79961) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 07:01:12.628369 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79961) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 07:01:12.629492 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79960) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 07:01:12.677856 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79961) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 07:01:12.678168 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79961) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 07:01:12.678764 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79960) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 07:01:12.678964 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79960) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 07:01:12.744461 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79961) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 07:01:12.744743 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79960) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 07:01:12.744913 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79961) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 07:01:12.745054 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79960) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 07:01:12.745054 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79960) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 07:01:12.745485 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79961) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 07:01:12.745637 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79960) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 07:01:12.745787 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79961) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 07:01:12.745928 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79960) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 07:01:12.746066 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79961) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 07:01:12.746204 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79960) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 07:01:12.746342 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79961) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 07:01:12.770764 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79960) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 07:01:12.771067 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79961) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 07:01:12.771224 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79960) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 07:01:12.771382 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79961) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 07:01:12.771523 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79960) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 07:01:12.771661 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79961) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 07:01:12.771835 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79960) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 07:01:12.771984 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79961) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 07:01:12.772123 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79960) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 07:01:12.772261 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79961) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 07:01:12.772399 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79960) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 07:01:12.772549 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79961) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 07:01:12.772549 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79961) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 07:01:12.772826 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79960) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 07:01:12.783617 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79961) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 07:01:12.783882 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79960) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 07:01:12.796626 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79961) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 07:01:12.796870 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79960) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 07:01:12.797025 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79961) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 07:01:12.797169 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79960) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 07:01:12.797311 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79961) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 07:01:12.797451 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79960) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 07:01:12.797610 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79961) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 07:01:12.797751 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79960) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 07:01:12.797903 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79961) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 07:01:12.797903 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79961) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 07:01:12.798166 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79960) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 07:01:12.798166 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79960) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 07:01:12.798437 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79961) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 07:01:12.798575 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79960) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 30 07:01:12.815702 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79961) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.815946 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79961) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Mar 30 07:01:12.816258 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79961) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.816461 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79960) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.816613 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79961) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Mar 30 07:01:12.816771 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79960) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Mar 30 07:01:12.816913 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79961) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.817051 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79960) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.817202 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79961) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.817341 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79960) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Mar 30 07:01:12.817479 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79961) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.817616 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79960) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.817754 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79961) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.817891 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79960) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.817891 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79960) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.818164 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79960) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.828282 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79961) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.828505 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79961) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.828657 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79960) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.828814 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79961) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.828960 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79960) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.829099 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79961) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.829240 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79960) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.829378 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79960) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.837146 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79961) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 30 07:01:12.837452 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79960) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 30 07:01:12.840438 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79961) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 30 07:01:12.840659 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79961) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.840971 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79961) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.841192 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79960) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 30 07:01:12.841347 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79961) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.841490 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79960) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.841630 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79961) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.841769 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79960) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.841907 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79961) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.842054 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79960) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.842195 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79961) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.842333 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79960) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.842483 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79961) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.842628 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79960) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.842778 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79961) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.842918 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79960) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.843074 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79961) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.843300 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79960) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.843475 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79961) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.843626 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79960) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.843626 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79960) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.843626 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79960) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.869959 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79961) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.870792 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79960) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.871535 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79961) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 30 07:01:12.871763 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79961) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.872423 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79960) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 30 07:01:12.872670 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79960) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.877004 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79961) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 30 07:01:12.877268 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79961) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.877676 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79961) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.877878 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79960) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 30 07:01:12.878165 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79960) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.878563 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79960) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.884837 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79961) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 30 07:01:12.885093 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79961) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.885807 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79960) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 30 07:01:12.886104 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79960) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.889752 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79961) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 30 07:01:12.890039 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79961) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.890323 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79961) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.890542 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79960) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 30 07:01:12.890695 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79961) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.890838 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79960) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.890991 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79961) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.891130 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79960) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.891276 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79961) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.891415 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79960) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.891552 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79961) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.891689 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79960) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.891853 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79961) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.892010 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79960) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.892148 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79960) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.892320 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79960) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.910007 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79961) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.910232 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79961) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.910500 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79960) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.910720 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79960) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.914712 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79961) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 30 07:01:12.915799 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79960) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 30 07:01:12.918384 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79961) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.918665 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79961) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.919394 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79960) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.919681 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79960) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.923667 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79961) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 30 07:01:12.924750 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79960) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 30 07:01:12.927193 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79961) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 30 07:01:12.928215 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79960) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 30 07:01:12.930741 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79961) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.931015 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79961) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.931311 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79961) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.931593 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79961) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.931917 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79960) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.932080 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79961) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.932318 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79960) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.932549 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79961) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.932785 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79960) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.932785 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79960) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.933082 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79960) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.933263 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79960) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.951063 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79961) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 30 07:01:12.951358 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79961) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.951574 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79961) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.951854 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79961) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.952682 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79960) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 30 07:01:12.952944 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79960) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.953226 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79960) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.953441 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79960) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.959567 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79961) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.961178 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79960) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.961385 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79961) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.961536 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79961) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.962850 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79960) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.963087 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79960) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.964881 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79961) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 30 07:01:12.965140 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79961) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.965448 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79961) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.965736 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79961) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.965988 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79961) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.966396 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79960) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 30 07:01:12.966680 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79960) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.966954 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79960) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.967298 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79960) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.967485 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79960) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.979723 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79961) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 30 07:01:12.980149 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79961) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.980331 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79961) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.980584 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79961) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.980835 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79961) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.980999 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79960) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 30 07:01:12.981147 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79960) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.981428 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79960) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.981677 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79960) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.981973 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79960) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.982353 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79960) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.982653 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79961) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.982860 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79960) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:12.983028 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79961) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:13.001612 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79961) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 30 07:01:13.001933 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79960) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 30 07:01:13.005202 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79960) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 30 07:01:13.006601 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79961) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 30 07:01:13.010067 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79961) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:13.011013 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79960) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:13.016582 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79960) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:13.016582 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79960) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 30 07:01:13.016836 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79960) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:13.017117 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79960) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:13.027754 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79960) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:13.029474 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79960) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 30 07:01:13.033546 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79960) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:13.033889 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79960) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:13.123489 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79961) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:13.125192 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79961) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 30 07:01:13.125455 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79961) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:13.125755 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79961) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:13.133215 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79961) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:13.134913 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79961) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 30 07:01:13.138521 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79961) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:13.138781 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79961) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:13.139093 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79961) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:13.139374 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79961) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:13.139721 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79960) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:13.140083 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79960) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:13.148503 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79961) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 30 07:01:13.148781 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79961) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:13.149077 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79961) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:13.149296 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79960) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 30 07:01:13.149565 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79960) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:13.149828 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79960) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:13.156955 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79961) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 30 07:01:13.157193 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79961) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:13.157596 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79961) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:13.157847 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79961) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:13.158018 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79960) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 30 07:01:13.158113 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79961) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:13.158392 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79961) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:13.158520 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79960) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:13.158725 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79961) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:13.158820 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79960) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:13.159006 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79961) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:13.159088 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79960) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:13.159159 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79960) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:13.159229 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79961) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:13.159535 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79960) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:13.159678 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79961) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:13.159678 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79961) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:13.159837 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79960) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:13.160086 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79961) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:13.160244 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79960) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:13.160384 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79961) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:13.160563 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79960) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:13.160563 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79960) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:13.160840 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79961) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:13.160983 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79960) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:13.160983 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79960) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:13.161259 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79960) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:13.161480 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79960) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 30 07:01:13.198276 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5601d24609c0 pid: 79961 (default app) Mar 30 07:01:13.198556 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5601d24609c0 pid: 79960 (default app) Mar 30 07:01:13.201888 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa05e10-adfb-4f90-a846-4ac8aa1e557c None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:13.202179 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa05e10-adfb-4f90-a846-4ac8aa1e557c None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:13.202478 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa05e10-adfb-4f90-a846-4ac8aa1e557c None None] PATH_INFO: `/v3` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:13.208293 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1/1] 10.222.0.20 () {50 vars in 791 bytes} [Wed Mar 30 07:01:13 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:01:21.516799 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52302471-5ae0-4dc4-b81a-66d15827144a None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:21.517325 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52302471-5ae0-4dc4-b81a-66d15827144a None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:21.517325 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52302471-5ae0-4dc4-b81a-66d15827144a None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:21.522362 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1/2] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:01:21 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 30 07:01:21.528976 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bfa958-1444-426e-a73e-f398b43f7874 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:21.529694 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bfa958-1444-426e-a73e-f398b43f7874 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:21.529957 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bfa958-1444-426e-a73e-f398b43f7874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:21.573533 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG oslo_db.sqlalchemy.engines [None req-47bfa958-1444-426e-a73e-f398b43f7874 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79961) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 30 07:01:21.759949 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG passlib.handlers.bcrypt [None req-47bfa958-1444-426e-a73e-f398b43f7874 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79961) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Mar 30 07:01:21.760434 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG passlib.handlers.bcrypt [None req-47bfa958-1444-426e-a73e-f398b43f7874 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79961) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Mar 30 07:01:21.817260 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-47bfa958-1444-426e-a73e-f398b43f7874 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:01:21.818874 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-47bfa958-1444-426e-a73e-f398b43f7874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:01:21.951389 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 2/3] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:01:21 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 424 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Mar 30 07:01:22.104669 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52302471-5ae0-4dc4-b81a-66d15827144a None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:22.149223 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG oslo_db.sqlalchemy.engines [None req-52302471-5ae0-4dc4-b81a-66d15827144a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79960) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 30 07:01:22.291993 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52302471-5ae0-4dc4-b81a-66d15827144a None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:22.298350 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14f67b9-5d7d-48e0-bd85-fadd2a0131a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:22.299011 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f67b9-5d7d-48e0-bd85-fadd2a0131a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:22.299293 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f67b9-5d7d-48e0-bd85-fadd2a0131a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:22.299573 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f67b9-5d7d-48e0-bd85-fadd2a0131a1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:22.308149 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14f67b9-5d7d-48e0-bd85-fadd2a0131a1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:22.361141 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.common.rbac_enforcer.enforcer [None req-a14f67b9-5d7d-48e0-bd85-fadd2a0131a1 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Mar 30 07:01:22.361397 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14f67b9-5d7d-48e0-bd85-fadd2a0131a1 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:22.372093 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 2/4] 10.222.0.20 () {58 vars in 1324 bytes} [Wed Mar 30 07:01:22 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 30 07:01:22.382145 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bfa958-1444-426e-a73e-f398b43f7874 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:22.399161 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bfa958-1444-426e-a73e-f398b43f7874 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:22.405411 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67af4f86-57e4-4d1b-98a9-a313aed96d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:22.406525 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67af4f86-57e4-4d1b-98a9-a313aed96d12 admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:22.406813 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67af4f86-57e4-4d1b-98a9-a313aed96d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:22.407094 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67af4f86-57e4-4d1b-98a9-a313aed96d12 admin admin] PATH_INFO: `/v3/projects/e0c9fc0b60d1476cbb305fe8a9512169` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:22.408762 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67af4f86-57e4-4d1b-98a9-a313aed96d12 admin admin] RBAC: Authorizing `identity:get_project(project_id=e0c9fc0b60d1476cbb305fe8a9512169)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:22.460316 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.common.rbac_enforcer.enforcer [None req-67af4f86-57e4-4d1b-98a9-a313aed96d12 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Mar 30 07:01:22.460657 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67af4f86-57e4-4d1b-98a9-a313aed96d12 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:22.465472 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 3/5] 10.222.0.20 () {56 vars in 1207 bytes} [Wed Mar 30 07:01:22 2022] GET /identity/v3/projects/e0c9fc0b60d1476cbb305fe8a9512169 => generated 344 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:01:24.725128 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b98a4-163a-4df9-9081-fa920cacd1c1 None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:24.725665 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b98a4-163a-4df9-9081-fa920cacd1c1 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:24.725665 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b98a4-163a-4df9-9081-fa920cacd1c1 None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:24.731889 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 3/6] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:01:24 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:01:24.738008 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e268c353-f7e5-4640-9508-7406047db9c3 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:24.738472 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e268c353-f7e5-4640-9508-7406047db9c3 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:24.738559 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e268c353-f7e5-4640-9508-7406047db9c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:24.759232 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-e268c353-f7e5-4640-9508-7406047db9c3 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:01:24.760893 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-e268c353-f7e5-4640-9508-7406047db9c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:01:24.769653 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 4/7] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:01:24 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Mar 30 07:01:24.801652 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162b98a4-163a-4df9-9081-fa920cacd1c1 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:24.817689 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162b98a4-163a-4df9-9081-fa920cacd1c1 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:24.823931 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbe28ff-6d56-49ad-a7ee-3c012c54c933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:24.824577 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbe28ff-6d56-49ad-a7ee-3c012c54c933 admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:24.824865 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbe28ff-6d56-49ad-a7ee-3c012c54c933 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:24.825146 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbe28ff-6d56-49ad-a7ee-3c012c54c933 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:24.833872 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbe28ff-6d56-49ad-a7ee-3c012c54c933 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:24.835678 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbe28ff-6d56-49ad-a7ee-3c012c54c933 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:24.845121 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 4/8] 10.222.0.20 () {58 vars in 1324 bytes} [Wed Mar 30 07:01:24 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 30 07:01:24.851505 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e268c353-f7e5-4640-9508-7406047db9c3 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:24.862664 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e268c353-f7e5-4640-9508-7406047db9c3 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:24.868806 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b15d80-1027-4b3a-9cef-4c348ca620e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:24.869690 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b15d80-1027-4b3a-9cef-4c348ca620e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:24.869983 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b15d80-1027-4b3a-9cef-4c348ca620e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:24.870292 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b15d80-1027-4b3a-9cef-4c348ca620e0 admin admin] PATH_INFO: `/v3/users/3226f67e8def44ad8010bab402b41414` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:24.871828 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b15d80-1027-4b3a-9cef-4c348ca620e0 admin admin] RBAC: Authorizing `identity:get_user(user_id=3226f67e8def44ad8010bab402b41414)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:24.873708 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b15d80-1027-4b3a-9cef-4c348ca620e0 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:24.875277 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 5/9] 10.222.0.20 () {56 vars in 1198 bytes} [Wed Mar 30 07:01:24 2022] GET /identity/v3/users/3226f67e8def44ad8010bab402b41414 => generated 247 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:01:27.231184 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c9320d-8378-4ae9-8087-606c42c61b92 None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:27.231720 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c9320d-8378-4ae9-8087-606c42c61b92 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:27.231720 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c9320d-8378-4ae9-8087-606c42c61b92 None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:27.232098 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335add65-bf90-4b75-b57f-307be2d7d347 None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:27.232528 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335add65-bf90-4b75-b57f-307be2d7d347 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:27.232622 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335add65-bf90-4b75-b57f-307be2d7d347 None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:27.233486 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 5/10] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:01:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:01:27.235365 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 6/11] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:01:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:01:27.240819 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a302d10-885b-4dd4-ac17-790604b7743e None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:27.241305 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a302d10-885b-4dd4-ac17-790604b7743e None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:27.241580 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a302d10-885b-4dd4-ac17-790604b7743e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:27.242079 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1499be6-9c6b-43f6-b049-64af36d92864 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:27.242369 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1499be6-9c6b-43f6-b049-64af36d92864 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:27.242644 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1499be6-9c6b-43f6-b049-64af36d92864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:27.260346 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-e1499be6-9c6b-43f6-b049-64af36d92864 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:01:27.261826 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-e1499be6-9c6b-43f6-b049-64af36d92864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:01:27.282490 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG passlib.handlers.bcrypt [None req-2a302d10-885b-4dd4-ac17-790604b7743e None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79960) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Mar 30 07:01:27.282901 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG passlib.handlers.bcrypt [None req-2a302d10-885b-4dd4-ac17-790604b7743e None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79960) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Mar 30 07:01:27.328865 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-2a302d10-885b-4dd4-ac17-790604b7743e None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:01:27.330459 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-2a302d10-885b-4dd4-ac17-790604b7743e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:01:27.346404 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 7/12] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:01:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 07:01:27.374358 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1499be6-9c6b-43f6-b049-64af36d92864 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:27.429307 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 6/13] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:01:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 30 07:01:27.453044 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a302d10-885b-4dd4-ac17-790604b7743e None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:27.474437 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1499be6-9c6b-43f6-b049-64af36d92864 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:27.507775 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56fd4a3-8de1-451f-9c51-31f2d1940145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:27.508456 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56fd4a3-8de1-451f-9c51-31f2d1940145 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:27.508737 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56fd4a3-8de1-451f-9c51-31f2d1940145 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:27.509011 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56fd4a3-8de1-451f-9c51-31f2d1940145 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:27.551184 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a302d10-885b-4dd4-ac17-790604b7743e None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:27.574175 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56fd4a3-8de1-451f-9c51-31f2d1940145 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:27.575650 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56fd4a3-8de1-451f-9c51-31f2d1940145 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:27.585290 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679d750a-69c5-4c6d-9e54-13142125563b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:27.586376 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679d750a-69c5-4c6d-9e54-13142125563b None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:27.586629 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679d750a-69c5-4c6d-9e54-13142125563b None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:27.586928 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679d750a-69c5-4c6d-9e54-13142125563b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:27.599239 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679d750a-69c5-4c6d-9e54-13142125563b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 07:01:27.606320 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-679d750a-69c5-4c6d-9e54-13142125563b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 30 07:01:27.607522 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 7/14] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Mar 30 07:01:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:01:27.613722 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679d750a-69c5-4c6d-9e54-13142125563b None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:27.668164 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 8/15] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Mar 30 07:01:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 30 07:01:27.673962 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56fd4a3-8de1-451f-9c51-31f2d1940145 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:27.711406 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679d750a-69c5-4c6d-9e54-13142125563b None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:27.758091 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90668d4e-a23f-47d9-b5ba-0e4d17b497e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:27.759066 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90668d4e-a23f-47d9-b5ba-0e4d17b497e2 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:27.759519 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90668d4e-a23f-47d9-b5ba-0e4d17b497e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:27.759992 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90668d4e-a23f-47d9-b5ba-0e4d17b497e2 None admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:27.761160 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90668d4e-a23f-47d9-b5ba-0e4d17b497e2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:01:27.761658 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90668d4e-a23f-47d9-b5ba-0e4d17b497e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:27.764063 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90668d4e-a23f-47d9-b5ba-0e4d17b497e2 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:27.782197 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 8/16] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Mar 30 07:01:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:01:27.790142 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90668d4e-a23f-47d9-b5ba-0e4d17b497e2 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:27.795459 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56fd4a3-8de1-451f-9c51-31f2d1940145 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:27.833507 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dc2957-3181-4700-aa18-f415c23f4da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:27.834307 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dc2957-3181-4700-aa18-f415c23f4da7 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:27.834591 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dc2957-3181-4700-aa18-f415c23f4da7 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:27.834871 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dc2957-3181-4700-aa18-f415c23f4da7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:27.846043 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dc2957-3181-4700-aa18-f415c23f4da7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:27.847505 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dc2957-3181-4700-aa18-f415c23f4da7 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:27.864763 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-36dc2957-3181-4700-aa18-f415c23f4da7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 07:01:27.866174 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 9/17] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:01:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:01:27.871756 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dc2957-3181-4700-aa18-f415c23f4da7 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:27.890228 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90668d4e-a23f-47d9-b5ba-0e4d17b497e2 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:27.924073 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a5f95f-8d30-4717-978a-84316bbd676b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:27.924949 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a5f95f-8d30-4717-978a-84316bbd676b None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:27.925222 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a5f95f-8d30-4717-978a-84316bbd676b None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:27.925490 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a5f95f-8d30-4717-978a-84316bbd676b None admin] PATH_INFO: `/v3/users/3226f67e8def44ad8010bab402b41414` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:27.927065 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a5f95f-8d30-4717-978a-84316bbd676b None admin] RBAC: Authorizing `identity:get_user(user_id=3226f67e8def44ad8010bab402b41414)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:27.928571 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a5f95f-8d30-4717-978a-84316bbd676b None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:27.930382 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 9/18] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Mar 30 07:01:27 2022] GET /identity/v3/users/3226f67e8def44ad8010bab402b41414 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:01:27.935735 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a5f95f-8d30-4717-978a-84316bbd676b None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:27.968235 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dc2957-3181-4700-aa18-f415c23f4da7 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:28.001270 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbdcba8-b4a8-4cde-a24f-5783ce82e680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:28.001925 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbdcba8-b4a8-4cde-a24f-5783ce82e680 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:28.002207 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbdcba8-b4a8-4cde-a24f-5783ce82e680 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:28.002480 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbdcba8-b4a8-4cde-a24f-5783ce82e680 None admin] PATH_INFO: `/v3/domains` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:28.003205 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbdcba8-b4a8-4cde-a24f-5783ce82e680 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:01:28.003511 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbdcba8-b4a8-4cde-a24f-5783ce82e680 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:28.004978 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbdcba8-b4a8-4cde-a24f-5783ce82e680 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:28.021827 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 10/19] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Mar 30 07:01:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:01:28.033294 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a5f95f-8d30-4717-978a-84316bbd676b None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:28.069805 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1b73e7-f5c3-4b34-94d5-558219e403cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:28.070630 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b73e7-f5c3-4b34-94d5-558219e403cf None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:28.070913 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b73e7-f5c3-4b34-94d5-558219e403cf None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:28.071192 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b73e7-f5c3-4b34-94d5-558219e403cf None admin] PATH_INFO: `/v3/domains/default` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:28.072477 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1b73e7-f5c3-4b34-94d5-558219e403cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:28.073977 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1b73e7-f5c3-4b34-94d5-558219e403cf None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:28.075600 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 10/20] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:01:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:01:28.081951 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbdcba8-b4a8-4cde-a24f-5783ce82e680 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:28.191127 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbdcba8-b4a8-4cde-a24f-5783ce82e680 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:28.226224 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab629245-9698-40f9-9d73-695841cfad15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:28.226885 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab629245-9698-40f9-9d73-695841cfad15 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:28.227164 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab629245-9698-40f9-9d73-695841cfad15 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:28.227438 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab629245-9698-40f9-9d73-695841cfad15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:28.228304 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab629245-9698-40f9-9d73-695841cfad15 None admin] RBAC: Adding query filter params (role.id=1c39b9ab8cfd4c0ea71845831920a845, scope.domain.id=default, user.id=3226f67e8def44ad8010bab402b41414) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:01:28.228605 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab629245-9698-40f9-9d73-695841cfad15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:28.230258 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab629245-9698-40f9-9d73-695841cfad15 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:28.237885 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 11/21] 10.222.0.20 () {56 vars in 1322 bytes} [Wed Mar 30 07:01:28 2022] GET /identity/v3/role_assignments?user.id=3226f67e8def44ad8010bab402b41414&scope.domain.id=default&role.id=1c39b9ab8cfd4c0ea71845831920a845 => generated 233 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:01:30.995324 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2ec9b0-959b-410c-aadf-e0ba93e53a12 None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:30.996556 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2ec9b0-959b-410c-aadf-e0ba93e53a12 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:30.997041 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2ec9b0-959b-410c-aadf-e0ba93e53a12 None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:30.999376 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 11/22] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:01:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:01:31.009633 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03fcf42-ac5b-4c8b-8e6f-d081512f25fe None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:31.010123 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03fcf42-ac5b-4c8b-8e6f-d081512f25fe None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:31.010196 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03fcf42-ac5b-4c8b-8e6f-d081512f25fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:31.033192 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-f03fcf42-ac5b-4c8b-8e6f-d081512f25fe None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:01:31.034736 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-f03fcf42-ac5b-4c8b-8e6f-d081512f25fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:01:31.085161 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da265bfb-dece-4840-92b8-96b192012487 None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:31.085490 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da265bfb-dece-4840-92b8-96b192012487 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:31.085719 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da265bfb-dece-4840-92b8-96b192012487 None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:31.087703 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 12/23] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:01:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 30 07:01:31.093226 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4a4ca7-8fbe-4f63-bb6e-0ffa52f3cf84 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:31.093798 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4a4ca7-8fbe-4f63-bb6e-0ffa52f3cf84 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:31.094274 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4a4ca7-8fbe-4f63-bb6e-0ffa52f3cf84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:31.120926 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 12/24] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:01:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 07:01:31.121996 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-2c4a4ca7-8fbe-4f63-bb6e-0ffa52f3cf84 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:01:31.123224 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-2c4a4ca7-8fbe-4f63-bb6e-0ffa52f3cf84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:01:31.204005 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03fcf42-ac5b-4c8b-8e6f-d081512f25fe None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:31.247840 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 13/25] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:01:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 30 07:01:31.278856 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4a4ca7-8fbe-4f63-bb6e-0ffa52f3cf84 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:31.349315 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03fcf42-ac5b-4c8b-8e6f-d081512f25fe None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:31.393994 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f936960-29cc-424f-9967-04904f3ac77e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:31.394689 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f936960-29cc-424f-9967-04904f3ac77e None admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:31.394970 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f936960-29cc-424f-9967-04904f3ac77e None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:31.395243 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f936960-29cc-424f-9967-04904f3ac77e None admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:31.396055 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f936960-29cc-424f-9967-04904f3ac77e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:31.397455 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f936960-29cc-424f-9967-04904f3ac77e None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:31.453355 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4a4ca7-8fbe-4f63-bb6e-0ffa52f3cf84 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:31.505339 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca56cb8d-ac49-4adb-ac5b-b0c3a39a7196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:31.506478 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca56cb8d-ac49-4adb-ac5b-b0c3a39a7196 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:31.506962 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca56cb8d-ac49-4adb-ac5b-b0c3a39a7196 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:31.507448 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca56cb8d-ac49-4adb-ac5b-b0c3a39a7196 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:31.517978 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca56cb8d-ac49-4adb-ac5b-b0c3a39a7196 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 07:01:31.525053 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-ca56cb8d-ac49-4adb-ac5b-b0c3a39a7196 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 30 07:01:31.531702 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 14/26] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Mar 30 07:01:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 07:01:31.533356 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f156722-febd-4368-b89f-f11810fc15b8 None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:31.533880 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f156722-febd-4368-b89f-f11810fc15b8 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:31.534352 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f156722-febd-4368-b89f-f11810fc15b8 None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:31.536301 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 15/27] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:01:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:01:31.537544 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60af4ff2-8dc0-475a-92b7-4c86f86c2b80 None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:31.538068 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60af4ff2-8dc0-475a-92b7-4c86f86c2b80 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:31.538536 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60af4ff2-8dc0-475a-92b7-4c86f86c2b80 None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:31.545199 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 16/28] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:01:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:01:31.546248 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60af4ff2-8dc0-475a-92b7-4c86f86c2b80 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:31.568044 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 13/29] 10.222.0.20 () {60 vars in 1131 bytes} [Wed Mar 30 07:01:31 2022] POST /identity/v3/roles => generated 219 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:01:31.570352 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdf4e14-9041-415c-a715-02c77cb8d06f None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:31.570771 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdf4e14-9041-415c-a715-02c77cb8d06f None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:31.571054 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdf4e14-9041-415c-a715-02c77cb8d06f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:31.597569 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-3bdf4e14-9041-415c-a715-02c77cb8d06f None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:01:31.599739 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-3bdf4e14-9041-415c-a715-02c77cb8d06f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:01:31.672409 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60af4ff2-8dc0-475a-92b7-4c86f86c2b80 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:31.678835 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 14/30] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:01:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 07:01:31.688553 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be559499-16e7-4ef4-956c-e2c3473f6e85 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:31.688868 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be559499-16e7-4ef4-956c-e2c3473f6e85 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:31.689128 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be559499-16e7-4ef4-956c-e2c3473f6e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:31.713061 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-be559499-16e7-4ef4-956c-e2c3473f6e85 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:01:31.714764 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-be559499-16e7-4ef4-956c-e2c3473f6e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:01:31.718426 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9653af-9b9c-4dd0-94d8-971b2bd82bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:31.719115 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9653af-9b9c-4dd0-94d8-971b2bd82bef None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:31.719388 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9653af-9b9c-4dd0-94d8-971b2bd82bef None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:31.719655 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9653af-9b9c-4dd0-94d8-971b2bd82bef None admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:31.720450 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9653af-9b9c-4dd0-94d8-971b2bd82bef None admin] RBAC: Adding query filter params (name=admin) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:01:31.720750 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9653af-9b9c-4dd0-94d8-971b2bd82bef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:31.723317 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9653af-9b9c-4dd0-94d8-971b2bd82bef None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:31.734846 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 17/31] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Mar 30 07:01:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:01:31.735570 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9653af-9b9c-4dd0-94d8-971b2bd82bef None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:31.849394 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 15/32] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:01:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 07:01:31.850670 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be559499-16e7-4ef4-956c-e2c3473f6e85 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:31.883549 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9653af-9b9c-4dd0-94d8-971b2bd82bef None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:31.925544 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55348c4-8661-4da1-8ff6-e6af5018dd8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:31.926234 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55348c4-8661-4da1-8ff6-e6af5018dd8a None admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:31.926518 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55348c4-8661-4da1-8ff6-e6af5018dd8a None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:31.926792 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55348c4-8661-4da1-8ff6-e6af5018dd8a None admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:31.927623 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55348c4-8661-4da1-8ff6-e6af5018dd8a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:31.929359 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55348c4-8661-4da1-8ff6-e6af5018dd8a None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:31.975949 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be559499-16e7-4ef4-956c-e2c3473f6e85 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:32.012286 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ec1800-242a-42d5-bc3b-3938cf5666f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:32.014008 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec1800-242a-42d5-bc3b-3938cf5666f5 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:32.014474 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec1800-242a-42d5-bc3b-3938cf5666f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:32.014975 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec1800-242a-42d5-bc3b-3938cf5666f5 None admin] PATH_INFO: `/v3/users/3226f67e8def44ad8010bab402b41414` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:32.016401 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ec1800-242a-42d5-bc3b-3938cf5666f5 None admin] RBAC: Authorizing `identity:get_user(user_id=3226f67e8def44ad8010bab402b41414)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:32.018203 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ec1800-242a-42d5-bc3b-3938cf5666f5 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:32.024497 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 16/33] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Mar 30 07:01:31 2022] GET /identity/v3/users/3226f67e8def44ad8010bab402b41414 => generated 247 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:01:32.025979 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2da0345-e1df-4e91-9799-bbe3813961e9 None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:32.026504 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2da0345-e1df-4e91-9799-bbe3813961e9 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:32.026958 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2da0345-e1df-4e91-9799-bbe3813961e9 None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:32.028840 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 17/34] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:01:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:01:32.029717 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2da0345-e1df-4e91-9799-bbe3813961e9 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:32.071839 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 18/35] 10.222.0.20 () {60 vars in 1131 bytes} [Wed Mar 30 07:01:31 2022] POST /identity/v3/roles => generated 225 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:01:32.071839 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55348c4-8661-4da1-8ff6-e6af5018dd8a None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:32.149537 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2da0345-e1df-4e91-9799-bbe3813961e9 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:32.187915 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55348c4-8661-4da1-8ff6-e6af5018dd8a None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:32.189870 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63b4798-2aff-4f22-bd95-078b28463dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:32.190799 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63b4798-2aff-4f22-bd95-078b28463dce None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:32.191154 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63b4798-2aff-4f22-bd95-078b28463dce None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:32.191501 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63b4798-2aff-4f22-bd95-078b28463dce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:32.204345 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63b4798-2aff-4f22-bd95-078b28463dce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:32.204849 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63b4798-2aff-4f22-bd95-078b28463dce None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:32.223271 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-b63b4798-2aff-4f22-bd95-078b28463dce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 07:01:32.224639 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 18/36] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:01:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:01:32.225996 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056e2be8-ed1e-4446-a474-7f2383ac4e3c None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:32.226292 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056e2be8-ed1e-4446-a474-7f2383ac4e3c None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:32.226570 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056e2be8-ed1e-4446-a474-7f2383ac4e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:32.228262 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bcbec5-9320-40c6-aae7-959e476ba8cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:32.229432 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bcbec5-9320-40c6-aae7-959e476ba8cb None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:32.229923 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bcbec5-9320-40c6-aae7-959e476ba8cb None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:32.230642 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bcbec5-9320-40c6-aae7-959e476ba8cb None admin] PATH_INFO: `/v3/domains/default` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:32.232347 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bcbec5-9320-40c6-aae7-959e476ba8cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:32.234404 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bcbec5-9320-40c6-aae7-959e476ba8cb None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:32.236992 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 19/37] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:01:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:01:32.242906 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bcbec5-9320-40c6-aae7-959e476ba8cb None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:32.251315 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-056e2be8-ed1e-4446-a474-7f2383ac4e3c None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:01:32.252584 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-056e2be8-ed1e-4446-a474-7f2383ac4e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:01:32.330813 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 19/38] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:01:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 07:01:32.330813 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056e2be8-ed1e-4446-a474-7f2383ac4e3c None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:32.381023 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bcbec5-9320-40c6-aae7-959e476ba8cb None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:32.414603 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83482a0f-ec71-44a5-a5ae-cf0e566e2c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:32.415196 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83482a0f-ec71-44a5-a5ae-cf0e566e2c70 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:32.415482 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83482a0f-ec71-44a5-a5ae-cf0e566e2c70 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:32.415760 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83482a0f-ec71-44a5-a5ae-cf0e566e2c70 None admin] PATH_INFO: `/v3/domains` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:32.416533 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83482a0f-ec71-44a5-a5ae-cf0e566e2c70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:01:32.417000 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83482a0f-ec71-44a5-a5ae-cf0e566e2c70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:32.418673 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83482a0f-ec71-44a5-a5ae-cf0e566e2c70 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:32.432975 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056e2be8-ed1e-4446-a474-7f2383ac4e3c None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:32.439727 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 20/39] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Mar 30 07:01:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:01:32.441859 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83482a0f-ec71-44a5-a5ae-cf0e566e2c70 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:32.467527 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae9f8bd-65c7-438e-ac9e-e136493ee2e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:32.468526 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae9f8bd-65c7-438e-ac9e-e136493ee2e8 None admin] REQUEST_METHOD: `PUT` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:32.468815 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae9f8bd-65c7-438e-ac9e-e136493ee2e8 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:32.469109 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae9f8bd-65c7-438e-ac9e-e136493ee2e8 None admin] PATH_INFO: `/v3/domains/default/users/3226f67e8def44ad8010bab402b41414/roles/1c39b9ab8cfd4c0ea71845831920a845` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:32.471131 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae9f8bd-65c7-438e-ac9e-e136493ee2e8 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=3226f67e8def44ad8010bab402b41414, role_id=1c39b9ab8cfd4c0ea71845831920a845)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:32.472651 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae9f8bd-65c7-438e-ac9e-e136493ee2e8 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:32.488193 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 20/40] 10.222.0.20 () {58 vars in 1361 bytes} [Wed Mar 30 07:01:32 2022] PUT /identity/v3/domains/default/users/3226f67e8def44ad8010bab402b41414/roles/1c39b9ab8cfd4c0ea71845831920a845 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:01:32.489016 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae9f8bd-65c7-438e-ac9e-e136493ee2e8 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:32.570423 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83482a0f-ec71-44a5-a5ae-cf0e566e2c70 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:32.598566 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae9f8bd-65c7-438e-ac9e-e136493ee2e8 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:32.606068 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ac36ed-02e7-4e75-bdb0-cf2f7f9e9cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:32.606762 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ac36ed-02e7-4e75-bdb0-cf2f7f9e9cc8 None admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:32.607055 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ac36ed-02e7-4e75-bdb0-cf2f7f9e9cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:32.607333 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ac36ed-02e7-4e75-bdb0-cf2f7f9e9cc8 None admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:32.608135 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ac36ed-02e7-4e75-bdb0-cf2f7f9e9cc8 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:32.609706 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ac36ed-02e7-4e75-bdb0-cf2f7f9e9cc8 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:32.624347 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 21/41] 10.222.0.20 () {60 vars in 1131 bytes} [Wed Mar 30 07:01:32 2022] POST /identity/v3/roles => generated 223 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:01:32.625773 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9448f953-1d64-4fb9-9820-02470ce34678 None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:32.626063 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9448f953-1d64-4fb9-9820-02470ce34678 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:32.626346 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9448f953-1d64-4fb9-9820-02470ce34678 None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:32.631915 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 22/42] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:01:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:01:32.634184 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb7a358-f2ba-4a92-8936-1e41f14a39fe None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:32.634480 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb7a358-f2ba-4a92-8936-1e41f14a39fe None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:32.634761 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb7a358-f2ba-4a92-8936-1e41f14a39fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:32.649022 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6d02c3-a69d-4658-87fc-539dc49b6e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:32.650034 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6d02c3-a69d-4658-87fc-539dc49b6e8a None admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:32.651659 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6d02c3-a69d-4658-87fc-539dc49b6e8a None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:32.652139 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6d02c3-a69d-4658-87fc-539dc49b6e8a None admin] PATH_INFO: `/v3/projects` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:32.653053 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6d02c3-a69d-4658-87fc-539dc49b6e8a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:32.656487 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6d02c3-a69d-4658-87fc-539dc49b6e8a None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:32.665626 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-5bb7a358-f2ba-4a92-8936-1e41f14a39fe None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:01:32.667538 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-5bb7a358-f2ba-4a92-8936-1e41f14a39fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:01:32.696866 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 21/43] 10.222.0.20 () {60 vars in 1141 bytes} [Wed Mar 30 07:01:32 2022] POST /identity/v3/projects => generated 301 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:01:32.765536 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 23/44] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:01:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 07:01:32.790669 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6d02c3-a69d-4658-87fc-539dc49b6e8a None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:32.906845 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6d02c3-a69d-4658-87fc-539dc49b6e8a None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:32.942459 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db10c20-5786-4fef-9000-c740207cc789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:32.943202 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db10c20-5786-4fef-9000-c740207cc789 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:32.943477 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db10c20-5786-4fef-9000-c740207cc789 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:32.943755 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db10c20-5786-4fef-9000-c740207cc789 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:32.944998 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db10c20-5786-4fef-9000-c740207cc789 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:32.946473 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db10c20-5786-4fef-9000-c740207cc789 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:32.948199 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 22/45] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:01:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:01:32.953943 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb7a358-f2ba-4a92-8936-1e41f14a39fe None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:33.051339 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb7a358-f2ba-4a92-8936-1e41f14a39fe None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:33.085127 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498343b9-90dd-4bb5-9c1a-69c5b5c79083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:33.085792 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498343b9-90dd-4bb5-9c1a-69c5b5c79083 None admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:33.086078 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498343b9-90dd-4bb5-9c1a-69c5b5c79083 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:33.086354 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498343b9-90dd-4bb5-9c1a-69c5b5c79083 None admin] PATH_INFO: `/v3/projects` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:33.087071 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498343b9-90dd-4bb5-9c1a-69c5b5c79083 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:33.088627 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498343b9-90dd-4bb5-9c1a-69c5b5c79083 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:33.122312 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 24/46] 10.222.0.20 () {60 vars in 1141 bytes} [Wed Mar 30 07:01:32 2022] POST /identity/v3/projects => generated 312 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:01:34.863288 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165999c1-d925-46e4-bdec-f9797df8ebf5 None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:34.863898 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165999c1-d925-46e4-bdec-f9797df8ebf5 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:34.863898 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165999c1-d925-46e4-bdec-f9797df8ebf5 None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:34.865753 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 23/47] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:01:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:01:34.871199 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e12d8f-b337-4612-b55a-420f7966f913 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:34.871616 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e12d8f-b337-4612-b55a-420f7966f913 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:34.871716 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e12d8f-b337-4612-b55a-420f7966f913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:34.889035 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-a3e12d8f-b337-4612-b55a-420f7966f913 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:01:34.890209 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-a3e12d8f-b337-4612-b55a-420f7966f913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:01:34.960519 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 25/48] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:01:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 07:01:34.987057 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165999c1-d925-46e4-bdec-f9797df8ebf5 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:35.092825 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165999c1-d925-46e4-bdec-f9797df8ebf5 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:35.128463 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6172378d-35da-426c-9a7c-28bf03630f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:35.129202 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6172378d-35da-426c-9a7c-28bf03630f19 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:35.129482 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6172378d-35da-426c-9a7c-28bf03630f19 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:35.129755 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6172378d-35da-426c-9a7c-28bf03630f19 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:35.141357 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6172378d-35da-426c-9a7c-28bf03630f19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 07:01:35.148234 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-6172378d-35da-426c-9a7c-28bf03630f19 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 30 07:01:35.149630 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 24/49] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Mar 30 07:01:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:01:35.155782 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e12d8f-b337-4612-b55a-420f7966f913 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:35.256111 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e12d8f-b337-4612-b55a-420f7966f913 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:35.290760 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5464d75-9edf-4966-9cdf-e00a3472e123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:35.291433 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5464d75-9edf-4966-9cdf-e00a3472e123 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:35.291748 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5464d75-9edf-4966-9cdf-e00a3472e123 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:35.292261 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5464d75-9edf-4966-9cdf-e00a3472e123 None admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:35.293128 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5464d75-9edf-4966-9cdf-e00a3472e123 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:01:35.293440 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5464d75-9edf-4966-9cdf-e00a3472e123 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:35.294849 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5464d75-9edf-4966-9cdf-e00a3472e123 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:35.303168 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 26/50] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Mar 30 07:01:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:01:35.309125 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6172378d-35da-426c-9a7c-28bf03630f19 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:35.389199 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e744f386-e61a-4312-99f5-e6b98fbe4fda None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:35.389407 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e744f386-e61a-4312-99f5-e6b98fbe4fda None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:35.389672 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e744f386-e61a-4312-99f5-e6b98fbe4fda None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:35.391444 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 27/51] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:01:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:01:35.396523 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a7aac-695d-4596-ab31-29faa9120629 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:35.396810 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a7aac-695d-4596-ab31-29faa9120629 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:35.397091 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a7aac-695d-4596-ab31-29faa9120629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:35.412244 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6172378d-35da-426c-9a7c-28bf03630f19 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:35.417483 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-479a7aac-695d-4596-ab31-29faa9120629 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:01:35.418799 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-479a7aac-695d-4596-ab31-29faa9120629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:01:35.448099 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07fd685-69f0-487d-8033-00d42cc15ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:35.449170 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07fd685-69f0-487d-8033-00d42cc15ed5 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:35.449453 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07fd685-69f0-487d-8033-00d42cc15ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:35.449709 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07fd685-69f0-487d-8033-00d42cc15ed5 None admin] PATH_INFO: `/v3/users/3226f67e8def44ad8010bab402b41414` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:35.450935 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07fd685-69f0-487d-8033-00d42cc15ed5 None admin] RBAC: Authorizing `identity:get_user(user_id=3226f67e8def44ad8010bab402b41414)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:35.452451 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07fd685-69f0-487d-8033-00d42cc15ed5 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:35.454076 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 25/52] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Mar 30 07:01:35 2022] GET /identity/v3/users/3226f67e8def44ad8010bab402b41414 => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:01:35.459674 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07fd685-69f0-487d-8033-00d42cc15ed5 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:35.493647 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 28/53] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:01:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 30 07:01:35.527782 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479a7aac-695d-4596-ab31-29faa9120629 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:35.574968 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07fd685-69f0-487d-8033-00d42cc15ed5 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:35.606941 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bc0abc-2402-46fb-9071-871be867bafe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:35.607729 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc0abc-2402-46fb-9071-871be867bafe None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:35.608044 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc0abc-2402-46fb-9071-871be867bafe None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:35.608322 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc0abc-2402-46fb-9071-871be867bafe None admin] PATH_INFO: `/v3/domains/default` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:35.609576 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bc0abc-2402-46fb-9071-871be867bafe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:35.611053 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bc0abc-2402-46fb-9071-871be867bafe None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:35.613096 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 26/54] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:01:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:01:35.618974 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bc0abc-2402-46fb-9071-871be867bafe None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:35.627398 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479a7aac-695d-4596-ab31-29faa9120629 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:35.660324 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187a907e-ba04-444b-bd1e-a12d99ebff69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:35.661009 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187a907e-ba04-444b-bd1e-a12d99ebff69 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:35.661291 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187a907e-ba04-444b-bd1e-a12d99ebff69 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:35.661564 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187a907e-ba04-444b-bd1e-a12d99ebff69 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:35.662736 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187a907e-ba04-444b-bd1e-a12d99ebff69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:35.664207 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187a907e-ba04-444b-bd1e-a12d99ebff69 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:35.666079 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 29/55] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:01:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:01:35.671798 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187a907e-ba04-444b-bd1e-a12d99ebff69 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:35.717424 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bc0abc-2402-46fb-9071-871be867bafe None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:35.751080 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c8839e-a011-4663-bbf0-811e1877dc68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:35.751767 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c8839e-a011-4663-bbf0-811e1877dc68 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:35.752088 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c8839e-a011-4663-bbf0-811e1877dc68 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:35.752370 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c8839e-a011-4663-bbf0-811e1877dc68 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:35.753210 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c8839e-a011-4663-bbf0-811e1877dc68 None admin] RBAC: Adding query filter params (role.id=1c39b9ab8cfd4c0ea71845831920a845, scope.domain.id=default, user.id=3226f67e8def44ad8010bab402b41414) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:01:35.753522 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c8839e-a011-4663-bbf0-811e1877dc68 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:35.754987 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c8839e-a011-4663-bbf0-811e1877dc68 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:35.760710 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 27/56] 10.222.0.20 () {56 vars in 1322 bytes} [Wed Mar 30 07:01:35 2022] GET /identity/v3/role_assignments?user.id=3226f67e8def44ad8010bab402b41414&scope.domain.id=default&role.id=1c39b9ab8cfd4c0ea71845831920a845 => generated 530 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:01:35.766469 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187a907e-ba04-444b-bd1e-a12d99ebff69 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:35.802693 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dadff42-54ee-40dd-a9ee-f66e1b99fb47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:35.803374 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dadff42-54ee-40dd-a9ee-f66e1b99fb47 None admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:35.803660 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dadff42-54ee-40dd-a9ee-f66e1b99fb47 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:35.803966 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dadff42-54ee-40dd-a9ee-f66e1b99fb47 None admin] PATH_INFO: `/v3/projects` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:35.804725 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dadff42-54ee-40dd-a9ee-f66e1b99fb47 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:35.806208 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dadff42-54ee-40dd-a9ee-f66e1b99fb47 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:35.834919 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 30/57] 10.222.0.20 () {60 vars in 1140 bytes} [Wed Mar 30 07:01:35 2022] POST /identity/v3/projects => generated 298 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 07:01:38.146114 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad02a286-d2c9-4d36-9199-04319abbea16 None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:38.146952 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad02a286-d2c9-4d36-9199-04319abbea16 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:38.146952 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad02a286-d2c9-4d36-9199-04319abbea16 None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:38.149921 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 28/58] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:01:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:01:38.156449 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa092362-4248-4985-933d-aed747b9e312 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:38.157108 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa092362-4248-4985-933d-aed747b9e312 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:38.157364 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa092362-4248-4985-933d-aed747b9e312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:38.179360 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-fa092362-4248-4985-933d-aed747b9e312 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:01:38.180559 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-fa092362-4248-4985-933d-aed747b9e312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:01:38.261998 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 31/59] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:01:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 07:01:38.287526 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad02a286-d2c9-4d36-9199-04319abbea16 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:38.391434 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad02a286-d2c9-4d36-9199-04319abbea16 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:38.426749 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daf15cb-be61-4e9d-8823-af81ff493a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:38.427518 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daf15cb-be61-4e9d-8823-af81ff493a5c None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:38.427799 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daf15cb-be61-4e9d-8823-af81ff493a5c None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:38.428113 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daf15cb-be61-4e9d-8823-af81ff493a5c None admin] PATH_INFO: `/v3/domains/default` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:38.429332 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daf15cb-be61-4e9d-8823-af81ff493a5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:38.430797 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daf15cb-be61-4e9d-8823-af81ff493a5c None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:38.432692 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 29/60] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:01:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:01:38.440181 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa092362-4248-4985-933d-aed747b9e312 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:38.557245 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa092362-4248-4985-933d-aed747b9e312 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:38.605784 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2becd874-4226-44ef-9d2a-7bd039b9c826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:38.606455 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2becd874-4226-44ef-9d2a-7bd039b9c826 None admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:38.606690 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2becd874-4226-44ef-9d2a-7bd039b9c826 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:38.606999 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2becd874-4226-44ef-9d2a-7bd039b9c826 None admin] PATH_INFO: `/v3/users` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:38.607706 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2becd874-4226-44ef-9d2a-7bd039b9c826 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:38.609235 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2becd874-4226-44ef-9d2a-7bd039b9c826 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:38.643317 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 32/61] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Mar 30 07:01:38 2022] POST /identity/v3/users => generated 275 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:01:42.130745 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e80e56-6499-455b-a553-367b5e7618a6 None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:42.131279 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e80e56-6499-455b-a553-367b5e7618a6 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:42.131279 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e80e56-6499-455b-a553-367b5e7618a6 None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:42.133514 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 30/62] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:01:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:01:42.140147 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eab42a-143e-48de-ac1f-2f40624d4a5b None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:42.140650 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eab42a-143e-48de-ac1f-2f40624d4a5b None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:42.140723 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eab42a-143e-48de-ac1f-2f40624d4a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:42.164875 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-a8eab42a-143e-48de-ac1f-2f40624d4a5b None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:01:42.166075 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-a8eab42a-143e-48de-ac1f-2f40624d4a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:01:42.265542 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 33/63] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:01:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 30 07:01:42.313573 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e80e56-6499-455b-a553-367b5e7618a6 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:42.362562 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0fb52d-3002-4ecc-bc88-bab8ec00d848 None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:42.363230 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0fb52d-3002-4ecc-bc88-bab8ec00d848 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:42.363722 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0fb52d-3002-4ecc-bc88-bab8ec00d848 None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:42.365910 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 34/64] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:01:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:01:42.381584 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8a7f4b-7ed8-434b-96bc-31d07022159b None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:42.382166 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8a7f4b-7ed8-434b-96bc-31d07022159b None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:42.382633 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8a7f4b-7ed8-434b-96bc-31d07022159b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:42.412863 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-6f8a7f4b-7ed8-434b-96bc-31d07022159b None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:01:42.414387 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-6f8a7f4b-7ed8-434b-96bc-31d07022159b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:01:42.444724 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e80e56-6499-455b-a553-367b5e7618a6 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:42.507446 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e090d438-d243-48b9-94b1-28bc8b377afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:42.508292 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e090d438-d243-48b9-94b1-28bc8b377afb None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:42.508733 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e090d438-d243-48b9-94b1-28bc8b377afb None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:42.509160 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e090d438-d243-48b9-94b1-28bc8b377afb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:42.519280 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 35/65] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:01:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 07:01:42.520300 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e090d438-d243-48b9-94b1-28bc8b377afb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 07:01:42.521202 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce5c12-c1b1-4f3f-ba20-3a9ef40cae94 None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:42.521583 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce5c12-c1b1-4f3f-ba20-3a9ef40cae94 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:42.521948 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce5c12-c1b1-4f3f-ba20-3a9ef40cae94 None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:42.523713 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 36/66] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:01:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:01:42.528453 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-e090d438-d243-48b9-94b1-28bc8b377afb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 30 07:01:42.529147 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b82779-7542-45d3-a2c6-18b17d6cac56 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:42.529530 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b82779-7542-45d3-a2c6-18b17d6cac56 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:42.529903 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b82779-7542-45d3-a2c6-18b17d6cac56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:42.530354 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 31/67] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Mar 30 07:01:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:01:42.542666 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e090d438-d243-48b9-94b1-28bc8b377afb None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:42.552140 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-42b82779-7542-45d3-a2c6-18b17d6cac56 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:01:42.553519 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-42b82779-7542-45d3-a2c6-18b17d6cac56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:01:42.619890 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 37/68] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:01:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 30 07:01:42.621142 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b82779-7542-45d3-a2c6-18b17d6cac56 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:42.642741 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e090d438-d243-48b9-94b1-28bc8b377afb None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:42.676523 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2013efe-059d-4c2f-adc9-558a44ae2260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:42.677336 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2013efe-059d-4c2f-adc9-558a44ae2260 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:42.677849 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2013efe-059d-4c2f-adc9-558a44ae2260 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:42.677952 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2013efe-059d-4c2f-adc9-558a44ae2260 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:42.688152 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2013efe-059d-4c2f-adc9-558a44ae2260 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 07:01:42.695124 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-e2013efe-059d-4c2f-adc9-558a44ae2260 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 30 07:01:42.696542 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 32/69] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Mar 30 07:01:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 07:01:42.697749 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977cd14b-27ec-415b-975a-c0e9911d5bfa None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:42.698042 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977cd14b-27ec-415b-975a-c0e9911d5bfa None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:42.698324 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977cd14b-27ec-415b-975a-c0e9911d5bfa None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:42.704085 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 33/70] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:01:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:01:42.704085 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977cd14b-27ec-415b-975a-c0e9911d5bfa None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:42.720826 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b82779-7542-45d3-a2c6-18b17d6cac56 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:42.758768 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c31ca0-50b0-44c8-a50c-0eb868e6a41d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:42.759449 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c31ca0-50b0-44c8-a50c-0eb868e6a41d None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:42.759738 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c31ca0-50b0-44c8-a50c-0eb868e6a41d None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:42.760044 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c31ca0-50b0-44c8-a50c-0eb868e6a41d None admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:42.760802 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c31ca0-50b0-44c8-a50c-0eb868e6a41d None admin] RBAC: Adding query filter params (name=admin) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:01:42.761105 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c31ca0-50b0-44c8-a50c-0eb868e6a41d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:42.762838 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c31ca0-50b0-44c8-a50c-0eb868e6a41d None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:42.771237 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 38/71] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Mar 30 07:01:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:01:42.773524 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c31ca0-50b0-44c8-a50c-0eb868e6a41d None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:42.802641 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977cd14b-27ec-415b-975a-c0e9911d5bfa None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:42.835846 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a315573-8291-4447-8a46-2947b230acb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:42.837062 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a315573-8291-4447-8a46-2947b230acb8 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:42.837518 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a315573-8291-4447-8a46-2947b230acb8 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:42.837985 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a315573-8291-4447-8a46-2947b230acb8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:42.848447 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a315573-8291-4447-8a46-2947b230acb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 07:01:42.855830 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-5a315573-8291-4447-8a46-2947b230acb8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 30 07:01:42.857036 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 34/72] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Mar 30 07:01:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:01:42.858194 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782219a1-d375-4231-9d9d-649989cb791c None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:42.858473 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782219a1-d375-4231-9d9d-649989cb791c None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:42.858741 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782219a1-d375-4231-9d9d-649989cb791c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:42.869563 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c31ca0-50b0-44c8-a50c-0eb868e6a41d None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:42.876338 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-782219a1-d375-4231-9d9d-649989cb791c None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:01:42.877522 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-782219a1-d375-4231-9d9d-649989cb791c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:01:42.902242 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b231a9-8b1d-488a-a569-3b0860d2c159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:42.902875 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b231a9-8b1d-488a-a569-3b0860d2c159 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:42.903165 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b231a9-8b1d-488a-a569-3b0860d2c159 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:42.903444 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b231a9-8b1d-488a-a569-3b0860d2c159 None admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:42.904253 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b231a9-8b1d-488a-a569-3b0860d2c159 None admin] RBAC: Adding query filter params (name=member) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:01:42.904562 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b231a9-8b1d-488a-a569-3b0860d2c159 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:42.905972 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b231a9-8b1d-488a-a569-3b0860d2c159 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:42.913968 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 39/73] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Mar 30 07:01:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:01:42.918626 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b231a9-8b1d-488a-a569-3b0860d2c159 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:42.940631 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 35/74] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:01:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 07:01:42.952968 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d5f064-c6e3-4725-9fb0-baf3fbdc3f74 None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:42.952968 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d5f064-c6e3-4725-9fb0-baf3fbdc3f74 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:42.952968 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d5f064-c6e3-4725-9fb0-baf3fbdc3f74 None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:42.952968 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 36/75] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:01:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:01:42.952968 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d5f064-c6e3-4725-9fb0-baf3fbdc3f74 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:43.008784 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b231a9-8b1d-488a-a569-3b0860d2c159 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:43.042262 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827a9d4e-a6b0-4721-8fbb-75e9f7c83ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:43.043173 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a9d4e-a6b0-4721-8fbb-75e9f7c83ea6 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:43.043460 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a9d4e-a6b0-4721-8fbb-75e9f7c83ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:43.043733 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a9d4e-a6b0-4721-8fbb-75e9f7c83ea6 None admin] PATH_INFO: `/v3/users/3226f67e8def44ad8010bab402b41414` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:43.043917 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d5f064-c6e3-4725-9fb0-baf3fbdc3f74 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:43.045024 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827a9d4e-a6b0-4721-8fbb-75e9f7c83ea6 None admin] RBAC: Authorizing `identity:get_user(user_id=3226f67e8def44ad8010bab402b41414)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:43.046495 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827a9d4e-a6b0-4721-8fbb-75e9f7c83ea6 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:43.048141 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 40/76] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Mar 30 07:01:42 2022] GET /identity/v3/users/3226f67e8def44ad8010bab402b41414 => generated 247 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:01:43.052815 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827a9d4e-a6b0-4721-8fbb-75e9f7c83ea6 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:43.077265 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe4214f-23ea-4521-9cc6-3945c591fcdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:43.077933 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe4214f-23ea-4521-9cc6-3945c591fcdd None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:43.078224 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe4214f-23ea-4521-9cc6-3945c591fcdd None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:43.078503 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe4214f-23ea-4521-9cc6-3945c591fcdd None admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:43.079255 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe4214f-23ea-4521-9cc6-3945c591fcdd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:01:43.079564 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe4214f-23ea-4521-9cc6-3945c591fcdd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:43.081003 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe4214f-23ea-4521-9cc6-3945c591fcdd None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:43.092288 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 37/77] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Mar 30 07:01:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:01:43.093502 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df524794-966e-4ccf-aef9-18ebfe6bdef6 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:43.093794 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df524794-966e-4ccf-aef9-18ebfe6bdef6 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:43.094074 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df524794-966e-4ccf-aef9-18ebfe6bdef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:43.109866 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-df524794-966e-4ccf-aef9-18ebfe6bdef6 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:01:43.111057 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-df524794-966e-4ccf-aef9-18ebfe6bdef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:01:43.152157 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827a9d4e-a6b0-4721-8fbb-75e9f7c83ea6 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:43.176101 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 38/78] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:01:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 07:01:43.180739 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df524794-966e-4ccf-aef9-18ebfe6bdef6 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:43.184673 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535e0542-ef5e-4de2-8fb6-894e15967c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:43.185564 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535e0542-ef5e-4de2-8fb6-894e15967c75 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:43.185862 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535e0542-ef5e-4de2-8fb6-894e15967c75 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:43.186123 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535e0542-ef5e-4de2-8fb6-894e15967c75 None admin] PATH_INFO: `/v3/users/733e72413c1843f3a51be8e04c684d6b` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:43.201163 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535e0542-ef5e-4de2-8fb6-894e15967c75 None admin] RBAC: Authorizing `identity:get_user(user_id=733e72413c1843f3a51be8e04c684d6b)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:43.202663 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535e0542-ef5e-4de2-8fb6-894e15967c75 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:43.208938 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 41/79] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Mar 30 07:01:43 2022] GET /identity/v3/users/733e72413c1843f3a51be8e04c684d6b => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:01:43.208938 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535e0542-ef5e-4de2-8fb6-894e15967c75 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:43.284522 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df524794-966e-4ccf-aef9-18ebfe6bdef6 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:43.305619 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535e0542-ef5e-4de2-8fb6-894e15967c75 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:43.318067 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2878a355-68ef-4a08-ae8b-035dfeb7fe66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:43.318871 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2878a355-68ef-4a08-ae8b-035dfeb7fe66 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:43.319127 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2878a355-68ef-4a08-ae8b-035dfeb7fe66 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:43.319430 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2878a355-68ef-4a08-ae8b-035dfeb7fe66 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:43.329875 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2878a355-68ef-4a08-ae8b-035dfeb7fe66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 07:01:43.336790 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-2878a355-68ef-4a08-ae8b-035dfeb7fe66 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 30 07:01:43.338009 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 39/80] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Mar 30 07:01:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:01:43.338440 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6645cb90-67c1-4bcf-b251-4c24cbc37f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:43.338777 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2878a355-68ef-4a08-ae8b-035dfeb7fe66 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:43.339063 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6645cb90-67c1-4bcf-b251-4c24cbc37f28 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:43.339352 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6645cb90-67c1-4bcf-b251-4c24cbc37f28 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:43.339679 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6645cb90-67c1-4bcf-b251-4c24cbc37f28 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:43.406562 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6645cb90-67c1-4bcf-b251-4c24cbc37f28 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:43.408068 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6645cb90-67c1-4bcf-b251-4c24cbc37f28 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:43.434528 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2878a355-68ef-4a08-ae8b-035dfeb7fe66 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:43.469524 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66452d99-f3b4-4e27-8f3c-aa39915b3b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:43.470376 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66452d99-f3b4-4e27-8f3c-aa39915b3b45 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:43.470740 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66452d99-f3b4-4e27-8f3c-aa39915b3b45 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:43.470993 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66452d99-f3b4-4e27-8f3c-aa39915b3b45 None admin] PATH_INFO: `/v3/users/733e72413c1843f3a51be8e04c684d6b` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:43.472242 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66452d99-f3b4-4e27-8f3c-aa39915b3b45 None admin] RBAC: Authorizing `identity:get_user(user_id=733e72413c1843f3a51be8e04c684d6b)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:43.473733 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66452d99-f3b4-4e27-8f3c-aa39915b3b45 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:43.475598 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 40/81] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Mar 30 07:01:43 2022] GET /identity/v3/users/733e72413c1843f3a51be8e04c684d6b => generated 275 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:01:43.476176 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66452d99-f3b4-4e27-8f3c-aa39915b3b45 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:43.505503 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 42/82] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Mar 30 07:01:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 30 07:01:43.506389 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6645cb90-67c1-4bcf-b251-4c24cbc37f28 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:43.573578 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66452d99-f3b4-4e27-8f3c-aa39915b3b45 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:43.602217 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6645cb90-67c1-4bcf-b251-4c24cbc37f28 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:43.606189 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c83926c-5ce6-487c-b0eb-03db1cd28892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:43.606983 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c83926c-5ce6-487c-b0eb-03db1cd28892 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:43.607265 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c83926c-5ce6-487c-b0eb-03db1cd28892 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:43.607540 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c83926c-5ce6-487c-b0eb-03db1cd28892 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:43.608779 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c83926c-5ce6-487c-b0eb-03db1cd28892 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:43.610246 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c83926c-5ce6-487c-b0eb-03db1cd28892 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:43.612258 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 41/83] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:01:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:01:43.616912 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c83926c-5ce6-487c-b0eb-03db1cd28892 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:43.635211 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74491926-33cd-484a-b605-64a0184aee67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:43.635867 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74491926-33cd-484a-b605-64a0184aee67 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:43.636161 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74491926-33cd-484a-b605-64a0184aee67 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:43.636500 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74491926-33cd-484a-b605-64a0184aee67 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:43.699801 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74491926-33cd-484a-b605-64a0184aee67 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:43.701235 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74491926-33cd-484a-b605-64a0184aee67 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:43.712400 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c83926c-5ce6-487c-b0eb-03db1cd28892 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:43.746929 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25682e6e-41d5-4a5e-8753-7220ebb59c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:43.747605 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25682e6e-41d5-4a5e-8753-7220ebb59c71 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:43.747915 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25682e6e-41d5-4a5e-8753-7220ebb59c71 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:43.748193 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25682e6e-41d5-4a5e-8753-7220ebb59c71 None admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:43.748946 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25682e6e-41d5-4a5e-8753-7220ebb59c71 None admin] RBAC: Adding query filter params (name=member) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:01:43.749254 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25682e6e-41d5-4a5e-8753-7220ebb59c71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:43.750668 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25682e6e-41d5-4a5e-8753-7220ebb59c71 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:43.759146 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 42/84] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Mar 30 07:01:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:01:43.759849 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25682e6e-41d5-4a5e-8753-7220ebb59c71 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:43.801280 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 43/85] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Mar 30 07:01:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 30 07:01:43.802148 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74491926-33cd-484a-b605-64a0184aee67 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:43.857219 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25682e6e-41d5-4a5e-8753-7220ebb59c71 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:43.889575 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624412b5-c2c7-423f-bd0d-3d5809f74b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:43.890241 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624412b5-c2c7-423f-bd0d-3d5809f74b21 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:43.890524 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624412b5-c2c7-423f-bd0d-3d5809f74b21 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:43.890802 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624412b5-c2c7-423f-bd0d-3d5809f74b21 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:43.904064 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74491926-33cd-484a-b605-64a0184aee67 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:43.935195 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e353d4a-25aa-4d7f-89f9-d4cb9bc23363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:43.936092 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e353d4a-25aa-4d7f-89f9-d4cb9bc23363 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:43.936369 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e353d4a-25aa-4d7f-89f9-d4cb9bc23363 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:43.936611 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e353d4a-25aa-4d7f-89f9-d4cb9bc23363 None admin] PATH_INFO: `/v3/projects/03146c35f6b74534aaeb260041749b99` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:43.937795 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e353d4a-25aa-4d7f-89f9-d4cb9bc23363 None admin] RBAC: Authorizing `identity:get_project(project_id=03146c35f6b74534aaeb260041749b99)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:43.939257 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e353d4a-25aa-4d7f-89f9-d4cb9bc23363 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:43.941017 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 44/86] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Mar 30 07:01:43 2022] GET /identity/v3/projects/03146c35f6b74534aaeb260041749b99 => generated 298 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:01:43.942940 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e353d4a-25aa-4d7f-89f9-d4cb9bc23363 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:43.958782 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624412b5-c2c7-423f-bd0d-3d5809f74b21 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:43.960249 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624412b5-c2c7-423f-bd0d-3d5809f74b21 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:44.038063 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e353d4a-25aa-4d7f-89f9-d4cb9bc23363 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:44.057095 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 43/87] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Mar 30 07:01:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 30 07:01:44.060711 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624412b5-c2c7-423f-bd0d-3d5809f74b21 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:44.071421 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c5b2f7-b734-49a3-88bf-a44307178fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:44.072135 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c5b2f7-b734-49a3-88bf-a44307178fff None admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:44.072420 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c5b2f7-b734-49a3-88bf-a44307178fff None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:44.072696 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c5b2f7-b734-49a3-88bf-a44307178fff None admin] PATH_INFO: `/v3/users` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:44.073408 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c5b2f7-b734-49a3-88bf-a44307178fff None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:44.074908 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c5b2f7-b734-49a3-88bf-a44307178fff None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:44.107842 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 45/88] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Mar 30 07:01:43 2022] POST /identity/v3/users => generated 289 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:01:44.107842 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c5b2f7-b734-49a3-88bf-a44307178fff None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:44.165820 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624412b5-c2c7-423f-bd0d-3d5809f74b21 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:44.201650 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aefe4fe-c7b7-4106-9b62-a5356bdd6ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:44.202351 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c5b2f7-b734-49a3-88bf-a44307178fff None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:44.208092 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aefe4fe-c7b7-4106-9b62-a5356bdd6ad4 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:44.208403 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aefe4fe-c7b7-4106-9b62-a5356bdd6ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:44.208657 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aefe4fe-c7b7-4106-9b62-a5356bdd6ad4 None admin] PATH_INFO: `/v3/users/733e72413c1843f3a51be8e04c684d6b` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:44.210120 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aefe4fe-c7b7-4106-9b62-a5356bdd6ad4 None admin] RBAC: Authorizing `identity:get_user(user_id=733e72413c1843f3a51be8e04c684d6b)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:44.211645 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aefe4fe-c7b7-4106-9b62-a5356bdd6ad4 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:44.213594 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 44/89] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Mar 30 07:01:44 2022] GET /identity/v3/users/733e72413c1843f3a51be8e04c684d6b => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:01:44.214185 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aefe4fe-c7b7-4106-9b62-a5356bdd6ad4 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:44.244171 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96af6b1-5910-4196-8b2e-a4882564097c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:44.245058 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96af6b1-5910-4196-8b2e-a4882564097c None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:44.245326 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96af6b1-5910-4196-8b2e-a4882564097c None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:44.245596 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96af6b1-5910-4196-8b2e-a4882564097c None admin] PATH_INFO: `/v3/projects/03146c35f6b74534aaeb260041749b99` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:44.246889 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96af6b1-5910-4196-8b2e-a4882564097c None admin] RBAC: Authorizing `identity:get_project(project_id=03146c35f6b74534aaeb260041749b99)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:44.248395 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96af6b1-5910-4196-8b2e-a4882564097c None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:44.255503 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 46/90] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Mar 30 07:01:44 2022] GET /identity/v3/projects/03146c35f6b74534aaeb260041749b99 => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:01:44.255503 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96af6b1-5910-4196-8b2e-a4882564097c None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:44.319726 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aefe4fe-c7b7-4106-9b62-a5356bdd6ad4 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:44.352544 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96af6b1-5910-4196-8b2e-a4882564097c None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:44.356930 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544e1427-f617-4216-93b2-7ec640dadd5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:44.357842 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544e1427-f617-4216-93b2-7ec640dadd5d None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:44.358281 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544e1427-f617-4216-93b2-7ec640dadd5d None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:44.358728 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544e1427-f617-4216-93b2-7ec640dadd5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:44.359726 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544e1427-f617-4216-93b2-7ec640dadd5d None admin] RBAC: Adding query filter params (role.id=1c39b9ab8cfd4c0ea71845831920a845, scope.project.id=03146c35f6b74534aaeb260041749b99, user.id=3226f67e8def44ad8010bab402b41414) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:01:44.360072 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544e1427-f617-4216-93b2-7ec640dadd5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:44.361912 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544e1427-f617-4216-93b2-7ec640dadd5d None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:44.368849 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 45/91] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Mar 30 07:01:44 2022] GET /identity/v3/role_assignments?user.id=3226f67e8def44ad8010bab402b41414&scope.project.id=03146c35f6b74534aaeb260041749b99&role.id=1c39b9ab8cfd4c0ea71845831920a845 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:01:44.369753 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544e1427-f617-4216-93b2-7ec640dadd5d None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:44.390542 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d2727e-771a-48c0-aa13-80c329e347ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:44.391923 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d2727e-771a-48c0-aa13-80c329e347ff None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:44.392412 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d2727e-771a-48c0-aa13-80c329e347ff None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:44.392875 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d2727e-771a-48c0-aa13-80c329e347ff None admin] PATH_INFO: `/v3/projects/03146c35f6b74534aaeb260041749b99` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:44.394440 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d2727e-771a-48c0-aa13-80c329e347ff None admin] RBAC: Authorizing `identity:get_project(project_id=03146c35f6b74534aaeb260041749b99)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:44.396239 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d2727e-771a-48c0-aa13-80c329e347ff None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:44.398404 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 47/92] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Mar 30 07:01:44 2022] GET /identity/v3/projects/03146c35f6b74534aaeb260041749b99 => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:01:44.399485 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d2727e-771a-48c0-aa13-80c329e347ff None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:44.501270 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544e1427-f617-4216-93b2-7ec640dadd5d None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:44.510173 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d2727e-771a-48c0-aa13-80c329e347ff None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:44.536140 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c2569a-c7cb-41ae-9c2d-d11980f129a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:44.536895 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c2569a-c7cb-41ae-9c2d-d11980f129a4 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:44.537264 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c2569a-c7cb-41ae-9c2d-d11980f129a4 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:44.537606 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c2569a-c7cb-41ae-9c2d-d11980f129a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:44.547095 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1a2559-1a22-4985-812d-da5fe688c702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:44.548144 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1a2559-1a22-4985-812d-da5fe688c702 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:44.548636 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1a2559-1a22-4985-812d-da5fe688c702 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:44.549098 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1a2559-1a22-4985-812d-da5fe688c702 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:44.550143 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1a2559-1a22-4985-812d-da5fe688c702 None admin] RBAC: Adding query filter params (role.id=5d79031a64754b57ba120367465e2252, scope.project.id=03146c35f6b74534aaeb260041749b99, user.id=733e72413c1843f3a51be8e04c684d6b) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:01:44.550679 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1a2559-1a22-4985-812d-da5fe688c702 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:44.552498 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1a2559-1a22-4985-812d-da5fe688c702 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:44.562406 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 48/93] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Mar 30 07:01:44 2022] GET /identity/v3/role_assignments?user.id=733e72413c1843f3a51be8e04c684d6b&scope.project.id=03146c35f6b74534aaeb260041749b99&role.id=5d79031a64754b57ba120367465e2252 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:01:44.563398 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1a2559-1a22-4985-812d-da5fe688c702 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:44.618178 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c2569a-c7cb-41ae-9c2d-d11980f129a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:44.619694 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c2569a-c7cb-41ae-9c2d-d11980f129a4 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:44.696650 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1a2559-1a22-4985-812d-da5fe688c702 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:44.730943 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 46/94] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Mar 30 07:01:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 30 07:01:44.731691 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8379354-4854-4637-809f-ffb48f5682fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:44.732590 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8379354-4854-4637-809f-ffb48f5682fc None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:44.733068 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8379354-4854-4637-809f-ffb48f5682fc None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:44.733510 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8379354-4854-4637-809f-ffb48f5682fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:44.734612 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8379354-4854-4637-809f-ffb48f5682fc None admin] RBAC: Adding query filter params (role.id=075d8bdffff942c29baa73114127d3fa, scope.project.id=03146c35f6b74534aaeb260041749b99, user.id=733e72413c1843f3a51be8e04c684d6b) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:01:44.735098 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8379354-4854-4637-809f-ffb48f5682fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:44.737145 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8379354-4854-4637-809f-ffb48f5682fc None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:44.737270 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c2569a-c7cb-41ae-9c2d-d11980f129a4 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:44.743727 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 49/95] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Mar 30 07:01:44 2022] GET /identity/v3/role_assignments?user.id=733e72413c1843f3a51be8e04c684d6b&scope.project.id=03146c35f6b74534aaeb260041749b99&role.id=075d8bdffff942c29baa73114127d3fa => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:01:44.855638 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c2569a-c7cb-41ae-9c2d-d11980f129a4 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:44.892561 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be611b49-8fcb-4f70-b710-b5a17c6325b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:44.893752 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be611b49-8fcb-4f70-b710-b5a17c6325b5 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:44.894227 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be611b49-8fcb-4f70-b710-b5a17c6325b5 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:44.894687 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be611b49-8fcb-4f70-b710-b5a17c6325b5 None admin] PATH_INFO: `/v3/projects/403939f69cde4d87bc0ce9540534ba13` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:44.896142 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be611b49-8fcb-4f70-b710-b5a17c6325b5 None admin] RBAC: Authorizing `identity:get_project(project_id=403939f69cde4d87bc0ce9540534ba13)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:44.897837 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be611b49-8fcb-4f70-b710-b5a17c6325b5 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:44.899907 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 47/96] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Mar 30 07:01:44 2022] GET /identity/v3/projects/403939f69cde4d87bc0ce9540534ba13 => generated 312 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:01:44.906507 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8379354-4854-4637-809f-ffb48f5682fc None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:45.019683 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8379354-4854-4637-809f-ffb48f5682fc None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:45.055635 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8320e93b-05ea-4256-b5a5-699023499c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:45.056762 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8320e93b-05ea-4256-b5a5-699023499c32 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:45.057220 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8320e93b-05ea-4256-b5a5-699023499c32 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:45.057674 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8320e93b-05ea-4256-b5a5-699023499c32 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:45.058735 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8320e93b-05ea-4256-b5a5-699023499c32 None admin] RBAC: Adding query filter params (role.id=5d79031a64754b57ba120367465e2252, scope.project.id=403939f69cde4d87bc0ce9540534ba13, user.id=733e72413c1843f3a51be8e04c684d6b) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:01:45.059221 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8320e93b-05ea-4256-b5a5-699023499c32 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:45.060884 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8320e93b-05ea-4256-b5a5-699023499c32 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:45.067108 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 50/97] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Mar 30 07:01:44 2022] GET /identity/v3/role_assignments?user.id=733e72413c1843f3a51be8e04c684d6b&scope.project.id=403939f69cde4d87bc0ce9540534ba13&role.id=5d79031a64754b57ba120367465e2252 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:01:47.287503 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b60a2-7303-48e2-843d-9e5dad8dc59f None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:47.288487 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b60a2-7303-48e2-843d-9e5dad8dc59f None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:47.288962 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b60a2-7303-48e2-843d-9e5dad8dc59f None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:47.290968 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 48/98] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:01:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:01:47.297046 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72da08ae-fbfb-4352-87ee-a5ca726e56ac None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:47.297925 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72da08ae-fbfb-4352-87ee-a5ca726e56ac None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:47.298406 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72da08ae-fbfb-4352-87ee-a5ca726e56ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:47.323375 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-72da08ae-fbfb-4352-87ee-a5ca726e56ac None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:01:47.325077 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-72da08ae-fbfb-4352-87ee-a5ca726e56ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:01:47.360372 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b57a264-9a7a-43cf-a6f4-18e4c8ca4bb1 None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:47.361009 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b57a264-9a7a-43cf-a6f4-18e4c8ca4bb1 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:47.361848 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b57a264-9a7a-43cf-a6f4-18e4c8ca4bb1 None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:47.363851 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 49/99] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:01:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:01:47.369365 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4f2347-ff5b-4c4f-9c09-ad9396f4f679 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:47.370035 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4f2347-ff5b-4c4f-9c09-ad9396f4f679 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:47.370506 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4f2347-ff5b-4c4f-9c09-ad9396f4f679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:47.400575 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-7d4f2347-ff5b-4c4f-9c09-ad9396f4f679 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:01:47.404714 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-7d4f2347-ff5b-4c4f-9c09-ad9396f4f679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:01:47.454642 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 51/100] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:01:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 07:01:47.478225 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72da08ae-fbfb-4352-87ee-a5ca726e56ac None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:47.558176 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 50/101] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:01:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 07:01:47.605655 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4f2347-ff5b-4c4f-9c09-ad9396f4f679 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:47.615825 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72da08ae-fbfb-4352-87ee-a5ca726e56ac None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:47.651346 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477d9a0d-c727-4e0f-8829-7aed52af9295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:47.652783 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477d9a0d-c727-4e0f-8829-7aed52af9295 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:47.653260 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477d9a0d-c727-4e0f-8829-7aed52af9295 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:47.653880 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477d9a0d-c727-4e0f-8829-7aed52af9295 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:47.665408 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477d9a0d-c727-4e0f-8829-7aed52af9295 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 07:01:47.673220 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-477d9a0d-c727-4e0f-8829-7aed52af9295 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 30 07:01:47.674813 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 52/102] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Mar 30 07:01:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 07:01:47.680790 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477d9a0d-c727-4e0f-8829-7aed52af9295 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:47.827581 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4f2347-ff5b-4c4f-9c09-ad9396f4f679 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:47.866970 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd6323b-e635-464f-a461-f824e2123704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:47.868174 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd6323b-e635-464f-a461-f824e2123704 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:47.868672 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd6323b-e635-464f-a461-f824e2123704 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:47.869400 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd6323b-e635-464f-a461-f824e2123704 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:47.870963 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd6323b-e635-464f-a461-f824e2123704 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:47.873099 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd6323b-e635-464f-a461-f824e2123704 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:47.875262 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 51/103] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:01:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:01:47.876904 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb1106f-ea43-4f45-a7d4-832c9260e44e None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:47.877725 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb1106f-ea43-4f45-a7d4-832c9260e44e None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:47.878316 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb1106f-ea43-4f45-a7d4-832c9260e44e None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:47.880674 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 52/104] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:01:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:01:47.881731 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb1106f-ea43-4f45-a7d4-832c9260e44e None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:47.893999 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477d9a0d-c727-4e0f-8829-7aed52af9295 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:47.991849 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3ac9b3-eb3f-4d2a-9336-dc4a4008fe77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:47.991849 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3ac9b3-eb3f-4d2a-9336-dc4a4008fe77 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:47.991849 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3ac9b3-eb3f-4d2a-9336-dc4a4008fe77 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:47.991849 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3ac9b3-eb3f-4d2a-9336-dc4a4008fe77 None admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:47.992304 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3ac9b3-eb3f-4d2a-9336-dc4a4008fe77 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:01:47.992304 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3ac9b3-eb3f-4d2a-9336-dc4a4008fe77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:47.992304 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3ac9b3-eb3f-4d2a-9336-dc4a4008fe77 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:48.001344 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 53/105] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Mar 30 07:01:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:01:48.003111 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2183522-c563-4cca-a4bc-51937f8f5366 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:48.003502 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2183522-c563-4cca-a4bc-51937f8f5366 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:48.003915 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2183522-c563-4cca-a4bc-51937f8f5366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:48.008187 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb1106f-ea43-4f45-a7d4-832c9260e44e None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:48.036896 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-b2183522-c563-4cca-a4bc-51937f8f5366 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:01:48.038095 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-b2183522-c563-4cca-a4bc-51937f8f5366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:01:48.051030 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c3d300-35c7-4e17-8a91-e2c371c2d974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:48.053365 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c3d300-35c7-4e17-8a91-e2c371c2d974 None admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:48.053651 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c3d300-35c7-4e17-8a91-e2c371c2d974 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:48.053930 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c3d300-35c7-4e17-8a91-e2c371c2d974 None admin] PATH_INFO: `/v3/projects` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:48.055841 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c3d300-35c7-4e17-8a91-e2c371c2d974 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:48.057369 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c3d300-35c7-4e17-8a91-e2c371c2d974 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:48.103357 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 53/106] 10.222.0.20 () {60 vars in 1141 bytes} [Wed Mar 30 07:01:47 2022] POST /identity/v3/projects => generated 302 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:01:48.104007 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c3d300-35c7-4e17-8a91-e2c371c2d974 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:48.176258 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 54/107] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:01:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 07:01:48.188300 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f6395e-387d-43d0-9820-552729006b21 None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:48.188640 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f6395e-387d-43d0-9820-552729006b21 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:48.188871 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f6395e-387d-43d0-9820-552729006b21 None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:48.190687 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 55/108] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:01:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 30 07:01:48.196282 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70bfa8f-dff8-43f7-aa87-8c8fcd2731b5 None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:48.196671 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70bfa8f-dff8-43f7-aa87-8c8fcd2731b5 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:48.197053 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70bfa8f-dff8-43f7-aa87-8c8fcd2731b5 None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:48.199034 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 56/109] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:01:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:01:48.200388 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46a643a-d9d3-4a0d-9a4a-cb417d659498 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:48.203349 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46a643a-d9d3-4a0d-9a4a-cb417d659498 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:48.203349 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46a643a-d9d3-4a0d-9a4a-cb417d659498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:48.227455 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-e46a643a-d9d3-4a0d-9a4a-cb417d659498 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:01:48.229076 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-e46a643a-d9d3-4a0d-9a4a-cb417d659498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:01:48.279028 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c3d300-35c7-4e17-8a91-e2c371c2d974 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:48.315519 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 57/110] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:01:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 30 07:01:48.316323 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c32e927-fea8-4a30-8e8a-c0fffb0c5c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:48.317660 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c32e927-fea8-4a30-8e8a-c0fffb0c5c32 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:48.318073 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c32e927-fea8-4a30-8e8a-c0fffb0c5c32 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:48.318464 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c32e927-fea8-4a30-8e8a-c0fffb0c5c32 None admin] PATH_INFO: `/v3/users/7c16c4dc95fa428c9f4892e490dc3378` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:48.323707 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f73ac94-e7a5-4add-8643-097736ae8d67 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:48.324125 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f73ac94-e7a5-4add-8643-097736ae8d67 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:48.324499 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f73ac94-e7a5-4add-8643-097736ae8d67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:48.335636 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c32e927-fea8-4a30-8e8a-c0fffb0c5c32 None admin] RBAC: Authorizing `identity:get_user(user_id=7c16c4dc95fa428c9f4892e490dc3378)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:48.337193 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c32e927-fea8-4a30-8e8a-c0fffb0c5c32 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:48.339093 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 54/111] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Mar 30 07:01:48 2022] GET /identity/v3/users/7c16c4dc95fa428c9f4892e490dc3378 => generated 289 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:01:48.340704 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c32e927-fea8-4a30-8e8a-c0fffb0c5c32 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:48.358406 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-6f73ac94-e7a5-4add-8643-097736ae8d67 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:01:48.359582 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-6f73ac94-e7a5-4add-8643-097736ae8d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:01:48.436158 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 58/112] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:01:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 07:01:48.437519 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f73ac94-e7a5-4add-8643-097736ae8d67 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:48.447030 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c32e927-fea8-4a30-8e8a-c0fffb0c5c32 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:48.480784 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f219ef45-a9a3-485f-9752-3738f4f906ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:48.481607 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f219ef45-a9a3-485f-9752-3738f4f906ef None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:48.481953 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f219ef45-a9a3-485f-9752-3738f4f906ef None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:48.482167 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f219ef45-a9a3-485f-9752-3738f4f906ef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:48.493038 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f219ef45-a9a3-485f-9752-3738f4f906ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 07:01:48.502036 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-f219ef45-a9a3-485f-9752-3738f4f906ef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 30 07:01:48.503597 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 55/113] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Mar 30 07:01:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:01:48.504424 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f219ef45-a9a3-485f-9752-3738f4f906ef None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:48.541436 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f73ac94-e7a5-4add-8643-097736ae8d67 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:48.576369 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefdfd81-158b-4a94-8352-ad18d52b6b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:48.577416 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefdfd81-158b-4a94-8352-ad18d52b6b67 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:48.577962 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefdfd81-158b-4a94-8352-ad18d52b6b67 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:48.578422 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefdfd81-158b-4a94-8352-ad18d52b6b67 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:48.607583 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f219ef45-a9a3-485f-9752-3738f4f906ef None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:48.641770 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dbd350-7fa4-4927-9ceb-a90097c0e20d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:48.642506 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dbd350-7fa4-4927-9ceb-a90097c0e20d None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:48.642791 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dbd350-7fa4-4927-9ceb-a90097c0e20d None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:48.643067 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dbd350-7fa4-4927-9ceb-a90097c0e20d None admin] PATH_INFO: `/v3/roles/member` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:48.647443 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefdfd81-158b-4a94-8352-ad18d52b6b67 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:48.649191 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefdfd81-158b-4a94-8352-ad18d52b6b67 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:48.653780 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dbd350-7fa4-4927-9ceb-a90097c0e20d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 07:01:48.660786 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-21dbd350-7fa4-4927-9ceb-a90097c0e20d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 30 07:01:48.662180 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 56/114] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Mar 30 07:01:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:01:48.662782 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dbd350-7fa4-4927-9ceb-a90097c0e20d None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:48.748240 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 59/115] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Mar 30 07:01:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 30 07:01:48.749499 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefdfd81-158b-4a94-8352-ad18d52b6b67 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:48.760339 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dbd350-7fa4-4927-9ceb-a90097c0e20d None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:48.793288 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7dfde7-2698-440e-a6bd-ef2c0a3466a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:48.794116 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7dfde7-2698-440e-a6bd-ef2c0a3466a6 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:48.794407 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7dfde7-2698-440e-a6bd-ef2c0a3466a6 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:48.794690 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7dfde7-2698-440e-a6bd-ef2c0a3466a6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:48.805013 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7dfde7-2698-440e-a6bd-ef2c0a3466a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 07:01:48.812596 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-6b7dfde7-2698-440e-a6bd-ef2c0a3466a6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 30 07:01:48.813835 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 57/116] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Mar 30 07:01:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:01:48.814602 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7dfde7-2698-440e-a6bd-ef2c0a3466a6 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:48.847720 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefdfd81-158b-4a94-8352-ad18d52b6b67 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:48.884617 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd0c059-c802-4902-ad68-8ec47647d715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:48.885663 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd0c059-c802-4902-ad68-8ec47647d715 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:48.886239 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd0c059-c802-4902-ad68-8ec47647d715 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:48.886714 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd0c059-c802-4902-ad68-8ec47647d715 None admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:48.887714 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd0c059-c802-4902-ad68-8ec47647d715 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:01:48.888233 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd0c059-c802-4902-ad68-8ec47647d715 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:48.889812 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd0c059-c802-4902-ad68-8ec47647d715 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:48.898921 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 60/117] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Mar 30 07:01:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:01:48.900047 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd0c059-c802-4902-ad68-8ec47647d715 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:48.920462 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7dfde7-2698-440e-a6bd-ef2c0a3466a6 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:48.952722 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9db1347-b0aa-4a79-abdb-889231c73be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:48.953408 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9db1347-b0aa-4a79-abdb-889231c73be0 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:48.953684 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9db1347-b0aa-4a79-abdb-889231c73be0 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:48.953963 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9db1347-b0aa-4a79-abdb-889231c73be0 None admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:48.954726 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9db1347-b0aa-4a79-abdb-889231c73be0 None admin] RBAC: Adding query filter params (name=member) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:01:48.955039 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9db1347-b0aa-4a79-abdb-889231c73be0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:48.956474 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9db1347-b0aa-4a79-abdb-889231c73be0 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:48.965302 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 58/118] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Mar 30 07:01:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:01:48.966134 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9db1347-b0aa-4a79-abdb-889231c73be0 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:49.005323 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd0c059-c802-4902-ad68-8ec47647d715 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:49.039422 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12bd053-ee4e-4a63-82df-3dc199485b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:49.040877 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12bd053-ee4e-4a63-82df-3dc199485b4f None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:49.041425 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12bd053-ee4e-4a63-82df-3dc199485b4f None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:49.041908 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12bd053-ee4e-4a63-82df-3dc199485b4f None admin] PATH_INFO: `/v3/projects/03146c35f6b74534aaeb260041749b99` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:49.043499 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12bd053-ee4e-4a63-82df-3dc199485b4f None admin] RBAC: Authorizing `identity:get_project(project_id=03146c35f6b74534aaeb260041749b99)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:49.045094 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12bd053-ee4e-4a63-82df-3dc199485b4f None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:49.046810 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 61/119] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Mar 30 07:01:48 2022] GET /identity/v3/projects/03146c35f6b74534aaeb260041749b99 => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:01:49.048008 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a55321a-7c16-4623-a7c4-baebb97cb5e9 None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:49.048909 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a55321a-7c16-4623-a7c4-baebb97cb5e9 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:49.048909 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a55321a-7c16-4623-a7c4-baebb97cb5e9 None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:49.054297 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 62/120] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:01:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:01:49.054297 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a55321a-7c16-4623-a7c4-baebb97cb5e9 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:49.070344 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9db1347-b0aa-4a79-abdb-889231c73be0 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:49.101925 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c488bc-1619-4275-93bb-7176d44e6960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:49.102601 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c488bc-1619-4275-93bb-7176d44e6960 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:49.102887 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c488bc-1619-4275-93bb-7176d44e6960 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:49.103169 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c488bc-1619-4275-93bb-7176d44e6960 None admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:49.103954 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c488bc-1619-4275-93bb-7176d44e6960 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:01:49.104263 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c488bc-1619-4275-93bb-7176d44e6960 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:49.105985 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c488bc-1619-4275-93bb-7176d44e6960 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:49.118740 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 59/121] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Mar 30 07:01:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:01:49.118740 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c488bc-1619-4275-93bb-7176d44e6960 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:49.161247 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a55321a-7c16-4623-a7c4-baebb97cb5e9 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:49.194284 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a182fd8-35cb-4247-9abe-98342fa2a29c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:49.195164 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a182fd8-35cb-4247-9abe-98342fa2a29c None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:49.195449 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a182fd8-35cb-4247-9abe-98342fa2a29c None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:49.195723 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a182fd8-35cb-4247-9abe-98342fa2a29c None admin] PATH_INFO: `/v3/users/3226f67e8def44ad8010bab402b41414` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:49.196955 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a182fd8-35cb-4247-9abe-98342fa2a29c None admin] RBAC: Authorizing `identity:get_user(user_id=3226f67e8def44ad8010bab402b41414)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:49.198431 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a182fd8-35cb-4247-9abe-98342fa2a29c None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:49.204981 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 63/122] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Mar 30 07:01:49 2022] GET /identity/v3/users/3226f67e8def44ad8010bab402b41414 => generated 247 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:01:49.204981 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a182fd8-35cb-4247-9abe-98342fa2a29c None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:49.219024 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c488bc-1619-4275-93bb-7176d44e6960 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:49.251898 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f48a0c4-d811-4e0b-9218-2a9feb154407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:49.252775 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f48a0c4-d811-4e0b-9218-2a9feb154407 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:49.253049 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f48a0c4-d811-4e0b-9218-2a9feb154407 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:49.253309 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f48a0c4-d811-4e0b-9218-2a9feb154407 None admin] PATH_INFO: `/v3/users/733e72413c1843f3a51be8e04c684d6b` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:49.254516 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f48a0c4-d811-4e0b-9218-2a9feb154407 None admin] RBAC: Authorizing `identity:get_user(user_id=733e72413c1843f3a51be8e04c684d6b)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:49.255988 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f48a0c4-d811-4e0b-9218-2a9feb154407 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:49.257783 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 60/123] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Mar 30 07:01:49 2022] GET /identity/v3/users/733e72413c1843f3a51be8e04c684d6b => generated 275 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:01:49.258956 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23dfed8-4c9f-44da-a793-b9961a222f21 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:49.259202 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23dfed8-4c9f-44da-a793-b9961a222f21 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:49.259475 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23dfed8-4c9f-44da-a793-b9961a222f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:49.278923 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-d23dfed8-4c9f-44da-a793-b9961a222f21 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:01:49.280121 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-d23dfed8-4c9f-44da-a793-b9961a222f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:01:49.312101 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a182fd8-35cb-4247-9abe-98342fa2a29c None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:49.343139 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 61/124] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:01:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 07:01:49.344833 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23dfed8-4c9f-44da-a793-b9961a222f21 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:49.345129 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073b7984-9e05-4a5e-8e89-1d8ebada66fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:49.346267 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b7984-9e05-4a5e-8e89-1d8ebada66fb None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:49.346697 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b7984-9e05-4a5e-8e89-1d8ebada66fb None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:49.347128 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b7984-9e05-4a5e-8e89-1d8ebada66fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:49.348168 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073b7984-9e05-4a5e-8e89-1d8ebada66fb None admin] RBAC: Adding query filter params (role.id=9c31475dead84051aacf6440785d5194, scope.project.id=03146c35f6b74534aaeb260041749b99, user.id=7c16c4dc95fa428c9f4892e490dc3378) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:01:49.348655 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073b7984-9e05-4a5e-8e89-1d8ebada66fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:49.350383 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073b7984-9e05-4a5e-8e89-1d8ebada66fb None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:49.357834 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 64/125] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Mar 30 07:01:49 2022] GET /identity/v3/role_assignments?user.id=7c16c4dc95fa428c9f4892e490dc3378&scope.project.id=03146c35f6b74534aaeb260041749b99&role.id=9c31475dead84051aacf6440785d5194 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:01:49.366312 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073b7984-9e05-4a5e-8e89-1d8ebada66fb None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:49.473028 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073b7984-9e05-4a5e-8e89-1d8ebada66fb None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:49.473222 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23dfed8-4c9f-44da-a793-b9961a222f21 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:49.509568 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3c5415-ee39-475e-878e-12b5d6f4a48f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:49.510138 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ad5944-5475-4cbf-8e10-35d82dc0affa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:49.510482 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c5415-ee39-475e-878e-12b5d6f4a48f None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:49.510765 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c5415-ee39-475e-878e-12b5d6f4a48f None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:49.511037 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c5415-ee39-475e-878e-12b5d6f4a48f None admin] PATH_INFO: `/v3/users/733e72413c1843f3a51be8e04c684d6b` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:49.512417 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ad5944-5475-4cbf-8e10-35d82dc0affa None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:49.512756 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3c5415-ee39-475e-878e-12b5d6f4a48f None admin] RBAC: Authorizing `identity:get_user(user_id=733e72413c1843f3a51be8e04c684d6b)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:49.513506 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ad5944-5475-4cbf-8e10-35d82dc0affa None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:49.514216 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ad5944-5475-4cbf-8e10-35d82dc0affa None admin] PATH_INFO: `/v3/projects/03146c35f6b74534aaeb260041749b99` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:49.514394 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3c5415-ee39-475e-878e-12b5d6f4a48f None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:49.516769 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ad5944-5475-4cbf-8e10-35d82dc0affa None admin] RBAC: Authorizing `identity:get_project(project_id=03146c35f6b74534aaeb260041749b99)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:49.516949 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 62/126] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Mar 30 07:01:49 2022] GET /identity/v3/users/733e72413c1843f3a51be8e04c684d6b => generated 275 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:01:49.522747 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3c5415-ee39-475e-878e-12b5d6f4a48f None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:49.524816 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ad5944-5475-4cbf-8e10-35d82dc0affa None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:49.527791 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 65/127] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Mar 30 07:01:49 2022] GET /identity/v3/projects/03146c35f6b74534aaeb260041749b99 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:01:49.529136 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ad5944-5475-4cbf-8e10-35d82dc0affa None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:49.642770 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ad5944-5475-4cbf-8e10-35d82dc0affa None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:49.645721 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3c5415-ee39-475e-878e-12b5d6f4a48f None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:49.675613 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f34c44-1d79-44d2-8e9c-7d9b66438cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:49.676434 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f34c44-1d79-44d2-8e9c-7d9b66438cf8 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:49.676716 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f34c44-1d79-44d2-8e9c-7d9b66438cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:49.676989 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f34c44-1d79-44d2-8e9c-7d9b66438cf8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:49.687569 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f34c44-1d79-44d2-8e9c-7d9b66438cf8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 07:01:49.688046 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04dbfb9-3751-445c-bf42-4870e94481fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:49.689159 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04dbfb9-3751-445c-bf42-4870e94481fb None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:49.689638 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04dbfb9-3751-445c-bf42-4870e94481fb None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:49.690111 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04dbfb9-3751-445c-bf42-4870e94481fb None admin] PATH_INFO: `/v3/projects/03146c35f6b74534aaeb260041749b99` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:49.691521 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04dbfb9-3751-445c-bf42-4870e94481fb None admin] RBAC: Authorizing `identity:get_project(project_id=03146c35f6b74534aaeb260041749b99)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:49.693221 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04dbfb9-3751-445c-bf42-4870e94481fb None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:49.694655 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-71f34c44-1d79-44d2-8e9c-7d9b66438cf8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 30 07:01:49.695717 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 63/128] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Mar 30 07:01:49 2022] GET /identity/v3/projects/03146c35f6b74534aaeb260041749b99 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:01:49.700386 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 66/129] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Mar 30 07:01:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:01:49.700386 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f34c44-1d79-44d2-8e9c-7d9b66438cf8 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:49.702649 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04dbfb9-3751-445c-bf42-4870e94481fb None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:49.818385 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04dbfb9-3751-445c-bf42-4870e94481fb None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:49.819420 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f34c44-1d79-44d2-8e9c-7d9b66438cf8 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:49.857534 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f79fd8f-8bbc-4a3e-88d3-f026f99e7f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:49.858439 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f79fd8f-8bbc-4a3e-88d3-f026f99e7f0b None admin] REQUEST_METHOD: `PUT` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:49.858725 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f79fd8f-8bbc-4a3e-88d3-f026f99e7f0b None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:49.859005 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f79fd8f-8bbc-4a3e-88d3-f026f99e7f0b None admin] PATH_INFO: `/v3/projects/03146c35f6b74534aaeb260041749b99/users/3226f67e8def44ad8010bab402b41414/roles/1c39b9ab8cfd4c0ea71845831920a845` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:49.861010 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f79fd8f-8bbc-4a3e-88d3-f026f99e7f0b None admin] RBAC: Authorizing `identity:create_grant(project_id=03146c35f6b74534aaeb260041749b99, user_id=3226f67e8def44ad8010bab402b41414, role_id=1c39b9ab8cfd4c0ea71845831920a845)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:49.862429 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70089421-f830-41e3-b4c7-c631caae0508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:49.862857 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f79fd8f-8bbc-4a3e-88d3-f026f99e7f0b None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:49.863770 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70089421-f830-41e3-b4c7-c631caae0508 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:49.864310 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70089421-f830-41e3-b4c7-c631caae0508 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:49.864775 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70089421-f830-41e3-b4c7-c631caae0508 None admin] PATH_INFO: `/v3/projects/03146c35f6b74534aaeb260041749b99` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:49.867058 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70089421-f830-41e3-b4c7-c631caae0508 None admin] RBAC: Authorizing `identity:get_project(project_id=03146c35f6b74534aaeb260041749b99)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:49.869034 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70089421-f830-41e3-b4c7-c631caae0508 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:49.876796 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 67/130] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Mar 30 07:01:49 2022] GET /identity/v3/projects/03146c35f6b74534aaeb260041749b99 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:01:49.878368 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70089421-f830-41e3-b4c7-c631caae0508 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:49.879547 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 64/131] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Mar 30 07:01:49 2022] PUT /identity/v3/projects/03146c35f6b74534aaeb260041749b99/users/3226f67e8def44ad8010bab402b41414/roles/1c39b9ab8cfd4c0ea71845831920a845 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:01:49.880724 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f79fd8f-8bbc-4a3e-88d3-f026f99e7f0b None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:49.993182 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70089421-f830-41e3-b4c7-c631caae0508 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:50.014675 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f79fd8f-8bbc-4a3e-88d3-f026f99e7f0b None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:50.031328 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea9f094-5723-4176-8a9b-3c907e455eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:50.032379 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea9f094-5723-4176-8a9b-3c907e455eb6 None admin] REQUEST_METHOD: `PUT` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:50.032733 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea9f094-5723-4176-8a9b-3c907e455eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:50.033084 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea9f094-5723-4176-8a9b-3c907e455eb6 None admin] PATH_INFO: `/v3/projects/03146c35f6b74534aaeb260041749b99/users/733e72413c1843f3a51be8e04c684d6b/roles/5d79031a64754b57ba120367465e2252` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:50.035211 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea9f094-5723-4176-8a9b-3c907e455eb6 None admin] RBAC: Authorizing `identity:create_grant(project_id=03146c35f6b74534aaeb260041749b99, user_id=733e72413c1843f3a51be8e04c684d6b, role_id=5d79031a64754b57ba120367465e2252)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:50.036905 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea9f094-5723-4176-8a9b-3c907e455eb6 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:50.057170 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 68/132] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Mar 30 07:01:49 2022] PUT /identity/v3/projects/03146c35f6b74534aaeb260041749b99/users/733e72413c1843f3a51be8e04c684d6b/roles/5d79031a64754b57ba120367465e2252 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:01:50.058466 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea9f094-5723-4176-8a9b-3c907e455eb6 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:50.059836 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d853e19d-32ef-48bc-bf78-ee94d40a232f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:50.060843 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d853e19d-32ef-48bc-bf78-ee94d40a232f None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:50.061598 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d853e19d-32ef-48bc-bf78-ee94d40a232f None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:50.062065 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d853e19d-32ef-48bc-bf78-ee94d40a232f None admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:50.064100 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d853e19d-32ef-48bc-bf78-ee94d40a232f None admin] RBAC: Adding query filter params (name=member) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:01:50.064673 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d853e19d-32ef-48bc-bf78-ee94d40a232f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:50.066329 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d853e19d-32ef-48bc-bf78-ee94d40a232f None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:50.083495 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 65/133] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Mar 30 07:01:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:01:50.092516 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d853e19d-32ef-48bc-bf78-ee94d40a232f None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:50.183527 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea9f094-5723-4176-8a9b-3c907e455eb6 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:50.211551 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d853e19d-32ef-48bc-bf78-ee94d40a232f None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:50.221998 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28feb83-c3e7-45da-8821-1748d8c3b87b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:50.223284 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28feb83-c3e7-45da-8821-1748d8c3b87b None admin] REQUEST_METHOD: `PUT` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:50.223802 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28feb83-c3e7-45da-8821-1748d8c3b87b None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:50.224324 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28feb83-c3e7-45da-8821-1748d8c3b87b None admin] PATH_INFO: `/v3/projects/03146c35f6b74534aaeb260041749b99/users/733e72413c1843f3a51be8e04c684d6b/roles/075d8bdffff942c29baa73114127d3fa` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:50.227024 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28feb83-c3e7-45da-8821-1748d8c3b87b None admin] RBAC: Authorizing `identity:create_grant(project_id=03146c35f6b74534aaeb260041749b99, user_id=733e72413c1843f3a51be8e04c684d6b, role_id=075d8bdffff942c29baa73114127d3fa)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:50.229057 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28feb83-c3e7-45da-8821-1748d8c3b87b None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:50.248264 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 69/134] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Mar 30 07:01:50 2022] PUT /identity/v3/projects/03146c35f6b74534aaeb260041749b99/users/733e72413c1843f3a51be8e04c684d6b/roles/075d8bdffff942c29baa73114127d3fa => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:01:50.254866 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028087ea-d41f-4559-978b-01ea1b5e03cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:50.256343 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028087ea-d41f-4559-978b-01ea1b5e03cd None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:50.256843 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028087ea-d41f-4559-978b-01ea1b5e03cd None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:50.257322 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028087ea-d41f-4559-978b-01ea1b5e03cd None admin] PATH_INFO: `/v3/users/733e72413c1843f3a51be8e04c684d6b` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:50.259121 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028087ea-d41f-4559-978b-01ea1b5e03cd None admin] RBAC: Authorizing `identity:get_user(user_id=733e72413c1843f3a51be8e04c684d6b)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:50.261292 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028087ea-d41f-4559-978b-01ea1b5e03cd None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:50.263713 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 66/135] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Mar 30 07:01:50 2022] GET /identity/v3/users/733e72413c1843f3a51be8e04c684d6b => generated 275 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:01:50.269743 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28feb83-c3e7-45da-8821-1748d8c3b87b None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:50.403349 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28feb83-c3e7-45da-8821-1748d8c3b87b None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:50.444543 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1a83ce-d1f6-4c18-82f1-ad9bde4ab89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:50.445937 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a83ce-d1f6-4c18-82f1-ad9bde4ab89c None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:50.446461 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a83ce-d1f6-4c18-82f1-ad9bde4ab89c None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:50.446951 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a83ce-d1f6-4c18-82f1-ad9bde4ab89c None admin] PATH_INFO: `/v3/projects/403939f69cde4d87bc0ce9540534ba13` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:50.448785 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1a83ce-d1f6-4c18-82f1-ad9bde4ab89c None admin] RBAC: Authorizing `identity:get_project(project_id=403939f69cde4d87bc0ce9540534ba13)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:50.450620 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1a83ce-d1f6-4c18-82f1-ad9bde4ab89c None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:50.453224 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 70/136] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Mar 30 07:01:50 2022] GET /identity/v3/projects/403939f69cde4d87bc0ce9540534ba13 => generated 312 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:01:50.460432 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028087ea-d41f-4559-978b-01ea1b5e03cd None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:50.569343 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028087ea-d41f-4559-978b-01ea1b5e03cd None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:50.603378 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118aed07-2514-4c1d-be19-5bb3258667ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:50.604317 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118aed07-2514-4c1d-be19-5bb3258667ab None admin] REQUEST_METHOD: `PUT` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:50.604603 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118aed07-2514-4c1d-be19-5bb3258667ab None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:50.604912 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118aed07-2514-4c1d-be19-5bb3258667ab None admin] PATH_INFO: `/v3/projects/403939f69cde4d87bc0ce9540534ba13/users/733e72413c1843f3a51be8e04c684d6b/roles/5d79031a64754b57ba120367465e2252` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:50.606974 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118aed07-2514-4c1d-be19-5bb3258667ab None admin] RBAC: Authorizing `identity:create_grant(project_id=403939f69cde4d87bc0ce9540534ba13, user_id=733e72413c1843f3a51be8e04c684d6b, role_id=5d79031a64754b57ba120367465e2252)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:50.608485 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118aed07-2514-4c1d-be19-5bb3258667ab None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:50.623868 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 67/137] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Mar 30 07:01:50 2022] PUT /identity/v3/projects/403939f69cde4d87bc0ce9540534ba13/users/733e72413c1843f3a51be8e04c684d6b/roles/5d79031a64754b57ba120367465e2252 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:01:50.936538 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef9c7f-c0b2-4662-986b-95dc6a8fe63c None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:50.937227 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef9c7f-c0b2-4662-986b-95dc6a8fe63c None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:50.937715 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef9c7f-c0b2-4662-986b-95dc6a8fe63c None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:50.939719 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 71/138] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:01:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:01:50.945321 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f27d37-e431-404c-8620-a070409a769b None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:50.945620 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f27d37-e431-404c-8620-a070409a769b None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:50.945998 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f27d37-e431-404c-8620-a070409a769b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:50.971795 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-20f27d37-e431-404c-8620-a070409a769b None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:01:50.973026 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-20f27d37-e431-404c-8620-a070409a769b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:01:51.055056 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 68/139] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:01:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 07:01:51.096502 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bef9c7f-c0b2-4662-986b-95dc6a8fe63c None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:51.229255 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bef9c7f-c0b2-4662-986b-95dc6a8fe63c None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:51.273169 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84cea26-c490-4b52-8375-12c46a094566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:51.274422 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84cea26-c490-4b52-8375-12c46a094566 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:51.274931 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84cea26-c490-4b52-8375-12c46a094566 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:51.275419 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84cea26-c490-4b52-8375-12c46a094566 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:51.276980 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84cea26-c490-4b52-8375-12c46a094566 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:51.278652 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84cea26-c490-4b52-8375-12c46a094566 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:51.280516 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 72/140] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:01:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:01:51.286382 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f27d37-e431-404c-8620-a070409a769b None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:51.408269 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f27d37-e431-404c-8620-a070409a769b None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:51.447332 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb96900-e0bc-4804-ad27-78120b9920da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:51.448046 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb96900-e0bc-4804-ad27-78120b9920da None admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:51.448335 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb96900-e0bc-4804-ad27-78120b9920da None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:51.448648 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb96900-e0bc-4804-ad27-78120b9920da None admin] PATH_INFO: `/v3/users` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:51.449382 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb96900-e0bc-4804-ad27-78120b9920da None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:51.450847 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb96900-e0bc-4804-ad27-78120b9920da None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:51.492214 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 69/141] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Mar 30 07:01:51 2022] POST /identity/v3/users => generated 283 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:01:52.919714 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b088a-9da3-470e-a5a4-dd6bc4e9fd4c None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:52.919714 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b088a-9da3-470e-a5a4-dd6bc4e9fd4c None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:52.919714 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b088a-9da3-470e-a5a4-dd6bc4e9fd4c None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:52.920904 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 73/142] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:01:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:01:52.925204 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f8a50-582b-4548-ae82-5dad393c294f None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:52.926109 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f8a50-582b-4548-ae82-5dad393c294f None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:52.926619 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f8a50-582b-4548-ae82-5dad393c294f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:52.951759 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-517f8a50-582b-4548-ae82-5dad393c294f None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:01:52.953361 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-517f8a50-582b-4548-ae82-5dad393c294f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:01:53.034252 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 70/143] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:01:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 07:01:53.081167 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71b088a-9da3-470e-a5a4-dd6bc4e9fd4c None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:53.217651 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71b088a-9da3-470e-a5a4-dd6bc4e9fd4c None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:53.261585 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb515441-e397-4a60-bcce-ca6a22644300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:53.263187 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb515441-e397-4a60-bcce-ca6a22644300 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:53.263555 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb515441-e397-4a60-bcce-ca6a22644300 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:53.263854 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb515441-e397-4a60-bcce-ca6a22644300 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:53.278646 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb515441-e397-4a60-bcce-ca6a22644300 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 07:01:53.285736 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-cb515441-e397-4a60-bcce-ca6a22644300 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 30 07:01:53.291790 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 74/144] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Mar 30 07:01:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:01:53.294124 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517f8a50-582b-4548-ae82-5dad393c294f None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:53.422165 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517f8a50-582b-4548-ae82-5dad393c294f None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:53.457379 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41b2ff3-14b5-413c-8d5e-676cdbbd7cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:53.458066 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b2ff3-14b5-413c-8d5e-676cdbbd7cd3 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:53.458352 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b2ff3-14b5-413c-8d5e-676cdbbd7cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:53.458633 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b2ff3-14b5-413c-8d5e-676cdbbd7cd3 None admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:53.459393 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41b2ff3-14b5-413c-8d5e-676cdbbd7cd3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:01:53.459702 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41b2ff3-14b5-413c-8d5e-676cdbbd7cd3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:53.461153 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41b2ff3-14b5-413c-8d5e-676cdbbd7cd3 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:53.475738 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 71/145] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Mar 30 07:01:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:01:53.482000 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb515441-e397-4a60-bcce-ca6a22644300 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:53.625775 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb515441-e397-4a60-bcce-ca6a22644300 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:53.669570 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff3eeae-34c2-4b6e-a4e0-ce2d72221acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:53.670474 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff3eeae-34c2-4b6e-a4e0-ce2d72221acb None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:53.670754 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff3eeae-34c2-4b6e-a4e0-ce2d72221acb None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:53.671029 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff3eeae-34c2-4b6e-a4e0-ce2d72221acb None admin] PATH_INFO: `/v3/users/7c16c4dc95fa428c9f4892e490dc3378` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:53.674451 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff3eeae-34c2-4b6e-a4e0-ce2d72221acb None admin] RBAC: Authorizing `identity:get_user(user_id=7c16c4dc95fa428c9f4892e490dc3378)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:53.675334 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c630675-9741-4cc6-b727-681cfb9039be None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:53.675631 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c630675-9741-4cc6-b727-681cfb9039be None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:53.675955 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff3eeae-34c2-4b6e-a4e0-ce2d72221acb None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:53.676119 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c630675-9741-4cc6-b727-681cfb9039be None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:53.677761 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 72/146] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:01:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:01:53.678077 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 75/147] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Mar 30 07:01:53 2022] GET /identity/v3/users/7c16c4dc95fa428c9f4892e490dc3378 => generated 289 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:01:53.682655 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa511d-88ca-4201-99ae-f266c0fe503a None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:53.683060 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa511d-88ca-4201-99ae-f266c0fe503a None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:53.683350 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa511d-88ca-4201-99ae-f266c0fe503a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:53.684328 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff3eeae-34c2-4b6e-a4e0-ce2d72221acb None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:53.704816 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-9afa511d-88ca-4201-99ae-f266c0fe503a None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:01:53.706014 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-9afa511d-88ca-4201-99ae-f266c0fe503a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:01:53.842146 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 73/148] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:01:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 07:01:53.843684 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c401a5-80f4-44c0-b822-a264d8b5f1f5 None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:53.844004 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c401a5-80f4-44c0-b822-a264d8b5f1f5 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:53.844280 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c401a5-80f4-44c0-b822-a264d8b5f1f5 None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:53.845957 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 74/149] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:01:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:01:53.851645 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09419c1-7c07-4470-bbb8-504503f9e941 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:53.851966 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09419c1-7c07-4470-bbb8-504503f9e941 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:53.852246 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09419c1-7c07-4470-bbb8-504503f9e941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:53.884839 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-d09419c1-7c07-4470-bbb8-504503f9e941 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:01:53.885890 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff3eeae-34c2-4b6e-a4e0-ce2d72221acb None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:53.886218 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-d09419c1-7c07-4470-bbb8-504503f9e941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:01:53.923453 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6a4738-b513-4286-97d1-cbe21329efb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:53.925072 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6a4738-b513-4286-97d1-cbe21329efb2 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:53.925556 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6a4738-b513-4286-97d1-cbe21329efb2 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:53.926025 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6a4738-b513-4286-97d1-cbe21329efb2 None admin] PATH_INFO: `/v3/projects/03146c35f6b74534aaeb260041749b99` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:53.927461 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6a4738-b513-4286-97d1-cbe21329efb2 None admin] RBAC: Authorizing `identity:get_project(project_id=03146c35f6b74534aaeb260041749b99)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:53.929276 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6a4738-b513-4286-97d1-cbe21329efb2 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:53.931213 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 76/150] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Mar 30 07:01:53 2022] GET /identity/v3/projects/03146c35f6b74534aaeb260041749b99 => generated 298 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:01:53.932717 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9981fdd1-adaf-4488-912e-f3a6a4f1c92e None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:53.933402 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9981fdd1-adaf-4488-912e-f3a6a4f1c92e None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:53.933903 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9981fdd1-adaf-4488-912e-f3a6a4f1c92e None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:53.935801 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 77/151] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:01:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:01:53.937027 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9981fdd1-adaf-4488-912e-f3a6a4f1c92e None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:53.998102 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 75/152] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:01:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 30 07:01:53.999014 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09419c1-7c07-4470-bbb8-504503f9e941 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:54.066823 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9981fdd1-adaf-4488-912e-f3a6a4f1c92e None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:54.105735 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84136571-7bd1-45f7-9628-2e7713a9f6ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:54.106909 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84136571-7bd1-45f7-9628-2e7713a9f6ce None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:54.107436 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84136571-7bd1-45f7-9628-2e7713a9f6ce None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:54.107976 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84136571-7bd1-45f7-9628-2e7713a9f6ce None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:54.119009 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84136571-7bd1-45f7-9628-2e7713a9f6ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 07:01:54.126445 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-84136571-7bd1-45f7-9628-2e7713a9f6ce None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 30 07:01:54.128212 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09419c1-7c07-4470-bbb8-504503f9e941 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:54.128466 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 78/153] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Mar 30 07:01:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:01:54.129881 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2898b6a-cffb-4343-8f8a-ea3c1a09eeda None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:54.130384 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2898b6a-cffb-4343-8f8a-ea3c1a09eeda None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:54.130856 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2898b6a-cffb-4343-8f8a-ea3c1a09eeda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:54.153238 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-d2898b6a-cffb-4343-8f8a-ea3c1a09eeda None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:01:54.154880 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-d2898b6a-cffb-4343-8f8a-ea3c1a09eeda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:01:54.162125 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95524ec8-651d-417f-8dc6-2897c0a41f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:54.163030 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95524ec8-651d-417f-8dc6-2897c0a41f42 None admin] REQUEST_METHOD: `PUT` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:54.163302 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95524ec8-651d-417f-8dc6-2897c0a41f42 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:54.163578 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95524ec8-651d-417f-8dc6-2897c0a41f42 None admin] PATH_INFO: `/v3/projects/03146c35f6b74534aaeb260041749b99/users/7c16c4dc95fa428c9f4892e490dc3378/roles/9c31475dead84051aacf6440785d5194` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:54.165959 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95524ec8-651d-417f-8dc6-2897c0a41f42 None admin] RBAC: Authorizing `identity:create_grant(project_id=03146c35f6b74534aaeb260041749b99, user_id=7c16c4dc95fa428c9f4892e490dc3378, role_id=9c31475dead84051aacf6440785d5194)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:54.167547 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95524ec8-651d-417f-8dc6-2897c0a41f42 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:54.184231 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 76/154] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Mar 30 07:01:53 2022] PUT /identity/v3/projects/03146c35f6b74534aaeb260041749b99/users/7c16c4dc95fa428c9f4892e490dc3378/roles/9c31475dead84051aacf6440785d5194 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:01:54.184890 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95524ec8-651d-417f-8dc6-2897c0a41f42 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:54.233087 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 79/155] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:01:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 07:01:54.234293 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2898b6a-cffb-4343-8f8a-ea3c1a09eeda None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:54.303291 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95524ec8-651d-417f-8dc6-2897c0a41f42 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:54.353356 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b557199-b034-4ab8-a613-fd4d66573c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:54.354190 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b557199-b034-4ab8-a613-fd4d66573c29 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:54.354472 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b557199-b034-4ab8-a613-fd4d66573c29 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:54.354911 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b557199-b034-4ab8-a613-fd4d66573c29 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:54.366828 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2898b6a-cffb-4343-8f8a-ea3c1a09eeda None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:54.370641 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b557199-b034-4ab8-a613-fd4d66573c29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 07:01:54.379263 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-6b557199-b034-4ab8-a613-fd4d66573c29 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 30 07:01:54.380911 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 77/156] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Mar 30 07:01:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:01:54.381715 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b557199-b034-4ab8-a613-fd4d66573c29 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:54.409574 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf35d15-2dd1-481f-b64e-2cb528687f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:54.410270 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf35d15-2dd1-481f-b64e-2cb528687f2c None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:54.410546 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf35d15-2dd1-481f-b64e-2cb528687f2c None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:54.410813 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf35d15-2dd1-481f-b64e-2cb528687f2c None admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:54.411852 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf35d15-2dd1-481f-b64e-2cb528687f2c None admin] RBAC: Adding query filter params (name=admin) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:01:54.412146 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf35d15-2dd1-481f-b64e-2cb528687f2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:54.413713 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf35d15-2dd1-481f-b64e-2cb528687f2c None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:54.425691 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 80/157] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Mar 30 07:01:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:01:54.426562 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf35d15-2dd1-481f-b64e-2cb528687f2c None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:54.503624 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b557199-b034-4ab8-a613-fd4d66573c29 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:54.540100 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf35d15-2dd1-481f-b64e-2cb528687f2c None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:54.551591 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfce6f28-72ab-4de8-a38d-5a2d86ccff47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:54.552850 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfce6f28-72ab-4de8-a38d-5a2d86ccff47 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:54.553333 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfce6f28-72ab-4de8-a38d-5a2d86ccff47 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:54.555836 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfce6f28-72ab-4de8-a38d-5a2d86ccff47 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:54.575530 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfce6f28-72ab-4de8-a38d-5a2d86ccff47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 07:01:54.590129 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-bfce6f28-72ab-4de8-a38d-5a2d86ccff47 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 30 07:01:54.593389 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 78/158] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Mar 30 07:01:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:01:54.595252 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfce6f28-72ab-4de8-a38d-5a2d86ccff47 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:54.619749 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e80724-8dd3-4727-bcd2-5eedf729d1f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:54.621085 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e80724-8dd3-4727-bcd2-5eedf729d1f8 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:54.622875 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e80724-8dd3-4727-bcd2-5eedf729d1f8 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:54.623370 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e80724-8dd3-4727-bcd2-5eedf729d1f8 None admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:54.624370 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e80724-8dd3-4727-bcd2-5eedf729d1f8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:01:54.625853 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e80724-8dd3-4727-bcd2-5eedf729d1f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:54.627490 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e80724-8dd3-4727-bcd2-5eedf729d1f8 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:54.645636 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 81/159] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Mar 30 07:01:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:01:54.648214 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e80724-8dd3-4727-bcd2-5eedf729d1f8 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:54.791677 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfce6f28-72ab-4de8-a38d-5a2d86ccff47 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:54.828981 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e80724-8dd3-4727-bcd2-5eedf729d1f8 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:54.847900 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea608eee-e306-46bc-9ada-73f680a6e180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:54.847900 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea608eee-e306-46bc-9ada-73f680a6e180 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:54.847900 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea608eee-e306-46bc-9ada-73f680a6e180 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:54.847900 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea608eee-e306-46bc-9ada-73f680a6e180 None admin] PATH_INFO: `/v3/users/3226f67e8def44ad8010bab402b41414` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:54.849287 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea608eee-e306-46bc-9ada-73f680a6e180 None admin] RBAC: Authorizing `identity:get_user(user_id=3226f67e8def44ad8010bab402b41414)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:54.850773 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea608eee-e306-46bc-9ada-73f680a6e180 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:54.852455 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 79/160] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Mar 30 07:01:54 2022] GET /identity/v3/users/3226f67e8def44ad8010bab402b41414 => generated 247 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:01:54.853216 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea608eee-e306-46bc-9ada-73f680a6e180 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:54.876794 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbfaf71-d86f-4068-bf0e-ff7fee299cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:54.877823 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbfaf71-d86f-4068-bf0e-ff7fee299cd8 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:54.878347 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbfaf71-d86f-4068-bf0e-ff7fee299cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:54.878832 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbfaf71-d86f-4068-bf0e-ff7fee299cd8 None admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:54.879855 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbfaf71-d86f-4068-bf0e-ff7fee299cd8 None admin] RBAC: Adding query filter params (name=member) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:01:54.880354 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbfaf71-d86f-4068-bf0e-ff7fee299cd8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:54.882094 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbfaf71-d86f-4068-bf0e-ff7fee299cd8 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:54.897922 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 82/161] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Mar 30 07:01:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:01:54.899049 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbfaf71-d86f-4068-bf0e-ff7fee299cd8 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:54.994741 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea608eee-e306-46bc-9ada-73f680a6e180 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:55.044969 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5999734c-ceb1-4743-aefc-729b65f137cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:55.045863 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5999734c-ceb1-4743-aefc-729b65f137cc None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:55.046138 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5999734c-ceb1-4743-aefc-729b65f137cc None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:55.046405 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5999734c-ceb1-4743-aefc-729b65f137cc None admin] PATH_INFO: `/v3/users/733e72413c1843f3a51be8e04c684d6b` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:55.049576 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5999734c-ceb1-4743-aefc-729b65f137cc None admin] RBAC: Authorizing `identity:get_user(user_id=733e72413c1843f3a51be8e04c684d6b)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:55.051063 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5999734c-ceb1-4743-aefc-729b65f137cc None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:55.052746 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 80/162] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Mar 30 07:01:54 2022] GET /identity/v3/users/733e72413c1843f3a51be8e04c684d6b => generated 275 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:01:55.053773 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5999734c-ceb1-4743-aefc-729b65f137cc None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:55.102630 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbfaf71-d86f-4068-bf0e-ff7fee299cd8 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:55.164209 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5999734c-ceb1-4743-aefc-729b65f137cc None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:55.165851 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6324d4-d388-471f-9047-f4b1aeb88bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:55.166771 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6324d4-d388-471f-9047-f4b1aeb88bdc None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:55.167292 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6324d4-d388-471f-9047-f4b1aeb88bdc None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:55.167761 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6324d4-d388-471f-9047-f4b1aeb88bdc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:55.205559 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dedb7a5-9907-45a0-bbd6-b99a7f00ae6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:55.205559 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dedb7a5-9907-45a0-bbd6-b99a7f00ae6c None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:55.205559 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dedb7a5-9907-45a0-bbd6-b99a7f00ae6c None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:55.205559 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dedb7a5-9907-45a0-bbd6-b99a7f00ae6c None admin] PATH_INFO: `/v3/users/733e72413c1843f3a51be8e04c684d6b` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:55.210706 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dedb7a5-9907-45a0-bbd6-b99a7f00ae6c None admin] RBAC: Authorizing `identity:get_user(user_id=733e72413c1843f3a51be8e04c684d6b)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:55.210706 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dedb7a5-9907-45a0-bbd6-b99a7f00ae6c None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:55.211758 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 81/163] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Mar 30 07:01:55 2022] GET /identity/v3/users/733e72413c1843f3a51be8e04c684d6b => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:01:55.219952 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dedb7a5-9907-45a0-bbd6-b99a7f00ae6c None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:55.318797 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6324d4-d388-471f-9047-f4b1aeb88bdc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:55.320326 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6324d4-d388-471f-9047-f4b1aeb88bdc None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:55.409924 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dedb7a5-9907-45a0-bbd6-b99a7f00ae6c None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:55.475749 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9010dd3d-66c8-4317-90df-706c5071c7f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:55.476355 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9010dd3d-66c8-4317-90df-706c5071c7f5 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:55.476631 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9010dd3d-66c8-4317-90df-706c5071c7f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:55.476903 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9010dd3d-66c8-4317-90df-706c5071c7f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:55.524473 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 83/164] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Mar 30 07:01:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 625 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 30 07:01:55.525494 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6324d4-d388-471f-9047-f4b1aeb88bdc None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:55.546422 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9010dd3d-66c8-4317-90df-706c5071c7f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:55.548021 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9010dd3d-66c8-4317-90df-706c5071c7f5 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:55.647283 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 82/165] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Mar 30 07:01:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 30 07:01:55.648665 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1091b4b7-52c1-4fb7-83ac-0c86f9671652 None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:55.649057 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1091b4b7-52c1-4fb7-83ac-0c86f9671652 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:55.649553 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1091b4b7-52c1-4fb7-83ac-0c86f9671652 None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:55.652169 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 83/166] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:01:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:01:55.652880 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1091b4b7-52c1-4fb7-83ac-0c86f9671652 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:55.739770 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6324d4-d388-471f-9047-f4b1aeb88bdc None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:55.791572 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1091b4b7-52c1-4fb7-83ac-0c86f9671652 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:55.819035 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d975f46-01a4-46f8-8fae-948b927ee636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:55.819713 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d975f46-01a4-46f8-8fae-948b927ee636 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:55.820024 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d975f46-01a4-46f8-8fae-948b927ee636 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:55.820290 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d975f46-01a4-46f8-8fae-948b927ee636 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:55.862087 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca782cb6-f239-45bb-a376-d4530eab4e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:55.862966 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca782cb6-f239-45bb-a376-d4530eab4e77 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:55.863242 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca782cb6-f239-45bb-a376-d4530eab4e77 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:55.863507 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca782cb6-f239-45bb-a376-d4530eab4e77 None admin] PATH_INFO: `/v3/projects/03146c35f6b74534aaeb260041749b99` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:55.864937 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca782cb6-f239-45bb-a376-d4530eab4e77 None admin] RBAC: Authorizing `identity:get_project(project_id=03146c35f6b74534aaeb260041749b99)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:55.866418 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca782cb6-f239-45bb-a376-d4530eab4e77 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:55.868326 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 84/167] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Mar 30 07:01:55 2022] GET /identity/v3/projects/03146c35f6b74534aaeb260041749b99 => generated 298 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:01:55.868932 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca782cb6-f239-45bb-a376-d4530eab4e77 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:55.929885 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d975f46-01a4-46f8-8fae-948b927ee636 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:55.931738 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d975f46-01a4-46f8-8fae-948b927ee636 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:55.991186 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca782cb6-f239-45bb-a376-d4530eab4e77 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:56.024373 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25059d5-e382-4f56-b87d-16459e4cbe78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:56.025225 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25059d5-e382-4f56-b87d-16459e4cbe78 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:56.025502 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25059d5-e382-4f56-b87d-16459e4cbe78 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:56.025769 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25059d5-e382-4f56-b87d-16459e4cbe78 None admin] PATH_INFO: `/v3/projects/03146c35f6b74534aaeb260041749b99` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:56.027014 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25059d5-e382-4f56-b87d-16459e4cbe78 None admin] RBAC: Authorizing `identity:get_project(project_id=03146c35f6b74534aaeb260041749b99)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:56.028677 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25059d5-e382-4f56-b87d-16459e4cbe78 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:56.030386 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 85/168] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Mar 30 07:01:55 2022] GET /identity/v3/projects/03146c35f6b74534aaeb260041749b99 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:01:56.031526 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80c5f1-975d-4691-8e77-a84372ec8633 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:56.031818 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80c5f1-975d-4691-8e77-a84372ec8633 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:56.032115 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80c5f1-975d-4691-8e77-a84372ec8633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:56.055902 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-9e80c5f1-975d-4691-8e77-a84372ec8633 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:01:56.057076 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-9e80c5f1-975d-4691-8e77-a84372ec8633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:01:56.124772 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 86/169] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:01:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 07:01:56.125651 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e80c5f1-975d-4691-8e77-a84372ec8633 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:56.152004 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 84/170] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Mar 30 07:01:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 623 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 30 07:01:56.153078 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d975f46-01a4-46f8-8fae-948b927ee636 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:56.224608 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e80c5f1-975d-4691-8e77-a84372ec8633 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:56.259302 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d3a748-6468-44aa-9526-879049575462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:56.259922 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d3a748-6468-44aa-9526-879049575462 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:56.260210 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d3a748-6468-44aa-9526-879049575462 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:56.260487 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d3a748-6468-44aa-9526-879049575462 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:56.261398 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d3a748-6468-44aa-9526-879049575462 None admin] RBAC: Adding query filter params (role.id=1c39b9ab8cfd4c0ea71845831920a845, scope.project.id=03146c35f6b74534aaeb260041749b99, user.id=3226f67e8def44ad8010bab402b41414) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:01:56.261769 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d3a748-6468-44aa-9526-879049575462 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:56.263323 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d3a748-6468-44aa-9526-879049575462 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:56.269995 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 87/171] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Mar 30 07:01:56 2022] GET /identity/v3/role_assignments?user.id=3226f67e8def44ad8010bab402b41414&scope.project.id=03146c35f6b74534aaeb260041749b99&role.id=1c39b9ab8cfd4c0ea71845831920a845 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:01:56.270906 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d3a748-6468-44aa-9526-879049575462 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:56.302304 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d975f46-01a4-46f8-8fae-948b927ee636 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:56.348606 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be25bff6-3dd4-44db-8280-e0086045cdf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:56.349285 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be25bff6-3dd4-44db-8280-e0086045cdf8 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:56.349564 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be25bff6-3dd4-44db-8280-e0086045cdf8 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:56.349833 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be25bff6-3dd4-44db-8280-e0086045cdf8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:56.350681 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be25bff6-3dd4-44db-8280-e0086045cdf8 None admin] RBAC: Adding query filter params (role.id=075d8bdffff942c29baa73114127d3fa, scope.project.id=03146c35f6b74534aaeb260041749b99, user.id=733e72413c1843f3a51be8e04c684d6b) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:01:56.350983 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be25bff6-3dd4-44db-8280-e0086045cdf8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:56.352473 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be25bff6-3dd4-44db-8280-e0086045cdf8 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:56.365690 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 85/172] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Mar 30 07:01:56 2022] GET /identity/v3/role_assignments?user.id=733e72413c1843f3a51be8e04c684d6b&scope.project.id=03146c35f6b74534aaeb260041749b99&role.id=075d8bdffff942c29baa73114127d3fa => generated 608 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:01:56.366590 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be25bff6-3dd4-44db-8280-e0086045cdf8 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:56.380648 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d3a748-6468-44aa-9526-879049575462 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:56.428151 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aa0da4-3bb0-4924-928c-fa13e79033c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:56.429118 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aa0da4-3bb0-4924-928c-fa13e79033c0 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:56.429407 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aa0da4-3bb0-4924-928c-fa13e79033c0 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:56.429686 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aa0da4-3bb0-4924-928c-fa13e79033c0 None admin] PATH_INFO: `/v3/projects/03146c35f6b74534aaeb260041749b99` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:56.431114 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aa0da4-3bb0-4924-928c-fa13e79033c0 None admin] RBAC: Authorizing `identity:get_project(project_id=03146c35f6b74534aaeb260041749b99)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:56.432704 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aa0da4-3bb0-4924-928c-fa13e79033c0 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:56.435340 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 88/173] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Mar 30 07:01:56 2022] GET /identity/v3/projects/03146c35f6b74534aaeb260041749b99 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:01:56.440785 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aa0da4-3bb0-4924-928c-fa13e79033c0 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:56.503838 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be25bff6-3dd4-44db-8280-e0086045cdf8 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:56.545504 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1b8747-e93a-46d0-a8fd-80cc495a05e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:56.546246 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1b8747-e93a-46d0-a8fd-80cc495a05e5 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:56.546520 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1b8747-e93a-46d0-a8fd-80cc495a05e5 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:56.546784 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1b8747-e93a-46d0-a8fd-80cc495a05e5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:56.570536 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1b8747-e93a-46d0-a8fd-80cc495a05e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 07:01:56.572918 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aa0da4-3bb0-4924-928c-fa13e79033c0 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:56.582096 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-db1b8747-e93a-46d0-a8fd-80cc495a05e5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 30 07:01:56.583380 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 86/174] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Mar 30 07:01:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:01:56.589920 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1b8747-e93a-46d0-a8fd-80cc495a05e5 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:56.609902 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c2a8ed-55d5-47d2-aad9-8d2050d1691b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:56.610590 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c2a8ed-55d5-47d2-aad9-8d2050d1691b None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:56.610921 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c2a8ed-55d5-47d2-aad9-8d2050d1691b None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:56.611197 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c2a8ed-55d5-47d2-aad9-8d2050d1691b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:56.612503 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c2a8ed-55d5-47d2-aad9-8d2050d1691b None admin] RBAC: Adding query filter params (role.id=5d79031a64754b57ba120367465e2252, scope.project.id=03146c35f6b74534aaeb260041749b99, user.id=733e72413c1843f3a51be8e04c684d6b) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:01:56.612813 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c2a8ed-55d5-47d2-aad9-8d2050d1691b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:56.614400 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c2a8ed-55d5-47d2-aad9-8d2050d1691b None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:56.621177 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 89/175] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Mar 30 07:01:56 2022] GET /identity/v3/role_assignments?user.id=733e72413c1843f3a51be8e04c684d6b&scope.project.id=03146c35f6b74534aaeb260041749b99&role.id=5d79031a64754b57ba120367465e2252 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:01:56.695085 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c350cf-744f-4dad-a3d4-9fdd981a00af None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:56.695421 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c350cf-744f-4dad-a3d4-9fdd981a00af None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:56.695646 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c350cf-744f-4dad-a3d4-9fdd981a00af None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:56.697580 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 90/176] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:01:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:01:56.703378 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd577342-dcfb-4fde-bc75-0fa3d22e1d1c None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:56.703663 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd577342-dcfb-4fde-bc75-0fa3d22e1d1c None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:56.703988 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd577342-dcfb-4fde-bc75-0fa3d22e1d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:56.722298 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1b8747-e93a-46d0-a8fd-80cc495a05e5 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:56.739022 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-bd577342-dcfb-4fde-bc75-0fa3d22e1d1c None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:01:56.740278 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-bd577342-dcfb-4fde-bc75-0fa3d22e1d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:01:56.764697 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dedde4-010f-4030-9427-ddbfae389fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:56.765403 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dedde4-010f-4030-9427-ddbfae389fdf None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:56.765685 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dedde4-010f-4030-9427-ddbfae389fdf None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:56.765957 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dedde4-010f-4030-9427-ddbfae389fdf None admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:56.766727 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dedde4-010f-4030-9427-ddbfae389fdf None admin] RBAC: Adding query filter params (name=member) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:01:56.767029 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dedde4-010f-4030-9427-ddbfae389fdf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:56.768493 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dedde4-010f-4030-9427-ddbfae389fdf None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:56.794330 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 87/177] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Mar 30 07:01:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:01:56.800652 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dedde4-010f-4030-9427-ddbfae389fdf None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:56.837978 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 91/178] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:01:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 07:01:56.892773 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd577342-dcfb-4fde-bc75-0fa3d22e1d1c None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:56.970931 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dedde4-010f-4030-9427-ddbfae389fdf None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:57.012162 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b419db-5a43-488e-87c9-ee62c2a4c0cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:57.013057 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b419db-5a43-488e-87c9-ee62c2a4c0cc None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:57.013334 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b419db-5a43-488e-87c9-ee62c2a4c0cc None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:57.013596 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b419db-5a43-488e-87c9-ee62c2a4c0cc None admin] PATH_INFO: `/v3/users/733e72413c1843f3a51be8e04c684d6b` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:57.014950 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b419db-5a43-488e-87c9-ee62c2a4c0cc None admin] RBAC: Authorizing `identity:get_user(user_id=733e72413c1843f3a51be8e04c684d6b)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:57.016639 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b419db-5a43-488e-87c9-ee62c2a4c0cc None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:57.019642 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 88/179] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Mar 30 07:01:56 2022] GET /identity/v3/users/733e72413c1843f3a51be8e04c684d6b => generated 275 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:01:57.026215 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b419db-5a43-488e-87c9-ee62c2a4c0cc None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:57.097479 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd577342-dcfb-4fde-bc75-0fa3d22e1d1c None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:57.150381 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b419db-5a43-488e-87c9-ee62c2a4c0cc None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:57.174490 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b179672a-4e83-4c0d-bba4-e2ff564287da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:57.175323 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b179672a-4e83-4c0d-bba4-e2ff564287da None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:57.175602 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b179672a-4e83-4c0d-bba4-e2ff564287da None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:57.175907 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b179672a-4e83-4c0d-bba4-e2ff564287da None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:57.187789 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb8a287-3cd2-46a3-aba8-f8d8b04e80f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:57.189142 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb8a287-3cd2-46a3-aba8-f8d8b04e80f4 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:57.189657 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb8a287-3cd2-46a3-aba8-f8d8b04e80f4 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:57.190125 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb8a287-3cd2-46a3-aba8-f8d8b04e80f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:57.197971 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b179672a-4e83-4c0d-bba4-e2ff564287da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 07:01:57.207100 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-b179672a-4e83-4c0d-bba4-e2ff564287da None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 30 07:01:57.212355 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 92/180] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Mar 30 07:01:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:01:57.217869 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b179672a-4e83-4c0d-bba4-e2ff564287da None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:57.271575 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb8a287-3cd2-46a3-aba8-f8d8b04e80f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:57.273444 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb8a287-3cd2-46a3-aba8-f8d8b04e80f4 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:57.394638 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 89/181] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Mar 30 07:01:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 30 07:01:57.395955 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2206c5-df92-4824-a534-a4ea314c2635 None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:57.396246 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2206c5-df92-4824-a534-a4ea314c2635 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:57.396523 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2206c5-df92-4824-a534-a4ea314c2635 None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:57.396957 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b179672a-4e83-4c0d-bba4-e2ff564287da None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:57.398235 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 90/182] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:01:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:01:57.400020 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2206c5-df92-4824-a534-a4ea314c2635 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:57.452450 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617f8f34-f1de-4c83-b255-bbfd82394fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:57.453484 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f8f34-f1de-4c83-b255-bbfd82394fe1 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:57.453963 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f8f34-f1de-4c83-b255-bbfd82394fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:57.454515 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f8f34-f1de-4c83-b255-bbfd82394fe1 None admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:57.455489 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617f8f34-f1de-4c83-b255-bbfd82394fe1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:01:57.456047 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617f8f34-f1de-4c83-b255-bbfd82394fe1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:57.457653 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617f8f34-f1de-4c83-b255-bbfd82394fe1 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:57.466719 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 93/183] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Mar 30 07:01:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:01:57.468281 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77279d25-6ce9-419d-8a82-92e6167f0b96 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:57.468768 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77279d25-6ce9-419d-8a82-92e6167f0b96 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:57.469276 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77279d25-6ce9-419d-8a82-92e6167f0b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:57.486180 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-77279d25-6ce9-419d-8a82-92e6167f0b96 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:01:57.488094 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-77279d25-6ce9-419d-8a82-92e6167f0b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:01:57.513565 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2206c5-df92-4824-a534-a4ea314c2635 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:57.548695 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2a7fe8-229a-4a98-aadc-24682219c89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:57.549603 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2a7fe8-229a-4a98-aadc-24682219c89c None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:57.549885 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2a7fe8-229a-4a98-aadc-24682219c89c None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:57.550159 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2a7fe8-229a-4a98-aadc-24682219c89c None admin] PATH_INFO: `/v3/projects/403939f69cde4d87bc0ce9540534ba13` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:57.551568 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2a7fe8-229a-4a98-aadc-24682219c89c None admin] RBAC: Authorizing `identity:get_project(project_id=403939f69cde4d87bc0ce9540534ba13)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:57.552967 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2a7fe8-229a-4a98-aadc-24682219c89c None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:57.559872 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 91/184] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Mar 30 07:01:57 2022] GET /identity/v3/projects/403939f69cde4d87bc0ce9540534ba13 => generated 312 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:01:57.559872 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2a7fe8-229a-4a98-aadc-24682219c89c None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:57.561862 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 94/185] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:01:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 07:01:57.563345 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77279d25-6ce9-419d-8a82-92e6167f0b96 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:57.661303 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2a7fe8-229a-4a98-aadc-24682219c89c None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:57.673128 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77279d25-6ce9-419d-8a82-92e6167f0b96 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:57.693435 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18daca5c-e430-4d57-a3e8-ac4565ebf4e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:57.694314 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18daca5c-e430-4d57-a3e8-ac4565ebf4e0 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:57.694588 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18daca5c-e430-4d57-a3e8-ac4565ebf4e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:57.694856 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18daca5c-e430-4d57-a3e8-ac4565ebf4e0 None admin] PATH_INFO: `/v3/users/8f6fec93707c43349426f07392c71457` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:57.709919 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18daca5c-e430-4d57-a3e8-ac4565ebf4e0 None admin] RBAC: Authorizing `identity:get_user(user_id=8f6fec93707c43349426f07392c71457)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:57.710470 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e228cb-81da-4f5d-b47d-98acbf54dcbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:57.711126 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e228cb-81da-4f5d-b47d-98acbf54dcbb None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:57.711401 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e228cb-81da-4f5d-b47d-98acbf54dcbb None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:57.711671 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e228cb-81da-4f5d-b47d-98acbf54dcbb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:57.712527 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e228cb-81da-4f5d-b47d-98acbf54dcbb None admin] RBAC: Adding query filter params (role.id=5d79031a64754b57ba120367465e2252, scope.project.id=403939f69cde4d87bc0ce9540534ba13, user.id=733e72413c1843f3a51be8e04c684d6b) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:01:57.712789 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18daca5c-e430-4d57-a3e8-ac4565ebf4e0 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:57.712886 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e228cb-81da-4f5d-b47d-98acbf54dcbb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:57.714335 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e228cb-81da-4f5d-b47d-98acbf54dcbb None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:57.715318 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 92/186] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Mar 30 07:01:57 2022] GET /identity/v3/users/8f6fec93707c43349426f07392c71457 => generated 283 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:01:57.716984 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dac61d-c0b7-48dd-85be-e81b5b0d83b2 None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:57.717919 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dac61d-c0b7-48dd-85be-e81b5b0d83b2 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:57.718818 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dac61d-c0b7-48dd-85be-e81b5b0d83b2 None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:57.720471 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 95/187] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Mar 30 07:01:57 2022] GET /identity/v3/role_assignments?user.id=733e72413c1843f3a51be8e04c684d6b&scope.project.id=403939f69cde4d87bc0ce9540534ba13&role.id=5d79031a64754b57ba120367465e2252 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:01:57.720964 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 93/188] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:01:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:01:57.721965 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dac61d-c0b7-48dd-85be-e81b5b0d83b2 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:57.725281 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e228cb-81da-4f5d-b47d-98acbf54dcbb None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:57.851368 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e228cb-81da-4f5d-b47d-98acbf54dcbb None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:57.867937 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dac61d-c0b7-48dd-85be-e81b5b0d83b2 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:57.894073 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc02767a-2c9d-404d-b0c2-1d8c9745b6c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:57.895483 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc02767a-2c9d-404d-b0c2-1d8c9745b6c5 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:57.896366 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc02767a-2c9d-404d-b0c2-1d8c9745b6c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:57.897105 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc02767a-2c9d-404d-b0c2-1d8c9745b6c5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:57.906777 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92d5f7f-629a-4e80-b5b7-628b5f9de933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:57.907494 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92d5f7f-629a-4e80-b5b7-628b5f9de933 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:57.907852 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92d5f7f-629a-4e80-b5b7-628b5f9de933 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:57.908219 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92d5f7f-629a-4e80-b5b7-628b5f9de933 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:57.912365 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc02767a-2c9d-404d-b0c2-1d8c9745b6c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 07:01:57.922178 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-dc02767a-2c9d-404d-b0c2-1d8c9745b6c5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 30 07:01:57.924685 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 96/189] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Mar 30 07:01:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:01:57.925319 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8770031-7333-4ae4-8c15-bd44d28e4ac1 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:57.925605 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8770031-7333-4ae4-8c15-bd44d28e4ac1 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:57.925881 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8770031-7333-4ae4-8c15-bd44d28e4ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:57.945449 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-e8770031-7333-4ae4-8c15-bd44d28e4ac1 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:01:57.946950 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-e8770031-7333-4ae4-8c15-bd44d28e4ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:01:57.989834 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92d5f7f-629a-4e80-b5b7-628b5f9de933 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:57.991900 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92d5f7f-629a-4e80-b5b7-628b5f9de933 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:58.034194 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 97/190] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:01:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 07:01:58.034877 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8770031-7333-4ae4-8c15-bd44d28e4ac1 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:58.098162 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 94/191] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Mar 30 07:01:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 30 07:01:58.099016 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92d5f7f-629a-4e80-b5b7-628b5f9de933 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:58.144263 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8770031-7333-4ae4-8c15-bd44d28e4ac1 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:58.180482 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a605e76e-002b-45c9-8e37-2af880962f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:58.181071 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a605e76e-002b-45c9-8e37-2af880962f28 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:58.181344 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a605e76e-002b-45c9-8e37-2af880962f28 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:58.181609 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a605e76e-002b-45c9-8e37-2af880962f28 None admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:58.182344 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a605e76e-002b-45c9-8e37-2af880962f28 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:01:58.182641 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a605e76e-002b-45c9-8e37-2af880962f28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:58.184264 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a605e76e-002b-45c9-8e37-2af880962f28 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:58.191686 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 98/192] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Mar 30 07:01:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:01:58.193712 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a605e76e-002b-45c9-8e37-2af880962f28 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:58.196884 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92d5f7f-629a-4e80-b5b7-628b5f9de933 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:58.232477 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac54bd5-07f1-4d2c-9d11-cc7c52ef9bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:58.233281 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac54bd5-07f1-4d2c-9d11-cc7c52ef9bcf None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:58.233551 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac54bd5-07f1-4d2c-9d11-cc7c52ef9bcf None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:58.233819 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac54bd5-07f1-4d2c-9d11-cc7c52ef9bcf None admin] PATH_INFO: `/v3/domains/default` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:58.234976 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac54bd5-07f1-4d2c-9d11-cc7c52ef9bcf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:58.236824 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac54bd5-07f1-4d2c-9d11-cc7c52ef9bcf None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:58.238433 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 95/193] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:01:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:01:58.239656 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c95108f-d32e-41c7-9ed4-67cd284af9b1 None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:58.239962 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c95108f-d32e-41c7-9ed4-67cd284af9b1 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:58.240349 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c95108f-d32e-41c7-9ed4-67cd284af9b1 None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:58.241989 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 96/194] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:01:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:01:58.244588 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c95108f-d32e-41c7-9ed4-67cd284af9b1 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:58.287445 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a605e76e-002b-45c9-8e37-2af880962f28 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:58.320987 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c2024a-2cfc-4db9-b0b4-9295e934d352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:58.321852 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c2024a-2cfc-4db9-b0b4-9295e934d352 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:58.322130 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c2024a-2cfc-4db9-b0b4-9295e934d352 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:58.322401 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c2024a-2cfc-4db9-b0b4-9295e934d352 None admin] PATH_INFO: `/v3/projects/e61749eb818249119b76cae445ffa9ff` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:58.323675 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c2024a-2cfc-4db9-b0b4-9295e934d352 None admin] RBAC: Authorizing `identity:get_project(project_id=e61749eb818249119b76cae445ffa9ff)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:58.325219 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c2024a-2cfc-4db9-b0b4-9295e934d352 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:58.326929 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 99/195] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Mar 30 07:01:58 2022] GET /identity/v3/projects/e61749eb818249119b76cae445ffa9ff => generated 302 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:01:58.327668 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c2024a-2cfc-4db9-b0b4-9295e934d352 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:58.342250 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c95108f-d32e-41c7-9ed4-67cd284af9b1 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:58.375772 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5f8c7a-2592-4251-9003-3e30ac775103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:58.376658 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5f8c7a-2592-4251-9003-3e30ac775103 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:58.376934 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5f8c7a-2592-4251-9003-3e30ac775103 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:58.377196 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5f8c7a-2592-4251-9003-3e30ac775103 None admin] PATH_INFO: `/v3/users/8f6fec93707c43349426f07392c71457` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:58.378376 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5f8c7a-2592-4251-9003-3e30ac775103 None admin] RBAC: Authorizing `identity:get_user(user_id=8f6fec93707c43349426f07392c71457)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:58.379834 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5f8c7a-2592-4251-9003-3e30ac775103 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:58.381479 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 97/196] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Mar 30 07:01:58 2022] GET /identity/v3/users/8f6fec93707c43349426f07392c71457 => generated 283 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:01:58.386141 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984f5c30-314c-481d-bc90-daa0840ece8f None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:58.386141 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984f5c30-314c-481d-bc90-daa0840ece8f None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:58.386141 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984f5c30-314c-481d-bc90-daa0840ece8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:58.400079 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-984f5c30-314c-481d-bc90-daa0840ece8f None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:01:58.401234 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-984f5c30-314c-481d-bc90-daa0840ece8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:01:58.427012 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c2024a-2cfc-4db9-b0b4-9295e934d352 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:58.458166 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4195127-c798-48fc-85bf-069e101b1e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:58.458763 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4195127-c798-48fc-85bf-069e101b1e4a None admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:58.459042 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4195127-c798-48fc-85bf-069e101b1e4a None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:58.459309 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4195127-c798-48fc-85bf-069e101b1e4a None admin] PATH_INFO: `/v3/users` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:58.460048 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4195127-c798-48fc-85bf-069e101b1e4a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:58.461503 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4195127-c798-48fc-85bf-069e101b1e4a None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:58.464530 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 98/197] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:01:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 07:01:58.466275 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984f5c30-314c-481d-bc90-daa0840ece8f None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:58.487519 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 100/198] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Mar 30 07:01:58 2022] POST /identity/v3/users => generated 297 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:01:58.492864 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4195127-c798-48fc-85bf-069e101b1e4a None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:58.573199 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984f5c30-314c-481d-bc90-daa0840ece8f None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:58.603444 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4195127-c798-48fc-85bf-069e101b1e4a None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:58.611114 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd13bdc1-2006-4a80-a16a-6ad69e4a63c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:58.612170 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd13bdc1-2006-4a80-a16a-6ad69e4a63c6 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:58.612467 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd13bdc1-2006-4a80-a16a-6ad69e4a63c6 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:58.612724 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd13bdc1-2006-4a80-a16a-6ad69e4a63c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:58.613563 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd13bdc1-2006-4a80-a16a-6ad69e4a63c6 None admin] RBAC: Adding query filter params (role.id=1c39b9ab8cfd4c0ea71845831920a845, scope.project.id=e61749eb818249119b76cae445ffa9ff, user.id=8f6fec93707c43349426f07392c71457) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:01:58.613864 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd13bdc1-2006-4a80-a16a-6ad69e4a63c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:58.615347 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd13bdc1-2006-4a80-a16a-6ad69e4a63c6 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:58.621496 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 99/199] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Mar 30 07:01:58 2022] GET /identity/v3/role_assignments?user.id=8f6fec93707c43349426f07392c71457&scope.project.id=e61749eb818249119b76cae445ffa9ff&role.id=1c39b9ab8cfd4c0ea71845831920a845 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:01:58.622415 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd13bdc1-2006-4a80-a16a-6ad69e4a63c6 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:58.643274 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca05ebe-4044-4d80-8916-9876a8700cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:58.644015 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca05ebe-4044-4d80-8916-9876a8700cda None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:58.644297 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca05ebe-4044-4d80-8916-9876a8700cda None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:58.644628 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca05ebe-4044-4d80-8916-9876a8700cda None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:58.740689 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca05ebe-4044-4d80-8916-9876a8700cda None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:58.742620 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca05ebe-4044-4d80-8916-9876a8700cda None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:58.773645 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd13bdc1-2006-4a80-a16a-6ad69e4a63c6 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:58.829047 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6830269-f87e-49af-ab5b-711ccc362a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:58.829559 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6830269-f87e-49af-ab5b-711ccc362a00 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:58.829842 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6830269-f87e-49af-ab5b-711ccc362a00 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:58.830120 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6830269-f87e-49af-ab5b-711ccc362a00 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:58.844396 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6830269-f87e-49af-ab5b-711ccc362a00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 07:01:58.852849 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-a6830269-f87e-49af-ab5b-711ccc362a00 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 30 07:01:58.854951 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 100/200] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Mar 30 07:01:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:01:58.860660 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6830269-f87e-49af-ab5b-711ccc362a00 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:58.868297 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 101/201] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Mar 30 07:01:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 30 07:01:58.874524 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca05ebe-4044-4d80-8916-9876a8700cda None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:58.980669 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6830269-f87e-49af-ab5b-711ccc362a00 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:58.983840 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca05ebe-4044-4d80-8916-9876a8700cda None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:59.014944 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8826731-442b-4cf4-a6ef-3390c0d1fe63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:59.016008 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8826731-442b-4cf4-a6ef-3390c0d1fe63 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:59.016485 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8826731-442b-4cf4-a6ef-3390c0d1fe63 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:59.016940 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8826731-442b-4cf4-a6ef-3390c0d1fe63 None admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:59.017826 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8826731-442b-4cf4-a6ef-3390c0d1fe63 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:01:59.018264 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8826731-442b-4cf4-a6ef-3390c0d1fe63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:59.018690 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc4cda6-205b-42e2-a482-709812de4f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:59.020655 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc4cda6-205b-42e2-a482-709812de4f66 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:59.020655 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc4cda6-205b-42e2-a482-709812de4f66 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:59.020655 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc4cda6-205b-42e2-a482-709812de4f66 None admin] PATH_INFO: `/v3/projects/e61749eb818249119b76cae445ffa9ff` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:59.021339 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8826731-442b-4cf4-a6ef-3390c0d1fe63 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:59.021612 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc4cda6-205b-42e2-a482-709812de4f66 None admin] RBAC: Authorizing `identity:get_project(project_id=e61749eb818249119b76cae445ffa9ff)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:59.023188 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc4cda6-205b-42e2-a482-709812de4f66 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:59.025171 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 102/202] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Mar 30 07:01:58 2022] GET /identity/v3/projects/e61749eb818249119b76cae445ffa9ff => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:01:59.032144 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 101/203] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Mar 30 07:01:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:01:59.035985 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc4cda6-205b-42e2-a482-709812de4f66 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:59.037989 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8826731-442b-4cf4-a6ef-3390c0d1fe63 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:59.136463 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc4cda6-205b-42e2-a482-709812de4f66 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:59.136818 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8826731-442b-4cf4-a6ef-3390c0d1fe63 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:59.169914 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1267113-1604-4e50-be61-e3f9e1ca50d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:59.171100 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d369c6-1459-4cc3-9b8c-b059ab5fa4ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:59.171584 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1267113-1604-4e50-be61-e3f9e1ca50d4 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:59.171584 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1267113-1604-4e50-be61-e3f9e1ca50d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:59.171918 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1267113-1604-4e50-be61-e3f9e1ca50d4 None admin] PATH_INFO: `/v3/users/7c16c4dc95fa428c9f4892e490dc3378` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:59.172459 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d369c6-1459-4cc3-9b8c-b059ab5fa4ba None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:59.172893 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d369c6-1459-4cc3-9b8c-b059ab5fa4ba None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:59.173332 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d369c6-1459-4cc3-9b8c-b059ab5fa4ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:59.173553 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1267113-1604-4e50-be61-e3f9e1ca50d4 None admin] RBAC: Authorizing `identity:get_user(user_id=7c16c4dc95fa428c9f4892e490dc3378)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:59.174489 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d369c6-1459-4cc3-9b8c-b059ab5fa4ba None admin] RBAC: Adding query filter params (role.id=075d8bdffff942c29baa73114127d3fa, scope.project.id=e61749eb818249119b76cae445ffa9ff, user.id=8f6fec93707c43349426f07392c71457) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:01:59.174932 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d369c6-1459-4cc3-9b8c-b059ab5fa4ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:59.175272 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1267113-1604-4e50-be61-e3f9e1ca50d4 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:59.176757 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d369c6-1459-4cc3-9b8c-b059ab5fa4ba None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:59.177144 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 102/204] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Mar 30 07:01:59 2022] GET /identity/v3/users/7c16c4dc95fa428c9f4892e490dc3378 => generated 289 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:01:59.182990 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1267113-1604-4e50-be61-e3f9e1ca50d4 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:59.183572 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 103/205] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Mar 30 07:01:59 2022] GET /identity/v3/role_assignments?user.id=8f6fec93707c43349426f07392c71457&scope.project.id=e61749eb818249119b76cae445ffa9ff&role.id=075d8bdffff942c29baa73114127d3fa => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:01:59.288963 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1267113-1604-4e50-be61-e3f9e1ca50d4 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:59.326611 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a21434d-9df8-44c7-8f83-033e3d14d15b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:59.327280 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a21434d-9df8-44c7-8f83-033e3d14d15b None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:59.327560 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a21434d-9df8-44c7-8f83-033e3d14d15b None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:59.327848 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a21434d-9df8-44c7-8f83-033e3d14d15b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:59.399206 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a21434d-9df8-44c7-8f83-033e3d14d15b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:59.400725 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a21434d-9df8-44c7-8f83-033e3d14d15b None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:59.506258 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 103/206] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Mar 30 07:01:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 30 07:01:59.512252 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d369c6-1459-4cc3-9b8c-b059ab5fa4ba None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:59.645282 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d369c6-1459-4cc3-9b8c-b059ab5fa4ba None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:59.711938 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12385c46-4f0b-40be-bb7b-20a3f605a153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:59.712814 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12385c46-4f0b-40be-bb7b-20a3f605a153 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:59.713094 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12385c46-4f0b-40be-bb7b-20a3f605a153 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:59.713369 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12385c46-4f0b-40be-bb7b-20a3f605a153 None admin] PATH_INFO: `/v3/projects/03146c35f6b74534aaeb260041749b99` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:59.714611 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12385c46-4f0b-40be-bb7b-20a3f605a153 None admin] RBAC: Authorizing `identity:get_project(project_id=03146c35f6b74534aaeb260041749b99)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:59.716095 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12385c46-4f0b-40be-bb7b-20a3f605a153 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:59.718118 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 104/207] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Mar 30 07:01:59 2022] GET /identity/v3/projects/03146c35f6b74534aaeb260041749b99 => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:01:59.723874 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a21434d-9df8-44c7-8f83-033e3d14d15b None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:01:59.888080 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a21434d-9df8-44c7-8f83-033e3d14d15b None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:01:59.932137 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e947d6c-623e-4328-a57d-1a12add2cd63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:01:59.933329 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e947d6c-623e-4328-a57d-1a12add2cd63 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:01:59.934026 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e947d6c-623e-4328-a57d-1a12add2cd63 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:01:59.934495 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e947d6c-623e-4328-a57d-1a12add2cd63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:01:59.935532 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e947d6c-623e-4328-a57d-1a12add2cd63 None admin] RBAC: Adding query filter params (role.id=9c31475dead84051aacf6440785d5194, scope.project.id=03146c35f6b74534aaeb260041749b99, user.id=7c16c4dc95fa428c9f4892e490dc3378) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:01:59.936094 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e947d6c-623e-4328-a57d-1a12add2cd63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:01:59.937767 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e947d6c-623e-4328-a57d-1a12add2cd63 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:01:59.944535 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 104/208] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Mar 30 07:01:59 2022] GET /identity/v3/role_assignments?user.id=7c16c4dc95fa428c9f4892e490dc3378&scope.project.id=03146c35f6b74534aaeb260041749b99&role.id=9c31475dead84051aacf6440785d5194 => generated 608 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:01.180948 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3412e4-59c1-4aae-972d-cf4b5d2bd98a None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:01.182014 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3412e4-59c1-4aae-972d-cf4b5d2bd98a None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:01.182496 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3412e4-59c1-4aae-972d-cf4b5d2bd98a None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:01.184713 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 105/209] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:02:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:02:01.191444 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1447f22-6ad0-4f8a-8aab-06419b52e21c None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:01.192321 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1447f22-6ad0-4f8a-8aab-06419b52e21c None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:01.192868 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1447f22-6ad0-4f8a-8aab-06419b52e21c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:01.215064 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-b1447f22-6ad0-4f8a-8aab-06419b52e21c None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:02:01.216564 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-b1447f22-6ad0-4f8a-8aab-06419b52e21c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:02:01.290639 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 105/210] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:02:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 07:02:01.314607 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3412e4-59c1-4aae-972d-cf4b5d2bd98a None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:01.434104 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab64ee4-67af-4376-9397-729f628e8d08 None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:01.435012 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab64ee4-67af-4376-9397-729f628e8d08 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:01.435587 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab64ee4-67af-4376-9397-729f628e8d08 None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:01.435731 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3412e4-59c1-4aae-972d-cf4b5d2bd98a None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:01.438711 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 106/211] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:02:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:02:01.444849 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd06536-ad5f-43c3-8f7f-a03ab8d6fa49 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:01.445407 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd06536-ad5f-43c3-8f7f-a03ab8d6fa49 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:01.445868 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd06536-ad5f-43c3-8f7f-a03ab8d6fa49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:01.463509 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-ccd06536-ad5f-43c3-8f7f-a03ab8d6fa49 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:02:01.465687 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-ccd06536-ad5f-43c3-8f7f-a03ab8d6fa49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:02:01.472417 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135ee634-63ab-40d9-8104-686b391b0b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:01.473235 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135ee634-63ab-40d9-8104-686b391b0b2b None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:01.473525 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135ee634-63ab-40d9-8104-686b391b0b2b None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:01.473799 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135ee634-63ab-40d9-8104-686b391b0b2b None admin] PATH_INFO: `/v3/roles/member` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:01.485781 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135ee634-63ab-40d9-8104-686b391b0b2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 07:02:01.497571 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-135ee634-63ab-40d9-8104-686b391b0b2b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 30 07:02:01.499615 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 106/212] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Mar 30 07:02:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:02:01.505336 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135ee634-63ab-40d9-8104-686b391b0b2b None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:01.545407 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 107/213] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:02:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 07:02:01.551981 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a0e74a-8541-4404-a8a2-92c8f1c9b679 None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:01.551981 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a0e74a-8541-4404-a8a2-92c8f1c9b679 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:01.551981 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a0e74a-8541-4404-a8a2-92c8f1c9b679 None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:01.557752 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 108/214] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:02:01 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:02:01.559046 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544530a4-6f77-4a6b-b981-cd20645e83ba None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:01.559333 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544530a4-6f77-4a6b-b981-cd20645e83ba None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:01.559608 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544530a4-6f77-4a6b-b981-cd20645e83ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:01.577360 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-544530a4-6f77-4a6b-b981-cd20645e83ba None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:02:01.578550 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-544530a4-6f77-4a6b-b981-cd20645e83ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:02:01.626715 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135ee634-63ab-40d9-8104-686b391b0b2b None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:01.657615 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 109/215] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:02:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 07:02:01.658757 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544530a4-6f77-4a6b-b981-cd20645e83ba None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:01.685928 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a945c34f-16f9-4dd1-b2a7-667f3e45dc5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:01.687015 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a945c34f-16f9-4dd1-b2a7-667f3e45dc5b None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:01.687523 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a945c34f-16f9-4dd1-b2a7-667f3e45dc5b None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:01.688016 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a945c34f-16f9-4dd1-b2a7-667f3e45dc5b None admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:01.688947 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a945c34f-16f9-4dd1-b2a7-667f3e45dc5b None admin] RBAC: Adding query filter params (name=member) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:01.689405 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a945c34f-16f9-4dd1-b2a7-667f3e45dc5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:01.691262 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a945c34f-16f9-4dd1-b2a7-667f3e45dc5b None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:01.700190 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 107/216] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Mar 30 07:02:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:02:01.701058 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a945c34f-16f9-4dd1-b2a7-667f3e45dc5b None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:01.791153 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544530a4-6f77-4a6b-b981-cd20645e83ba None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:01.821246 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a945c34f-16f9-4dd1-b2a7-667f3e45dc5b None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:01.830991 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59354296-0a0f-44df-b497-e5603049f2ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:01.831791 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59354296-0a0f-44df-b497-e5603049f2ad None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:01.832089 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59354296-0a0f-44df-b497-e5603049f2ad None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:01.832354 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59354296-0a0f-44df-b497-e5603049f2ad None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:01.843049 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59354296-0a0f-44df-b497-e5603049f2ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 07:02:01.852040 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-59354296-0a0f-44df-b497-e5603049f2ad None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 30 07:02:01.853356 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 110/217] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Mar 30 07:02:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:02:01.854108 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59354296-0a0f-44df-b497-e5603049f2ad None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:01.863732 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24277a01-d7e9-4690-bd41-d990802b9596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:01.864581 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24277a01-d7e9-4690-bd41-d990802b9596 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:01.864863 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24277a01-d7e9-4690-bd41-d990802b9596 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:01.865137 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24277a01-d7e9-4690-bd41-d990802b9596 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:01.866459 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24277a01-d7e9-4690-bd41-d990802b9596 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:01.868007 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24277a01-d7e9-4690-bd41-d990802b9596 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:01.869805 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 108/218] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:02:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:01.871174 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543c9fd8-a567-4ec5-9556-63fd4c318e57 None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:01.871323 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543c9fd8-a567-4ec5-9556-63fd4c318e57 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:01.871599 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543c9fd8-a567-4ec5-9556-63fd4c318e57 None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:01.873675 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 109/219] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:02:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:02:01.874361 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543c9fd8-a567-4ec5-9556-63fd4c318e57 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:01.967857 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59354296-0a0f-44df-b497-e5603049f2ad None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:01.991155 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543c9fd8-a567-4ec5-9556-63fd4c318e57 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:02.003400 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837288a4-5c82-4bbb-88d4-abf108eaed37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:02.004310 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837288a4-5c82-4bbb-88d4-abf108eaed37 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:02.004593 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837288a4-5c82-4bbb-88d4-abf108eaed37 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:02.004865 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837288a4-5c82-4bbb-88d4-abf108eaed37 None admin] PATH_INFO: `/v3/users/7ef5044bafe94bf79818dd7f5832d43f` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:02.018342 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837288a4-5c82-4bbb-88d4-abf108eaed37 None admin] RBAC: Authorizing `identity:get_user(user_id=7ef5044bafe94bf79818dd7f5832d43f)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:02.019888 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837288a4-5c82-4bbb-88d4-abf108eaed37 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:02.021598 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 111/220] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Mar 30 07:02:01 2022] GET /identity/v3/users/7ef5044bafe94bf79818dd7f5832d43f => generated 297 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:02.026968 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837288a4-5c82-4bbb-88d4-abf108eaed37 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:02.029831 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71e8bee-a33f-4c7b-95b6-095375c48ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:02.030798 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71e8bee-a33f-4c7b-95b6-095375c48ff7 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:02.031077 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71e8bee-a33f-4c7b-95b6-095375c48ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:02.031346 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71e8bee-a33f-4c7b-95b6-095375c48ff7 None admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:02.032123 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71e8bee-a33f-4c7b-95b6-095375c48ff7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:02.032425 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71e8bee-a33f-4c7b-95b6-095375c48ff7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:02.033896 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71e8bee-a33f-4c7b-95b6-095375c48ff7 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:02.042651 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 110/221] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Mar 30 07:02:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:02.043964 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42499a43-d832-4c7d-ad26-088d8e623675 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:02.044246 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42499a43-d832-4c7d-ad26-088d8e623675 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:02.044521 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42499a43-d832-4c7d-ad26-088d8e623675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:02.065226 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-42499a43-d832-4c7d-ad26-088d8e623675 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:02:02.066449 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-42499a43-d832-4c7d-ad26-088d8e623675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:02:02.146591 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837288a4-5c82-4bbb-88d4-abf108eaed37 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:02.153708 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 111/222] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:02:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 07:02:02.168023 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42499a43-d832-4c7d-ad26-088d8e623675 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:02.193698 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946b9a63-4934-4231-b381-1bc1d5596d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:02.194864 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b9a63-4934-4231-b381-1bc1d5596d29 None admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:02.195368 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b9a63-4934-4231-b381-1bc1d5596d29 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:02.195899 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b9a63-4934-4231-b381-1bc1d5596d29 None admin] PATH_INFO: `/v3/users` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:02.197247 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946b9a63-4934-4231-b381-1bc1d5596d29 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:02.199866 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946b9a63-4934-4231-b381-1bc1d5596d29 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:02.233516 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 112/223] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Mar 30 07:02:02 2022] POST /identity/v3/users => generated 297 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:02:02.234282 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946b9a63-4934-4231-b381-1bc1d5596d29 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:02.290388 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42499a43-d832-4c7d-ad26-088d8e623675 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:02.327229 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27199aa-6787-4bf6-8604-4209a4106587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:02.327915 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27199aa-6787-4bf6-8604-4209a4106587 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:02.328197 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27199aa-6787-4bf6-8604-4209a4106587 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:02.328496 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27199aa-6787-4bf6-8604-4209a4106587 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:02.346073 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946b9a63-4934-4231-b381-1bc1d5596d29 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:02.386560 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7f2d74-b7b1-4335-8711-63ff74c27cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:02.387650 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f2d74-b7b1-4335-8711-63ff74c27cc9 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:02.388004 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f2d74-b7b1-4335-8711-63ff74c27cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:02.388283 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f2d74-b7b1-4335-8711-63ff74c27cc9 None admin] PATH_INFO: `/v3/users/8f6fec93707c43349426f07392c71457` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:02.389584 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7f2d74-b7b1-4335-8711-63ff74c27cc9 None admin] RBAC: Authorizing `identity:get_user(user_id=8f6fec93707c43349426f07392c71457)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:02.391025 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7f2d74-b7b1-4335-8711-63ff74c27cc9 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:02.397610 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 113/224] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Mar 30 07:02:02 2022] GET /identity/v3/users/8f6fec93707c43349426f07392c71457 => generated 283 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:02.397610 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7f2d74-b7b1-4335-8711-63ff74c27cc9 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:02.398436 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27199aa-6787-4bf6-8604-4209a4106587 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:02.400006 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27199aa-6787-4bf6-8604-4209a4106587 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:02.505266 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7f2d74-b7b1-4335-8711-63ff74c27cc9 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:02.526972 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 112/225] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Mar 30 07:02:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 30 07:02:02.526972 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27199aa-6787-4bf6-8604-4209a4106587 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:02.548788 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8d0354-17bb-4dbb-a9df-64fd411e129d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:02.550142 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8d0354-17bb-4dbb-a9df-64fd411e129d None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:02.550631 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8d0354-17bb-4dbb-a9df-64fd411e129d None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:02.551121 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8d0354-17bb-4dbb-a9df-64fd411e129d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:02.565094 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8d0354-17bb-4dbb-a9df-64fd411e129d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 07:02:02.573195 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-8b8d0354-17bb-4dbb-a9df-64fd411e129d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 30 07:02:02.574714 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 114/226] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Mar 30 07:02:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:02:02.575673 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8d0354-17bb-4dbb-a9df-64fd411e129d None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:02.640704 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27199aa-6787-4bf6-8604-4209a4106587 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:02.676179 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43852b4e-291e-4398-8871-ba25a5964bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:02.677096 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43852b4e-291e-4398-8871-ba25a5964bbe None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:02.677413 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43852b4e-291e-4398-8871-ba25a5964bbe None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:02.677515 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8d0354-17bb-4dbb-a9df-64fd411e129d None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:02.677675 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43852b4e-291e-4398-8871-ba25a5964bbe None admin] PATH_INFO: `/v3/projects/e61749eb818249119b76cae445ffa9ff` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:02.678862 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43852b4e-291e-4398-8871-ba25a5964bbe None admin] RBAC: Authorizing `identity:get_project(project_id=e61749eb818249119b76cae445ffa9ff)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:02.680364 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43852b4e-291e-4398-8871-ba25a5964bbe None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:02.682067 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 113/227] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Mar 30 07:02:02 2022] GET /identity/v3/projects/e61749eb818249119b76cae445ffa9ff => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:02.683052 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43852b4e-291e-4398-8871-ba25a5964bbe None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:02.711150 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0871dcad-5b1d-4640-8b01-07bc6a8d516f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:02.712048 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0871dcad-5b1d-4640-8b01-07bc6a8d516f None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:02.712329 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0871dcad-5b1d-4640-8b01-07bc6a8d516f None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:02.712605 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0871dcad-5b1d-4640-8b01-07bc6a8d516f None admin] PATH_INFO: `/v3/projects/e61749eb818249119b76cae445ffa9ff` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:02.713834 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0871dcad-5b1d-4640-8b01-07bc6a8d516f None admin] RBAC: Authorizing `identity:get_project(project_id=e61749eb818249119b76cae445ffa9ff)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:02.715525 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0871dcad-5b1d-4640-8b01-07bc6a8d516f None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:02.717436 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 115/228] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Mar 30 07:02:02 2022] GET /identity/v3/projects/e61749eb818249119b76cae445ffa9ff => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:02.718020 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0871dcad-5b1d-4640-8b01-07bc6a8d516f None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:02.782321 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43852b4e-291e-4398-8871-ba25a5964bbe None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:02.815352 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59db75a9-6672-4026-903c-cc882aed2218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:02.815833 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0871dcad-5b1d-4640-8b01-07bc6a8d516f None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:02.816056 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db75a9-6672-4026-903c-cc882aed2218 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:02.816334 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db75a9-6672-4026-903c-cc882aed2218 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:02.816602 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db75a9-6672-4026-903c-cc882aed2218 None admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:02.817411 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59db75a9-6672-4026-903c-cc882aed2218 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:02.817702 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59db75a9-6672-4026-903c-cc882aed2218 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:02.819146 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59db75a9-6672-4026-903c-cc882aed2218 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:02.832192 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 114/229] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Mar 30 07:02:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:02.833089 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59db75a9-6672-4026-903c-cc882aed2218 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:02.848951 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb68f54-1cdb-46eb-b276-e689d4aa5d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:02.849854 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb68f54-1cdb-46eb-b276-e689d4aa5d3d None admin] REQUEST_METHOD: `PUT` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:02.850133 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb68f54-1cdb-46eb-b276-e689d4aa5d3d None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:02.850405 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb68f54-1cdb-46eb-b276-e689d4aa5d3d None admin] PATH_INFO: `/v3/projects/e61749eb818249119b76cae445ffa9ff/users/8f6fec93707c43349426f07392c71457/roles/1c39b9ab8cfd4c0ea71845831920a845` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:02.852448 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb68f54-1cdb-46eb-b276-e689d4aa5d3d None admin] RBAC: Authorizing `identity:create_grant(project_id=e61749eb818249119b76cae445ffa9ff, user_id=8f6fec93707c43349426f07392c71457, role_id=1c39b9ab8cfd4c0ea71845831920a845)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:02.853906 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb68f54-1cdb-46eb-b276-e689d4aa5d3d None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:02.872864 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 116/230] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Mar 30 07:02:02 2022] PUT /identity/v3/projects/e61749eb818249119b76cae445ffa9ff/users/8f6fec93707c43349426f07392c71457/roles/1c39b9ab8cfd4c0ea71845831920a845 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:02:02.873523 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb68f54-1cdb-46eb-b276-e689d4aa5d3d None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:02.938451 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59db75a9-6672-4026-903c-cc882aed2218 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:02.975506 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d0f24f-5849-4b00-b1a9-eeb3005cd8a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:02.976216 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d0f24f-5849-4b00-b1a9-eeb3005cd8a8 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:02.979852 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d0f24f-5849-4b00-b1a9-eeb3005cd8a8 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:02.979852 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d0f24f-5849-4b00-b1a9-eeb3005cd8a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:02.979852 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d0f24f-5849-4b00-b1a9-eeb3005cd8a8 None admin] RBAC: Adding query filter params (role.id=5d79031a64754b57ba120367465e2252, scope.project.id=e61749eb818249119b76cae445ffa9ff, user.id=7ef5044bafe94bf79818dd7f5832d43f) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:02.979852 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d0f24f-5849-4b00-b1a9-eeb3005cd8a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:02.979852 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d0f24f-5849-4b00-b1a9-eeb3005cd8a8 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:02.991402 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb68f54-1cdb-46eb-b276-e689d4aa5d3d None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:02.995782 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 115/231] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Mar 30 07:02:02 2022] GET /identity/v3/role_assignments?user.id=7ef5044bafe94bf79818dd7f5832d43f&scope.project.id=e61749eb818249119b76cae445ffa9ff&role.id=5d79031a64754b57ba120367465e2252 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:03.050696 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505e22d4-5fd4-4c0d-9778-394db932e5c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:03.051545 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e22d4-5fd4-4c0d-9778-394db932e5c1 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:03.051858 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e22d4-5fd4-4c0d-9778-394db932e5c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:03.052137 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e22d4-5fd4-4c0d-9778-394db932e5c1 None admin] PATH_INFO: `/v3/users/8f6fec93707c43349426f07392c71457` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:03.053401 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505e22d4-5fd4-4c0d-9778-394db932e5c1 None admin] RBAC: Authorizing `identity:get_user(user_id=8f6fec93707c43349426f07392c71457)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:03.054903 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505e22d4-5fd4-4c0d-9778-394db932e5c1 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:03.056977 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 117/232] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Mar 30 07:02:02 2022] GET /identity/v3/users/8f6fec93707c43349426f07392c71457 => generated 283 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:03.063214 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d0f24f-5849-4b00-b1a9-eeb3005cd8a8 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:03.195437 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d0f24f-5849-4b00-b1a9-eeb3005cd8a8 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:03.230011 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cde6f0-922b-424a-a528-eb884e97bf71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:03.230949 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cde6f0-922b-424a-a528-eb884e97bf71 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:03.231233 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cde6f0-922b-424a-a528-eb884e97bf71 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:03.231510 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cde6f0-922b-424a-a528-eb884e97bf71 None admin] PATH_INFO: `/v3/projects/e61749eb818249119b76cae445ffa9ff` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:03.232727 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cde6f0-922b-424a-a528-eb884e97bf71 None admin] RBAC: Authorizing `identity:get_project(project_id=e61749eb818249119b76cae445ffa9ff)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:03.234214 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cde6f0-922b-424a-a528-eb884e97bf71 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:03.236151 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 116/233] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Mar 30 07:02:03 2022] GET /identity/v3/projects/e61749eb818249119b76cae445ffa9ff => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:03.242168 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505e22d4-5fd4-4c0d-9778-394db932e5c1 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:03.342487 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505e22d4-5fd4-4c0d-9778-394db932e5c1 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:03.380372 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d509a8b0-53cc-4a45-a28f-317fa72f6b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:03.381572 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d509a8b0-53cc-4a45-a28f-317fa72f6b30 None admin] REQUEST_METHOD: `PUT` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:03.382023 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d509a8b0-53cc-4a45-a28f-317fa72f6b30 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:03.382492 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d509a8b0-53cc-4a45-a28f-317fa72f6b30 None admin] PATH_INFO: `/v3/projects/e61749eb818249119b76cae445ffa9ff/users/8f6fec93707c43349426f07392c71457/roles/075d8bdffff942c29baa73114127d3fa` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:03.384967 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d509a8b0-53cc-4a45-a28f-317fa72f6b30 None admin] RBAC: Authorizing `identity:create_grant(project_id=e61749eb818249119b76cae445ffa9ff, user_id=8f6fec93707c43349426f07392c71457, role_id=075d8bdffff942c29baa73114127d3fa)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:03.386948 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d509a8b0-53cc-4a45-a28f-317fa72f6b30 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:03.415564 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 118/234] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Mar 30 07:02:03 2022] PUT /identity/v3/projects/e61749eb818249119b76cae445ffa9ff/users/8f6fec93707c43349426f07392c71457/roles/075d8bdffff942c29baa73114127d3fa => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:02:05.072110 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb013e6-17c2-44df-abf4-323ae4b8297d None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:05.072632 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb013e6-17c2-44df-abf4-323ae4b8297d None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:05.072632 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb013e6-17c2-44df-abf4-323ae4b8297d None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:05.075038 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 117/235] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:02:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:02:05.080609 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9168e476-8602-4954-a32a-654433861a1c None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:05.081507 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9168e476-8602-4954-a32a-654433861a1c None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:05.081987 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9168e476-8602-4954-a32a-654433861a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:05.090950 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e192a5e-de18-4a92-a4d2-629d2258dcb0 None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:05.091537 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e192a5e-de18-4a92-a4d2-629d2258dcb0 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:05.092056 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e192a5e-de18-4a92-a4d2-629d2258dcb0 None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:05.094053 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 118/236] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:02:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:02:05.105740 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7aa8e0-7ca5-4d36-a7b3-cfe60072ae2d None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:05.106307 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7aa8e0-7ca5-4d36-a7b3-cfe60072ae2d None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:05.106774 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7aa8e0-7ca5-4d36-a7b3-cfe60072ae2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:05.114302 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-9168e476-8602-4954-a32a-654433861a1c None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:02:05.120836 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-9168e476-8602-4954-a32a-654433861a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:02:05.136958 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-8f7aa8e0-7ca5-4d36-a7b3-cfe60072ae2d None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:02:05.138470 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-8f7aa8e0-7ca5-4d36-a7b3-cfe60072ae2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:02:05.226310 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 119/237] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:02:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 30 07:02:05.231707 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 119/238] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:02:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 07:02:05.255831 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7aa8e0-7ca5-4d36-a7b3-cfe60072ae2d None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:05.264952 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9168e476-8602-4954-a32a-654433861a1c None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:05.364451 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7aa8e0-7ca5-4d36-a7b3-cfe60072ae2d None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:05.374503 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9168e476-8602-4954-a32a-654433861a1c None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:05.409096 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f9dd7d-a62f-4600-965d-1f58bd106ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:05.409578 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a53099-0158-433c-af54-cfb13919bebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:05.410409 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a53099-0158-433c-af54-cfb13919bebb None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:05.410685 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a53099-0158-433c-af54-cfb13919bebb None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:05.410904 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f9dd7d-a62f-4600-965d-1f58bd106ded None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:05.411020 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a53099-0158-433c-af54-cfb13919bebb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:05.411477 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f9dd7d-a62f-4600-965d-1f58bd106ded None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:05.411966 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f9dd7d-a62f-4600-965d-1f58bd106ded None admin] PATH_INFO: `/v3/domains/default` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:05.413330 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f9dd7d-a62f-4600-965d-1f58bd106ded None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:05.414979 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f9dd7d-a62f-4600-965d-1f58bd106ded None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:05.416906 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 120/239] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:02:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:05.424401 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f9dd7d-a62f-4600-965d-1f58bd106ded None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:05.433246 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a53099-0158-433c-af54-cfb13919bebb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 07:02:05.448626 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-d8a53099-0158-433c-af54-cfb13919bebb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 30 07:02:05.450222 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 120/240] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Mar 30 07:02:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:02:05.467379 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a53099-0158-433c-af54-cfb13919bebb None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:05.549727 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f9dd7d-a62f-4600-965d-1f58bd106ded None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:05.585641 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865188bb-1fd5-44ad-b243-eaf3c7090d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:05.586678 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865188bb-1fd5-44ad-b243-eaf3c7090d02 None admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:05.587173 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865188bb-1fd5-44ad-b243-eaf3c7090d02 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:05.587673 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865188bb-1fd5-44ad-b243-eaf3c7090d02 None admin] PATH_INFO: `/v3/users` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:05.588615 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865188bb-1fd5-44ad-b243-eaf3c7090d02 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:05.590680 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865188bb-1fd5-44ad-b243-eaf3c7090d02 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:05.616088 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 121/241] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Mar 30 07:02:05 2022] POST /identity/v3/users => generated 293 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 07:02:05.620217 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a53099-0158-433c-af54-cfb13919bebb None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:05.625663 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1678cd-320e-4a76-9ef9-b18c92063fcb None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:05.626331 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1678cd-320e-4a76-9ef9-b18c92063fcb None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:05.626798 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1678cd-320e-4a76-9ef9-b18c92063fcb None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:05.629387 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 122/242] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:02:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:02:05.636086 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f594fca2-6072-4dfd-b37f-b33c1d765189 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:05.636882 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f594fca2-6072-4dfd-b37f-b33c1d765189 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:05.637383 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f594fca2-6072-4dfd-b37f-b33c1d765189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:05.669425 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8590e032-9c20-4a1c-92ef-9f03db3c7cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:05.670126 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8590e032-9c20-4a1c-92ef-9f03db3c7cbb None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:05.670413 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8590e032-9c20-4a1c-92ef-9f03db3c7cbb None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:05.670677 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8590e032-9c20-4a1c-92ef-9f03db3c7cbb None admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:05.671520 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8590e032-9c20-4a1c-92ef-9f03db3c7cbb None admin] RBAC: Adding query filter params (name=reader) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:05.671841 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8590e032-9c20-4a1c-92ef-9f03db3c7cbb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:05.673534 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8590e032-9c20-4a1c-92ef-9f03db3c7cbb None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:05.676125 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-f594fca2-6072-4dfd-b37f-b33c1d765189 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:02:05.677554 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-f594fca2-6072-4dfd-b37f-b33c1d765189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:02:05.687097 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 121/243] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Mar 30 07:02:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:02:05.696958 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8590e032-9c20-4a1c-92ef-9f03db3c7cbb None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:05.770723 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 123/244] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:02:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 30 07:02:05.815954 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f594fca2-6072-4dfd-b37f-b33c1d765189 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:05.831326 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8590e032-9c20-4a1c-92ef-9f03db3c7cbb None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:05.881775 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3763030-0d50-433a-a45d-d70ba2fe9246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:05.881775 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3763030-0d50-433a-a45d-d70ba2fe9246 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:05.881775 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3763030-0d50-433a-a45d-d70ba2fe9246 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:05.881775 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3763030-0d50-433a-a45d-d70ba2fe9246 None admin] PATH_INFO: `/v3/users/c0cef026a6b64738a0413171a0cea3f9` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:05.906465 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3763030-0d50-433a-a45d-d70ba2fe9246 None admin] RBAC: Authorizing `identity:get_user(user_id=c0cef026a6b64738a0413171a0cea3f9)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:05.912052 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3763030-0d50-433a-a45d-d70ba2fe9246 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:05.913896 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 122/245] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Mar 30 07:02:05 2022] GET /identity/v3/users/c0cef026a6b64738a0413171a0cea3f9 => generated 297 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:05.920358 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3763030-0d50-433a-a45d-d70ba2fe9246 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:05.940637 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f594fca2-6072-4dfd-b37f-b33c1d765189 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:05.979709 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4980a323-99b4-4754-aa4e-f6a5eb5a8b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:05.980620 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4980a323-99b4-4754-aa4e-f6a5eb5a8b35 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:05.981660 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4980a323-99b4-4754-aa4e-f6a5eb5a8b35 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:05.981660 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4980a323-99b4-4754-aa4e-f6a5eb5a8b35 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:06.005858 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4980a323-99b4-4754-aa4e-f6a5eb5a8b35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 07:02:06.014209 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-4980a323-99b4-4754-aa4e-f6a5eb5a8b35 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 30 07:02:06.015770 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 124/246] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Mar 30 07:02:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:02:06.022258 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4980a323-99b4-4754-aa4e-f6a5eb5a8b35 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:06.052377 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3763030-0d50-433a-a45d-d70ba2fe9246 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:06.095221 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bb5fe8-e848-4b4a-8d0f-c98be823b613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:06.096240 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb5fe8-e848-4b4a-8d0f-c98be823b613 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:06.096523 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb5fe8-e848-4b4a-8d0f-c98be823b613 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:06.096800 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb5fe8-e848-4b4a-8d0f-c98be823b613 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:06.133105 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4980a323-99b4-4754-aa4e-f6a5eb5a8b35 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:06.170893 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fded3a2-bb08-4a82-ba5e-6c793daac590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:06.171576 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fded3a2-bb08-4a82-ba5e-6c793daac590 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:06.171854 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fded3a2-bb08-4a82-ba5e-6c793daac590 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:06.172116 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fded3a2-bb08-4a82-ba5e-6c793daac590 None admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:06.173057 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fded3a2-bb08-4a82-ba5e-6c793daac590 None admin] RBAC: Adding query filter params (name=member) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:06.173359 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fded3a2-bb08-4a82-ba5e-6c793daac590 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:06.175452 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fded3a2-bb08-4a82-ba5e-6c793daac590 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:06.176653 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bb5fe8-e848-4b4a-8d0f-c98be823b613 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:06.180344 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bb5fe8-e848-4b4a-8d0f-c98be823b613 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:06.186160 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 125/247] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Mar 30 07:02:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:06.187518 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee60ea-73a6-4e51-9209-7b15077f6090 None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:06.187827 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee60ea-73a6-4e51-9209-7b15077f6090 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:06.188105 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee60ea-73a6-4e51-9209-7b15077f6090 None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:06.189876 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 126/248] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:02:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:02:06.196442 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767b752e-3c96-45a5-987b-9c7ce85b394b None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:06.196754 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767b752e-3c96-45a5-987b-9c7ce85b394b None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:06.197000 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767b752e-3c96-45a5-987b-9c7ce85b394b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:06.228256 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-767b752e-3c96-45a5-987b-9c7ce85b394b None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:02:06.230022 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-767b752e-3c96-45a5-987b-9c7ce85b394b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:02:06.308468 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 127/249] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:02:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 07:02:06.309676 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767b752e-3c96-45a5-987b-9c7ce85b394b None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:06.315126 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 123/250] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Mar 30 07:02:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 30 07:02:06.319882 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bb5fe8-e848-4b4a-8d0f-c98be823b613 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:06.437400 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767b752e-3c96-45a5-987b-9c7ce85b394b None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:06.443692 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bb5fe8-e848-4b4a-8d0f-c98be823b613 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:06.478071 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fdb573-5349-4d3a-8210-9232e8fe318a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:06.478975 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fdb573-5349-4d3a-8210-9232e8fe318a None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:06.479254 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fdb573-5349-4d3a-8210-9232e8fe318a None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:06.479389 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22950144-7ddf-4cce-8e68-2c0330a5e709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:06.479718 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fdb573-5349-4d3a-8210-9232e8fe318a None admin] PATH_INFO: `/v3/projects/e61749eb818249119b76cae445ffa9ff` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:06.480196 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22950144-7ddf-4cce-8e68-2c0330a5e709 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:06.480476 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22950144-7ddf-4cce-8e68-2c0330a5e709 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:06.480858 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22950144-7ddf-4cce-8e68-2c0330a5e709 None admin] PATH_INFO: `/v3/users/7ef5044bafe94bf79818dd7f5832d43f` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:06.481226 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fdb573-5349-4d3a-8210-9232e8fe318a None admin] RBAC: Authorizing `identity:get_project(project_id=e61749eb818249119b76cae445ffa9ff)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:06.482061 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22950144-7ddf-4cce-8e68-2c0330a5e709 None admin] RBAC: Authorizing `identity:get_user(user_id=7ef5044bafe94bf79818dd7f5832d43f)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:06.482857 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fdb573-5349-4d3a-8210-9232e8fe318a None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:06.483511 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22950144-7ddf-4cce-8e68-2c0330a5e709 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:06.484923 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 124/251] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Mar 30 07:02:06 2022] GET /identity/v3/projects/e61749eb818249119b76cae445ffa9ff => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:02:06.485165 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 128/252] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Mar 30 07:02:06 2022] GET /identity/v3/users/7ef5044bafe94bf79818dd7f5832d43f => generated 297 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:06.485705 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fdb573-5349-4d3a-8210-9232e8fe318a None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:06.491266 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22950144-7ddf-4cce-8e68-2c0330a5e709 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:06.647862 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22950144-7ddf-4cce-8e68-2c0330a5e709 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:06.662598 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fdb573-5349-4d3a-8210-9232e8fe318a None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:06.686983 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170f4f32-663e-4cd1-835b-837e505b8353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:06.688287 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170f4f32-663e-4cd1-835b-837e505b8353 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:06.688745 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170f4f32-663e-4cd1-835b-837e505b8353 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:06.689023 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170f4f32-663e-4cd1-835b-837e505b8353 None admin] PATH_INFO: `/v3/projects/e61749eb818249119b76cae445ffa9ff` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:06.690397 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170f4f32-663e-4cd1-835b-837e505b8353 None admin] RBAC: Authorizing `identity:get_project(project_id=e61749eb818249119b76cae445ffa9ff)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:06.692406 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170f4f32-663e-4cd1-835b-837e505b8353 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:06.695106 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 129/253] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Mar 30 07:02:06 2022] GET /identity/v3/projects/e61749eb818249119b76cae445ffa9ff => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:06.695908 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170f4f32-663e-4cd1-835b-837e505b8353 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:06.698563 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757ef8d7-51d8-4715-9227-1b5245caadf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:06.699486 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757ef8d7-51d8-4715-9227-1b5245caadf8 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:06.699888 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757ef8d7-51d8-4715-9227-1b5245caadf8 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:06.700258 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757ef8d7-51d8-4715-9227-1b5245caadf8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:06.710819 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757ef8d7-51d8-4715-9227-1b5245caadf8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 07:02:06.718239 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-757ef8d7-51d8-4715-9227-1b5245caadf8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 30 07:02:06.719696 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 125/254] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Mar 30 07:02:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:02:06.720853 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9918bf07-1f0d-4f0e-99f1-7e785df597b8 None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:06.721205 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9918bf07-1f0d-4f0e-99f1-7e785df597b8 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:06.721543 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9918bf07-1f0d-4f0e-99f1-7e785df597b8 None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:06.723516 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 126/255] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:02:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:02:06.724305 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9918bf07-1f0d-4f0e-99f1-7e785df597b8 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:06.808550 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170f4f32-663e-4cd1-835b-837e505b8353 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:06.840080 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9918bf07-1f0d-4f0e-99f1-7e785df597b8 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:06.849441 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085faa7c-e5cc-4f1b-9b18-7e7f1fdccb02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:06.850377 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085faa7c-e5cc-4f1b-9b18-7e7f1fdccb02 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:06.850902 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085faa7c-e5cc-4f1b-9b18-7e7f1fdccb02 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:06.851683 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085faa7c-e5cc-4f1b-9b18-7e7f1fdccb02 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:06.852994 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085faa7c-e5cc-4f1b-9b18-7e7f1fdccb02 None admin] RBAC: Adding query filter params (role.id=9c31475dead84051aacf6440785d5194, scope.project.id=e61749eb818249119b76cae445ffa9ff, user.id=c0cef026a6b64738a0413171a0cea3f9) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:06.853637 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085faa7c-e5cc-4f1b-9b18-7e7f1fdccb02 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:06.855687 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085faa7c-e5cc-4f1b-9b18-7e7f1fdccb02 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:06.863475 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 130/256] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Mar 30 07:02:06 2022] GET /identity/v3/role_assignments?user.id=c0cef026a6b64738a0413171a0cea3f9&scope.project.id=e61749eb818249119b76cae445ffa9ff&role.id=9c31475dead84051aacf6440785d5194 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:06.864678 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085faa7c-e5cc-4f1b-9b18-7e7f1fdccb02 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:06.905809 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b3575e-3523-4e0d-9100-4633846928d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:06.906861 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b3575e-3523-4e0d-9100-4633846928d0 None admin] REQUEST_METHOD: `PUT` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:06.907199 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b3575e-3523-4e0d-9100-4633846928d0 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:06.907535 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b3575e-3523-4e0d-9100-4633846928d0 None admin] PATH_INFO: `/v3/projects/e61749eb818249119b76cae445ffa9ff/users/7ef5044bafe94bf79818dd7f5832d43f/roles/5d79031a64754b57ba120367465e2252` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:06.913328 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b3575e-3523-4e0d-9100-4633846928d0 None admin] RBAC: Authorizing `identity:create_grant(project_id=e61749eb818249119b76cae445ffa9ff, user_id=7ef5044bafe94bf79818dd7f5832d43f, role_id=5d79031a64754b57ba120367465e2252)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:06.914915 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b3575e-3523-4e0d-9100-4633846928d0 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:06.947731 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 127/257] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Mar 30 07:02:06 2022] PUT /identity/v3/projects/e61749eb818249119b76cae445ffa9ff/users/7ef5044bafe94bf79818dd7f5832d43f/roles/5d79031a64754b57ba120367465e2252 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:02:06.949678 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2eeef7-4a13-40d0-840c-d5ff26256bdc None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:06.950029 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2eeef7-4a13-40d0-840c-d5ff26256bdc None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:06.950424 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2eeef7-4a13-40d0-840c-d5ff26256bdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:06.989634 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085faa7c-e5cc-4f1b-9b18-7e7f1fdccb02 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:06.990942 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-fc2eeef7-4a13-40d0-840c-d5ff26256bdc None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:02:06.992389 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-fc2eeef7-4a13-40d0-840c-d5ff26256bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:02:07.079321 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 128/258] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:02:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 07:02:07.093363 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f455d81-bf31-498c-8a39-3634cb6f54ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:07.094058 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f455d81-bf31-498c-8a39-3634cb6f54ee None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:07.094332 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f455d81-bf31-498c-8a39-3634cb6f54ee None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:07.094617 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f455d81-bf31-498c-8a39-3634cb6f54ee None admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:07.095391 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f455d81-bf31-498c-8a39-3634cb6f54ee None admin] RBAC: Adding query filter params (name=admin) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:07.095667 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f455d81-bf31-498c-8a39-3634cb6f54ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:07.097138 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f455d81-bf31-498c-8a39-3634cb6f54ee None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:07.113385 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 131/259] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Mar 30 07:02:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:07.115983 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2eeef7-4a13-40d0-840c-d5ff26256bdc None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:07.127430 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f455d81-bf31-498c-8a39-3634cb6f54ee None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:07.279211 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2eeef7-4a13-40d0-840c-d5ff26256bdc None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:07.307052 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f455d81-bf31-498c-8a39-3634cb6f54ee None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:07.326011 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592621fe-4e53-4485-b7ca-cd5827ae2dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:07.326996 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592621fe-4e53-4485-b7ca-cd5827ae2dca None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:07.327367 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592621fe-4e53-4485-b7ca-cd5827ae2dca None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:07.327732 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592621fe-4e53-4485-b7ca-cd5827ae2dca None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:07.337989 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592621fe-4e53-4485-b7ca-cd5827ae2dca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 07:02:07.346598 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-592621fe-4e53-4485-b7ca-cd5827ae2dca None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 30 07:02:07.347970 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 129/260] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Mar 30 07:02:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:02:07.352298 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123751c0-9546-499f-91d1-26fc1f65bdd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:07.353468 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123751c0-9546-499f-91d1-26fc1f65bdd5 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:07.353893 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123751c0-9546-499f-91d1-26fc1f65bdd5 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:07.354170 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592621fe-4e53-4485-b7ca-cd5827ae2dca None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:07.354567 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123751c0-9546-499f-91d1-26fc1f65bdd5 None admin] PATH_INFO: `/v3/users/8f6fec93707c43349426f07392c71457` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:07.356231 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123751c0-9546-499f-91d1-26fc1f65bdd5 None admin] RBAC: Authorizing `identity:get_user(user_id=8f6fec93707c43349426f07392c71457)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:07.359025 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123751c0-9546-499f-91d1-26fc1f65bdd5 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:07.360895 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 132/261] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Mar 30 07:02:07 2022] GET /identity/v3/users/8f6fec93707c43349426f07392c71457 => generated 283 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:07.367379 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123751c0-9546-499f-91d1-26fc1f65bdd5 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:07.563611 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592621fe-4e53-4485-b7ca-cd5827ae2dca None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:07.595790 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123751c0-9546-499f-91d1-26fc1f65bdd5 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:07.631694 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7c9c73-d156-40ea-9752-e351641b6369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:07.632403 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7c9c73-d156-40ea-9752-e351641b6369 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:07.632682 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7c9c73-d156-40ea-9752-e351641b6369 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:07.632952 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7c9c73-d156-40ea-9752-e351641b6369 None admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:07.633705 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7c9c73-d156-40ea-9752-e351641b6369 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:07.634008 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7c9c73-d156-40ea-9752-e351641b6369 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:07.635399 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7c9c73-d156-40ea-9752-e351641b6369 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:07.656817 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 130/262] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Mar 30 07:02:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:02:07.662879 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7c9c73-d156-40ea-9752-e351641b6369 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:07.685845 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d12999-a965-480a-bde9-4df669864abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:07.686504 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d12999-a965-480a-bde9-4df669864abf None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:07.686782 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d12999-a965-480a-bde9-4df669864abf None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:07.687053 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d12999-a965-480a-bde9-4df669864abf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:07.798479 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d12999-a965-480a-bde9-4df669864abf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:07.800353 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d12999-a965-480a-bde9-4df669864abf None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:07.888076 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7c9c73-d156-40ea-9752-e351641b6369 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:07.912888 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 133/263] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Mar 30 07:02:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 546 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 30 07:02:07.919397 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d12999-a965-480a-bde9-4df669864abf None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:07.977062 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49066e65-247a-43b9-ac34-c13283245c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:07.977959 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49066e65-247a-43b9-ac34-c13283245c3c None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:07.978232 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49066e65-247a-43b9-ac34-c13283245c3c None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:07.978498 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49066e65-247a-43b9-ac34-c13283245c3c None admin] PATH_INFO: `/v3/users/8f6fec93707c43349426f07392c71457` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:07.984692 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49066e65-247a-43b9-ac34-c13283245c3c None admin] RBAC: Authorizing `identity:get_user(user_id=8f6fec93707c43349426f07392c71457)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:07.986170 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49066e65-247a-43b9-ac34-c13283245c3c None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:07.988244 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 131/264] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Mar 30 07:02:07 2022] GET /identity/v3/users/8f6fec93707c43349426f07392c71457 => generated 283 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:02:07.993547 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49066e65-247a-43b9-ac34-c13283245c3c None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:08.025667 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d12999-a965-480a-bde9-4df669864abf None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:08.061884 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62c9ed3-0555-4541-911b-a53e818b74cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:08.063083 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62c9ed3-0555-4541-911b-a53e818b74cb None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:08.063627 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62c9ed3-0555-4541-911b-a53e818b74cb None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:08.064246 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62c9ed3-0555-4541-911b-a53e818b74cb None admin] PATH_INFO: `/v3/projects/e61749eb818249119b76cae445ffa9ff` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:08.065870 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62c9ed3-0555-4541-911b-a53e818b74cb None admin] RBAC: Authorizing `identity:get_project(project_id=e61749eb818249119b76cae445ffa9ff)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:08.067535 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62c9ed3-0555-4541-911b-a53e818b74cb None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:08.070207 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 134/265] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Mar 30 07:02:07 2022] GET /identity/v3/projects/e61749eb818249119b76cae445ffa9ff => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:02:08.076450 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62c9ed3-0555-4541-911b-a53e818b74cb None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:08.174760 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62c9ed3-0555-4541-911b-a53e818b74cb None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:08.205740 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49066e65-247a-43b9-ac34-c13283245c3c None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:08.209926 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cfa92a-eba3-4f2d-bfe3-d0b385bdef7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:08.210696 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cfa92a-eba3-4f2d-bfe3-d0b385bdef7e None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:08.211074 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cfa92a-eba3-4f2d-bfe3-d0b385bdef7e None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:08.211510 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cfa92a-eba3-4f2d-bfe3-d0b385bdef7e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:08.212485 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cfa92a-eba3-4f2d-bfe3-d0b385bdef7e None admin] RBAC: Adding query filter params (role.id=1c39b9ab8cfd4c0ea71845831920a845, scope.project.id=e61749eb818249119b76cae445ffa9ff, user.id=8f6fec93707c43349426f07392c71457) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:08.212906 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cfa92a-eba3-4f2d-bfe3-d0b385bdef7e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:08.214587 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cfa92a-eba3-4f2d-bfe3-d0b385bdef7e None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:08.221238 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 135/266] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Mar 30 07:02:08 2022] GET /identity/v3/role_assignments?user.id=8f6fec93707c43349426f07392c71457&scope.project.id=e61749eb818249119b76cae445ffa9ff&role.id=1c39b9ab8cfd4c0ea71845831920a845 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:08.287692 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c22988-1ab4-4dba-a0ea-1ce13ca5a1d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:08.288688 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c22988-1ab4-4dba-a0ea-1ce13ca5a1d7 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:08.289118 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c22988-1ab4-4dba-a0ea-1ce13ca5a1d7 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:08.289545 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c22988-1ab4-4dba-a0ea-1ce13ca5a1d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:08.403613 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c22988-1ab4-4dba-a0ea-1ce13ca5a1d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:08.405378 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c22988-1ab4-4dba-a0ea-1ce13ca5a1d7 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:08.672177 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 132/267] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Mar 30 07:02:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 679 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 30 07:02:08.678168 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cfa92a-eba3-4f2d-bfe3-d0b385bdef7e None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:08.794996 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cfa92a-eba3-4f2d-bfe3-d0b385bdef7e None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:08.832151 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55652554-0288-489d-be79-32674c4f66e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:08.833021 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55652554-0288-489d-be79-32674c4f66e6 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:08.833298 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55652554-0288-489d-be79-32674c4f66e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:08.833565 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55652554-0288-489d-be79-32674c4f66e6 None admin] PATH_INFO: `/v3/projects/e61749eb818249119b76cae445ffa9ff` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:08.834742 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55652554-0288-489d-be79-32674c4f66e6 None admin] RBAC: Authorizing `identity:get_project(project_id=e61749eb818249119b76cae445ffa9ff)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:08.836226 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55652554-0288-489d-be79-32674c4f66e6 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:08.838242 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 136/268] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Mar 30 07:02:08 2022] GET /identity/v3/projects/e61749eb818249119b76cae445ffa9ff => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:02:08.844056 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c22988-1ab4-4dba-a0ea-1ce13ca5a1d7 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:09.005991 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c22988-1ab4-4dba-a0ea-1ce13ca5a1d7 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:09.062402 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eaf3b9-3c97-4193-8fad-861a4c988952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:09.063075 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eaf3b9-3c97-4193-8fad-861a4c988952 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:09.063370 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eaf3b9-3c97-4193-8fad-861a4c988952 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:09.063615 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eaf3b9-3c97-4193-8fad-861a4c988952 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:09.064539 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eaf3b9-3c97-4193-8fad-861a4c988952 None admin] RBAC: Adding query filter params (role.id=075d8bdffff942c29baa73114127d3fa, scope.project.id=e61749eb818249119b76cae445ffa9ff, user.id=8f6fec93707c43349426f07392c71457) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:09.064855 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eaf3b9-3c97-4193-8fad-861a4c988952 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:09.066328 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eaf3b9-3c97-4193-8fad-861a4c988952 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:09.077217 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 133/269] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Mar 30 07:02:08 2022] GET /identity/v3/role_assignments?user.id=8f6fec93707c43349426f07392c71457&scope.project.id=e61749eb818249119b76cae445ffa9ff&role.id=075d8bdffff942c29baa73114127d3fa => generated 608 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:09.230389 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1883364c-c167-4266-b807-5716d9a09320 None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:09.230779 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1883364c-c167-4266-b807-5716d9a09320 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:09.231056 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1883364c-c167-4266-b807-5716d9a09320 None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:09.233337 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 137/270] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:02:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:02:09.239581 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d38584-c418-4896-bedd-a12d7b04466b None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:09.240102 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d38584-c418-4896-bedd-a12d7b04466b None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:09.240176 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d38584-c418-4896-bedd-a12d7b04466b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:09.264553 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-c2d38584-c418-4896-bedd-a12d7b04466b None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:02:09.265674 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-c2d38584-c418-4896-bedd-a12d7b04466b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:02:09.363180 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 134/271] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:02:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 30 07:02:09.400342 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1883364c-c167-4266-b807-5716d9a09320 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:09.447856 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5af3097-1c8f-4d42-b136-dbbd1d02bf5b None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:09.447856 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5af3097-1c8f-4d42-b136-dbbd1d02bf5b None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:09.447856 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5af3097-1c8f-4d42-b136-dbbd1d02bf5b None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:09.448873 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 135/272] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:02:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 30 07:02:09.454233 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833c5e32-e420-4c10-a4c8-3a31b5ba0ed2 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:09.454790 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833c5e32-e420-4c10-a4c8-3a31b5ba0ed2 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:09.455263 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833c5e32-e420-4c10-a4c8-3a31b5ba0ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:09.472917 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-833c5e32-e420-4c10-a4c8-3a31b5ba0ed2 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:02:09.474438 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-833c5e32-e420-4c10-a4c8-3a31b5ba0ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:02:09.540351 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1883364c-c167-4266-b807-5716d9a09320 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:09.547636 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 136/273] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:02:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 30 07:02:09.572965 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833c5e32-e420-4c10-a4c8-3a31b5ba0ed2 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:09.580327 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1661c8ed-5930-4f3f-807d-41cc68559b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:09.581130 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1661c8ed-5930-4f3f-807d-41cc68559b1b None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:09.581407 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1661c8ed-5930-4f3f-807d-41cc68559b1b None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:09.581682 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1661c8ed-5930-4f3f-807d-41cc68559b1b None admin] PATH_INFO: `/v3/domains/default` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:09.584663 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1661c8ed-5930-4f3f-807d-41cc68559b1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:09.586284 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1661c8ed-5930-4f3f-807d-41cc68559b1b None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:09.588317 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 138/274] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:02:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:09.598703 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1661c8ed-5930-4f3f-807d-41cc68559b1b None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:09.716099 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1661c8ed-5930-4f3f-807d-41cc68559b1b None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:09.716750 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833c5e32-e420-4c10-a4c8-3a31b5ba0ed2 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:09.758568 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10488118-da44-466d-a956-0d69cce49f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:09.759380 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10488118-da44-466d-a956-0d69cce49f33 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:09.759665 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10488118-da44-466d-a956-0d69cce49f33 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:09.759967 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10488118-da44-466d-a956-0d69cce49f33 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:09.763104 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277761aa-ca16-4b57-b42b-fe32d8c1a005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:09.764069 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277761aa-ca16-4b57-b42b-fe32d8c1a005 None admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:09.764565 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277761aa-ca16-4b57-b42b-fe32d8c1a005 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:09.765034 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277761aa-ca16-4b57-b42b-fe32d8c1a005 None admin] PATH_INFO: `/v3/users` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:09.765957 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277761aa-ca16-4b57-b42b-fe32d8c1a005 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:09.767609 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277761aa-ca16-4b57-b42b-fe32d8c1a005 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:09.770979 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10488118-da44-466d-a956-0d69cce49f33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 07:02:09.779787 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-10488118-da44-466d-a956-0d69cce49f33 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 30 07:02:09.783937 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 137/275] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Mar 30 07:02:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 07:02:09.788441 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10488118-da44-466d-a956-0d69cce49f33 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:09.795975 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 139/276] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Mar 30 07:02:09 2022] POST /identity/v3/users => generated 293 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 07:02:09.901924 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec27fb3-92c0-460e-b72f-0b2d46eb483a None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:09.902232 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec27fb3-92c0-460e-b72f-0b2d46eb483a None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:09.902460 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec27fb3-92c0-460e-b72f-0b2d46eb483a None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:09.904333 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 140/277] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:02:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 30 07:02:09.910104 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b028ed18-63a0-44a5-b1b2-4cb62a0d359d None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:09.910382 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b028ed18-63a0-44a5-b1b2-4cb62a0d359d None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:09.910652 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b028ed18-63a0-44a5-b1b2-4cb62a0d359d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:09.920750 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10488118-da44-466d-a956-0d69cce49f33 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:09.929025 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-b028ed18-63a0-44a5-b1b2-4cb62a0d359d None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:02:09.930256 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-b028ed18-63a0-44a5-b1b2-4cb62a0d359d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:02:09.973728 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70bd090-5945-49d2-ab7a-0442a7add5c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:09.974476 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70bd090-5945-49d2-ab7a-0442a7add5c3 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:09.974698 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70bd090-5945-49d2-ab7a-0442a7add5c3 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:09.974971 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70bd090-5945-49d2-ab7a-0442a7add5c3 None admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:09.975735 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70bd090-5945-49d2-ab7a-0442a7add5c3 None admin] RBAC: Adding query filter params (name=member) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:09.976077 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70bd090-5945-49d2-ab7a-0442a7add5c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:09.977647 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70bd090-5945-49d2-ab7a-0442a7add5c3 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:09.987663 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 138/278] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Mar 30 07:02:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:02:09.992819 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70bd090-5945-49d2-ab7a-0442a7add5c3 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:10.021766 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 141/279] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:02:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 07:02:10.049812 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b028ed18-63a0-44a5-b1b2-4cb62a0d359d None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:10.108790 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70bd090-5945-49d2-ab7a-0442a7add5c3 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:10.155639 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad3eb6d-8be2-42db-afe6-2883fdadd3f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:10.157371 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad3eb6d-8be2-42db-afe6-2883fdadd3f8 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:10.157371 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad3eb6d-8be2-42db-afe6-2883fdadd3f8 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:10.157371 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad3eb6d-8be2-42db-afe6-2883fdadd3f8 None admin] PATH_INFO: `/v3/users/3819a014e8ee40d78644f5aae58dda4e` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:10.173744 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b028ed18-63a0-44a5-b1b2-4cb62a0d359d None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:10.185216 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad3eb6d-8be2-42db-afe6-2883fdadd3f8 None admin] RBAC: Authorizing `identity:get_user(user_id=3819a014e8ee40d78644f5aae58dda4e)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:10.186726 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad3eb6d-8be2-42db-afe6-2883fdadd3f8 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:10.188694 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 139/280] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Mar 30 07:02:09 2022] GET /identity/v3/users/3819a014e8ee40d78644f5aae58dda4e => generated 293 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:10.194636 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad3eb6d-8be2-42db-afe6-2883fdadd3f8 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:10.219070 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5a3add-e307-4198-a878-18fd9d0542ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:10.219926 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5a3add-e307-4198-a878-18fd9d0542ee None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:10.220204 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5a3add-e307-4198-a878-18fd9d0542ee None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:10.220471 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5a3add-e307-4198-a878-18fd9d0542ee None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:10.233557 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5a3add-e307-4198-a878-18fd9d0542ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 07:02:10.244837 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-2b5a3add-e307-4198-a878-18fd9d0542ee None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 30 07:02:10.246492 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 142/281] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Mar 30 07:02:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 07:02:10.247714 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5291a4f-6db6-43d3-a62b-85bc41826d3e None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:10.248019 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5291a4f-6db6-43d3-a62b-85bc41826d3e None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:10.248281 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5291a4f-6db6-43d3-a62b-85bc41826d3e None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:10.250071 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 143/282] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:02:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:02:10.251791 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5291a4f-6db6-43d3-a62b-85bc41826d3e None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:10.330160 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad3eb6d-8be2-42db-afe6-2883fdadd3f8 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:10.356846 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5291a4f-6db6-43d3-a62b-85bc41826d3e None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:10.370365 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2d7b88-1c01-4222-b209-a12fefb35417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:10.371027 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d7b88-1c01-4222-b209-a12fefb35417 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:10.371304 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d7b88-1c01-4222-b209-a12fefb35417 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:10.371572 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d7b88-1c01-4222-b209-a12fefb35417 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:10.372451 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2d7b88-1c01-4222-b209-a12fefb35417 None admin] RBAC: Adding query filter params (role.id=5d79031a64754b57ba120367465e2252, user.id=3819a014e8ee40d78644f5aae58dda4e, scope.system=all) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:10.372757 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2d7b88-1c01-4222-b209-a12fefb35417 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:10.374212 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2d7b88-1c01-4222-b209-a12fefb35417 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:10.379514 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 140/283] 10.222.0.20 () {56 vars in 1308 bytes} [Wed Mar 30 07:02:10 2022] GET /identity/v3/role_assignments?user.id=3819a014e8ee40d78644f5aae58dda4e&scope.system=all&role.id=5d79031a64754b57ba120367465e2252 => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:02:10.380775 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3215a7-4d72-434a-9f4c-8b99eef6a4be None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:10.381058 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3215a7-4d72-434a-9f4c-8b99eef6a4be None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:10.381326 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3215a7-4d72-434a-9f4c-8b99eef6a4be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:10.398033 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7683c16f-2d66-49aa-8337-5ff079147df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:10.398764 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7683c16f-2d66-49aa-8337-5ff079147df9 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:10.398872 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-cf3215a7-4d72-434a-9f4c-8b99eef6a4be None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:02:10.399032 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7683c16f-2d66-49aa-8337-5ff079147df9 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:10.399306 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7683c16f-2d66-49aa-8337-5ff079147df9 None admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:10.400104 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-cf3215a7-4d72-434a-9f4c-8b99eef6a4be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:02:10.400208 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7683c16f-2d66-49aa-8337-5ff079147df9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:10.400468 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7683c16f-2d66-49aa-8337-5ff079147df9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:10.402001 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7683c16f-2d66-49aa-8337-5ff079147df9 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:10.414165 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 144/284] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Mar 30 07:02:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:02:10.421323 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7683c16f-2d66-49aa-8337-5ff079147df9 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:10.478126 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 141/285] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:02:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 07:02:10.506246 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3215a7-4d72-434a-9f4c-8b99eef6a4be None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:10.633481 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3215a7-4d72-434a-9f4c-8b99eef6a4be None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:10.637205 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7683c16f-2d66-49aa-8337-5ff079147df9 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:10.668887 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1ac972-bd06-4b3d-a8c7-5d78e5eff171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:10.669691 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ac972-bd06-4b3d-a8c7-5d78e5eff171 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:10.669968 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ac972-bd06-4b3d-a8c7-5d78e5eff171 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:10.670328 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ac972-bd06-4b3d-a8c7-5d78e5eff171 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:10.670680 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62181db-2d47-4878-bf5e-01349aca2f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:10.671652 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62181db-2d47-4878-bf5e-01349aca2f9f None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:10.671965 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62181db-2d47-4878-bf5e-01349aca2f9f None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:10.672239 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62181db-2d47-4878-bf5e-01349aca2f9f None admin] PATH_INFO: `/v3/users/c0cef026a6b64738a0413171a0cea3f9` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:10.673437 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62181db-2d47-4878-bf5e-01349aca2f9f None admin] RBAC: Authorizing `identity:get_user(user_id=c0cef026a6b64738a0413171a0cea3f9)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:10.674884 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62181db-2d47-4878-bf5e-01349aca2f9f None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:10.677789 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 145/286] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Mar 30 07:02:10 2022] GET /identity/v3/users/c0cef026a6b64738a0413171a0cea3f9 => generated 297 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:10.682950 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1ac972-bd06-4b3d-a8c7-5d78e5eff171 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 07:02:10.683288 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62181db-2d47-4878-bf5e-01349aca2f9f None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:10.691033 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-1e1ac972-bd06-4b3d-a8c7-5d78e5eff171 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 30 07:02:10.696967 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 142/287] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Mar 30 07:02:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 07:02:10.699025 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1ac972-bd06-4b3d-a8c7-5d78e5eff171 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:10.803502 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1ac972-bd06-4b3d-a8c7-5d78e5eff171 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:10.839203 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c752f7-42c6-4baf-bd59-ed166299b4a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:10.839904 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c752f7-42c6-4baf-bd59-ed166299b4a0 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:10.840182 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c752f7-42c6-4baf-bd59-ed166299b4a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:10.840455 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c752f7-42c6-4baf-bd59-ed166299b4a0 None admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:10.841389 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c752f7-42c6-4baf-bd59-ed166299b4a0 None admin] RBAC: Adding query filter params (name=member) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:10.841696 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c752f7-42c6-4baf-bd59-ed166299b4a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:10.843600 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c752f7-42c6-4baf-bd59-ed166299b4a0 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:10.857356 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 143/288] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Mar 30 07:02:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:10.858713 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c752f7-42c6-4baf-bd59-ed166299b4a0 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:10.953264 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62181db-2d47-4878-bf5e-01349aca2f9f None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:10.964341 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c752f7-42c6-4baf-bd59-ed166299b4a0 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:11.010190 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb848f19-363c-42c6-bbb2-c60259a22bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:11.011173 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb848f19-363c-42c6-bbb2-c60259a22bbe None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:11.011452 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb848f19-363c-42c6-bbb2-c60259a22bbe None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:11.011727 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb848f19-363c-42c6-bbb2-c60259a22bbe None admin] PATH_INFO: `/v3/users/7ef5044bafe94bf79818dd7f5832d43f` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:11.013034 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb848f19-363c-42c6-bbb2-c60259a22bbe None admin] RBAC: Authorizing `identity:get_user(user_id=7ef5044bafe94bf79818dd7f5832d43f)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:11.013881 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da227a8e-ca9b-4d9f-bc62-61458b5d4dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:11.014548 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb848f19-363c-42c6-bbb2-c60259a22bbe None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:11.014752 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da227a8e-ca9b-4d9f-bc62-61458b5d4dcf None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:11.015032 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da227a8e-ca9b-4d9f-bc62-61458b5d4dcf None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:11.015300 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da227a8e-ca9b-4d9f-bc62-61458b5d4dcf None admin] PATH_INFO: `/v3/projects/e61749eb818249119b76cae445ffa9ff` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:11.016546 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 144/289] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Mar 30 07:02:10 2022] GET /identity/v3/users/7ef5044bafe94bf79818dd7f5832d43f => generated 297 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:11.017533 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da227a8e-ca9b-4d9f-bc62-61458b5d4dcf None admin] RBAC: Authorizing `identity:get_project(project_id=e61749eb818249119b76cae445ffa9ff)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:11.019011 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da227a8e-ca9b-4d9f-bc62-61458b5d4dcf None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:11.024343 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 146/290] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Mar 30 07:02:10 2022] GET /identity/v3/projects/e61749eb818249119b76cae445ffa9ff => generated 302 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:02:11.028749 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da227a8e-ca9b-4d9f-bc62-61458b5d4dcf None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:11.028969 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb848f19-363c-42c6-bbb2-c60259a22bbe None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:11.126677 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da227a8e-ca9b-4d9f-bc62-61458b5d4dcf None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:11.164202 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de48614d-8dcd-4a73-89be-bbf8c42d608d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:11.165098 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de48614d-8dcd-4a73-89be-bbf8c42d608d None admin] REQUEST_METHOD: `PUT` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:11.165379 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de48614d-8dcd-4a73-89be-bbf8c42d608d None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:11.165650 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de48614d-8dcd-4a73-89be-bbf8c42d608d None admin] PATH_INFO: `/v3/projects/e61749eb818249119b76cae445ffa9ff/users/c0cef026a6b64738a0413171a0cea3f9/roles/9c31475dead84051aacf6440785d5194` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:11.171828 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de48614d-8dcd-4a73-89be-bbf8c42d608d None admin] RBAC: Authorizing `identity:create_grant(project_id=e61749eb818249119b76cae445ffa9ff, user_id=c0cef026a6b64738a0413171a0cea3f9, role_id=9c31475dead84051aacf6440785d5194)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:11.171828 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de48614d-8dcd-4a73-89be-bbf8c42d608d None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:11.188343 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 147/291] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Mar 30 07:02:11 2022] PUT /identity/v3/projects/e61749eb818249119b76cae445ffa9ff/users/c0cef026a6b64738a0413171a0cea3f9/roles/9c31475dead84051aacf6440785d5194 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:02:11.241903 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb848f19-363c-42c6-bbb2-c60259a22bbe None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:11.283553 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afde350-ebf9-49c8-92e9-af72c8c9b050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:11.284262 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afde350-ebf9-49c8-92e9-af72c8c9b050 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:11.284547 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afde350-ebf9-49c8-92e9-af72c8c9b050 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:11.284823 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afde350-ebf9-49c8-92e9-af72c8c9b050 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:11.357777 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afde350-ebf9-49c8-92e9-af72c8c9b050 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:11.359310 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afde350-ebf9-49c8-92e9-af72c8c9b050 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:11.472001 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 145/292] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Mar 30 07:02:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 30 07:02:11.473814 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de48614d-8dcd-4a73-89be-bbf8c42d608d None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:11.575362 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de48614d-8dcd-4a73-89be-bbf8c42d608d None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:11.609161 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4f5c87-82e6-4b1b-89ae-7950cd6756ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:11.610031 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f5c87-82e6-4b1b-89ae-7950cd6756ef None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:11.610304 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f5c87-82e6-4b1b-89ae-7950cd6756ef None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:11.610569 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f5c87-82e6-4b1b-89ae-7950cd6756ef None admin] PATH_INFO: `/v3/projects/e61749eb818249119b76cae445ffa9ff` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:11.612127 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4f5c87-82e6-4b1b-89ae-7950cd6756ef None admin] RBAC: Authorizing `identity:get_project(project_id=e61749eb818249119b76cae445ffa9ff)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:11.613568 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4f5c87-82e6-4b1b-89ae-7950cd6756ef None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:11.620108 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 148/293] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Mar 30 07:02:11 2022] GET /identity/v3/projects/e61749eb818249119b76cae445ffa9ff => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:11.621927 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afde350-ebf9-49c8-92e9-af72c8c9b050 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:11.746336 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afde350-ebf9-49c8-92e9-af72c8c9b050 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:11.788518 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da54575-156d-4b2c-873a-c906468daceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:11.789183 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da54575-156d-4b2c-873a-c906468daceb None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:11.789461 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da54575-156d-4b2c-873a-c906468daceb None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:11.789730 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da54575-156d-4b2c-873a-c906468daceb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:11.790560 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da54575-156d-4b2c-873a-c906468daceb None admin] RBAC: Adding query filter params (role.id=5d79031a64754b57ba120367465e2252, scope.project.id=e61749eb818249119b76cae445ffa9ff, user.id=7ef5044bafe94bf79818dd7f5832d43f) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:11.790860 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da54575-156d-4b2c-873a-c906468daceb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:11.792404 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da54575-156d-4b2c-873a-c906468daceb None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:11.798436 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 146/294] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Mar 30 07:02:11 2022] GET /identity/v3/role_assignments?user.id=7ef5044bafe94bf79818dd7f5832d43f&scope.project.id=e61749eb818249119b76cae445ffa9ff&role.id=5d79031a64754b57ba120367465e2252 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:12.653013 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716307af-edba-474c-9664-2cb015f852e1 None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:12.653726 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716307af-edba-474c-9664-2cb015f852e1 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:12.653726 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716307af-edba-474c-9664-2cb015f852e1 None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:12.655470 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 149/295] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:02:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:02:12.661003 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827b4099-7494-4f0c-b640-654256c10e07 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:12.661812 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827b4099-7494-4f0c-b640-654256c10e07 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:12.662348 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827b4099-7494-4f0c-b640-654256c10e07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:12.679469 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-827b4099-7494-4f0c-b640-654256c10e07 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:02:12.681069 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-827b4099-7494-4f0c-b640-654256c10e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:02:12.749473 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 147/296] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:02:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 07:02:12.774424 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9654e6-ef54-46c1-b122-31af7456bb59 None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:12.774424 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9654e6-ef54-46c1-b122-31af7456bb59 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:12.774424 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9654e6-ef54-46c1-b122-31af7456bb59 None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:12.774771 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827b4099-7494-4f0c-b640-654256c10e07 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:12.775152 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 150/297] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:02:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:02:12.781629 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a939dfeb-d161-4731-a4f3-e119ab88b059 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:12.781918 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a939dfeb-d161-4731-a4f3-e119ab88b059 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:12.782193 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a939dfeb-d161-4731-a4f3-e119ab88b059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:12.803964 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-a939dfeb-d161-4731-a4f3-e119ab88b059 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:02:12.805885 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-a939dfeb-d161-4731-a4f3-e119ab88b059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:02:12.874429 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 151/298] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:02:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 30 07:02:12.876118 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827b4099-7494-4f0c-b640-654256c10e07 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:12.898526 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a939dfeb-d161-4731-a4f3-e119ab88b059 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:12.916536 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e2341d-00c8-4262-8925-8502e02cea4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:12.917450 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e2341d-00c8-4262-8925-8502e02cea4e None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:12.917949 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e2341d-00c8-4262-8925-8502e02cea4e None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:12.918543 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e2341d-00c8-4262-8925-8502e02cea4e None admin] PATH_INFO: `/v3/domains/default` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:12.920021 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e2341d-00c8-4262-8925-8502e02cea4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:12.921715 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e2341d-00c8-4262-8925-8502e02cea4e None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:12.924053 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 148/299] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:02:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:02:12.932858 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e2341d-00c8-4262-8925-8502e02cea4e None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:13.006411 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a939dfeb-d161-4731-a4f3-e119ab88b059 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:13.036693 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e2341d-00c8-4262-8925-8502e02cea4e None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:13.045801 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfa8a2e-5543-4241-941f-2523b19a603d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:13.047138 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa8a2e-5543-4241-941f-2523b19a603d None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:13.047574 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa8a2e-5543-4241-941f-2523b19a603d None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:13.048016 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa8a2e-5543-4241-941f-2523b19a603d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:13.061011 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfa8a2e-5543-4241-941f-2523b19a603d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 07:02:13.070568 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-dcfa8a2e-5543-4241-941f-2523b19a603d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 30 07:02:13.072490 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 152/300] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Mar 30 07:02:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 07:02:13.076161 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf300487-27d5-41c7-89f9-4043e9917a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:13.076953 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf300487-27d5-41c7-89f9-4043e9917a4e None admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:13.077312 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf300487-27d5-41c7-89f9-4043e9917a4e None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:13.077652 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf300487-27d5-41c7-89f9-4043e9917a4e None admin] PATH_INFO: `/v3/groups` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:13.078424 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf300487-27d5-41c7-89f9-4043e9917a4e None admin] RBAC: Authorizing `identity:create_group()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:13.081495 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf300487-27d5-41c7-89f9-4043e9917a4e None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:13.082568 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfa8a2e-5543-4241-941f-2523b19a603d None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:13.099282 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 149/301] 10.222.0.20 () {60 vars in 1134 bytes} [Wed Mar 30 07:02:12 2022] POST /identity/v3/groups => generated 229 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 07:02:13.196702 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfa8a2e-5543-4241-941f-2523b19a603d None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:13.233740 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea313a6-093a-4b64-8c82-33e2879a34ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:13.234422 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea313a6-093a-4b64-8c82-33e2879a34ae None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:13.234705 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea313a6-093a-4b64-8c82-33e2879a34ae None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:13.234982 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea313a6-093a-4b64-8c82-33e2879a34ae None admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:13.235745 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea313a6-093a-4b64-8c82-33e2879a34ae None admin] RBAC: Adding query filter params (name=reader) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:13.236086 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea313a6-093a-4b64-8c82-33e2879a34ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:13.237876 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea313a6-093a-4b64-8c82-33e2879a34ae None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:13.247697 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 153/302] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Mar 30 07:02:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:13.253069 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf300487-27d5-41c7-89f9-4043e9917a4e None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:13.257219 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815333ea-65b5-4522-98d5-1faf17136889 None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:13.257801 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815333ea-65b5-4522-98d5-1faf17136889 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:13.258265 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815333ea-65b5-4522-98d5-1faf17136889 None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:13.260739 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 154/303] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:02:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 30 07:02:13.266971 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d1ab8-676b-4d5b-94f9-25a162d0e59f None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:13.267596 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d1ab8-676b-4d5b-94f9-25a162d0e59f None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:13.268103 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d1ab8-676b-4d5b-94f9-25a162d0e59f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:13.285815 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-b30d1ab8-676b-4d5b-94f9-25a162d0e59f None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:02:13.287370 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-b30d1ab8-676b-4d5b-94f9-25a162d0e59f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:02:13.380311 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf300487-27d5-41c7-89f9-4043e9917a4e None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:13.382112 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 155/304] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:02:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 30 07:02:13.405334 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30d1ab8-676b-4d5b-94f9-25a162d0e59f None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:13.417419 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb4bde4-1241-465f-b52b-71ecf4282051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:13.418333 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb4bde4-1241-465f-b52b-71ecf4282051 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:13.418592 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb4bde4-1241-465f-b52b-71ecf4282051 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:13.419029 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb4bde4-1241-465f-b52b-71ecf4282051 None admin] PATH_INFO: `/v3/users/88e949a6c53f485280cf6f5142abca93` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:13.433037 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb4bde4-1241-465f-b52b-71ecf4282051 None admin] RBAC: Authorizing `identity:get_user(user_id=88e949a6c53f485280cf6f5142abca93)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:13.434731 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb4bde4-1241-465f-b52b-71ecf4282051 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:13.436950 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 150/305] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Mar 30 07:02:13 2022] GET /identity/v3/users/88e949a6c53f485280cf6f5142abca93 => generated 293 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:02:13.442707 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb4bde4-1241-465f-b52b-71ecf4282051 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:13.505772 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30d1ab8-676b-4d5b-94f9-25a162d0e59f None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:13.539306 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ec7a36-1103-44f0-ab71-931be3be2c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:13.540529 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec7a36-1103-44f0-ab71-931be3be2c8b None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:13.541039 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec7a36-1103-44f0-ab71-931be3be2c8b None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:13.541513 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec7a36-1103-44f0-ab71-931be3be2c8b None admin] PATH_INFO: `/v3/roles/member` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:13.543689 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb4bde4-1241-465f-b52b-71ecf4282051 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:13.555799 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ec7a36-1103-44f0-ab71-931be3be2c8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 07:02:13.566505 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-97ec7a36-1103-44f0-ab71-931be3be2c8b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 30 07:02:13.569262 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 156/306] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Mar 30 07:02:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 07:02:13.577185 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ec7a36-1103-44f0-ab71-931be3be2c8b None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:13.581493 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16da4fae-308b-4974-a963-d9efc0da90c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:13.582163 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16da4fae-308b-4974-a963-d9efc0da90c4 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:13.582446 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16da4fae-308b-4974-a963-d9efc0da90c4 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:13.582722 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16da4fae-308b-4974-a963-d9efc0da90c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:13.583566 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16da4fae-308b-4974-a963-d9efc0da90c4 None admin] RBAC: Adding query filter params (role.id=9c31475dead84051aacf6440785d5194, user.id=88e949a6c53f485280cf6f5142abca93, scope.system=all) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:13.583901 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16da4fae-308b-4974-a963-d9efc0da90c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:13.585518 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16da4fae-308b-4974-a963-d9efc0da90c4 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:13.595962 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 151/307] 10.222.0.20 () {56 vars in 1308 bytes} [Wed Mar 30 07:02:13 2022] GET /identity/v3/role_assignments?user.id=88e949a6c53f485280cf6f5142abca93&scope.system=all&role.id=9c31475dead84051aacf6440785d5194 => generated 226 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:13.695058 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ec7a36-1103-44f0-ab71-931be3be2c8b None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:13.730189 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ea8351-10bd-4b36-8c7f-62f86b912080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:13.730880 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea8351-10bd-4b36-8c7f-62f86b912080 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:13.731167 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea8351-10bd-4b36-8c7f-62f86b912080 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:13.731433 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea8351-10bd-4b36-8c7f-62f86b912080 None admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:13.732220 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ea8351-10bd-4b36-8c7f-62f86b912080 None admin] RBAC: Adding query filter params (name=member) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:13.732521 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ea8351-10bd-4b36-8c7f-62f86b912080 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:13.733918 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ea8351-10bd-4b36-8c7f-62f86b912080 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:13.739851 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69354dd1-5afa-49f4-841d-114cfb042b2f None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:13.740811 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69354dd1-5afa-49f4-841d-114cfb042b2f None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:13.741302 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69354dd1-5afa-49f4-841d-114cfb042b2f None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:13.743706 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 152/308] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:02:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 30 07:02:13.748023 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 157/309] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Mar 30 07:02:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:13.749756 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c6e7f9-4b72-48f2-a587-cf9862406350 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:13.750075 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ea8351-10bd-4b36-8c7f-62f86b912080 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:13.750485 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c6e7f9-4b72-48f2-a587-cf9862406350 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:13.750848 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c6e7f9-4b72-48f2-a587-cf9862406350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:13.768441 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-d5c6e7f9-4b72-48f2-a587-cf9862406350 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:02:13.769988 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-d5c6e7f9-4b72-48f2-a587-cf9862406350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:02:13.852191 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ea8351-10bd-4b36-8c7f-62f86b912080 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:13.856788 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 153/310] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:02:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 07:02:13.880584 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c6e7f9-4b72-48f2-a587-cf9862406350 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:13.900861 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ce5f53-851a-433d-b57e-d8fbb86d719a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:13.902936 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ce5f53-851a-433d-b57e-d8fbb86d719a None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:13.903420 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ce5f53-851a-433d-b57e-d8fbb86d719a None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:13.904243 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ce5f53-851a-433d-b57e-d8fbb86d719a None admin] PATH_INFO: `/v3/users/3819a014e8ee40d78644f5aae58dda4e` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:13.906070 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ce5f53-851a-433d-b57e-d8fbb86d719a None admin] RBAC: Authorizing `identity:get_user(user_id=3819a014e8ee40d78644f5aae58dda4e)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:13.908149 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ce5f53-851a-433d-b57e-d8fbb86d719a None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:13.910995 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 158/311] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Mar 30 07:02:13 2022] GET /identity/v3/users/3819a014e8ee40d78644f5aae58dda4e => generated 293 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:02:13.916676 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ce5f53-851a-433d-b57e-d8fbb86d719a None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:13.982881 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c6e7f9-4b72-48f2-a587-cf9862406350 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:14.017161 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c90cff-c5be-444f-acaf-052eedba7be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:14.018048 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c90cff-c5be-444f-acaf-052eedba7be8 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:14.018220 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c90cff-c5be-444f-acaf-052eedba7be8 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:14.018543 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c90cff-c5be-444f-acaf-052eedba7be8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:14.028231 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ce5f53-851a-433d-b57e-d8fbb86d719a None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:14.028799 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c90cff-c5be-444f-acaf-052eedba7be8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 07:02:14.035965 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-61c90cff-c5be-444f-acaf-052eedba7be8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 30 07:02:14.042254 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 154/312] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Mar 30 07:02:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:02:14.043415 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c90cff-c5be-444f-acaf-052eedba7be8 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:14.063163 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02191751-6312-49af-8dfc-b5407b09cb8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:14.064427 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02191751-6312-49af-8dfc-b5407b09cb8a None admin] REQUEST_METHOD: `PUT` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:14.064931 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02191751-6312-49af-8dfc-b5407b09cb8a None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:14.065392 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02191751-6312-49af-8dfc-b5407b09cb8a None admin] PATH_INFO: `/v3/system/users/3819a014e8ee40d78644f5aae58dda4e/roles/5d79031a64754b57ba120367465e2252` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:14.067108 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02191751-6312-49af-8dfc-b5407b09cb8a None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=3819a014e8ee40d78644f5aae58dda4e, role_id=5d79031a64754b57ba120367465e2252)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:14.068761 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02191751-6312-49af-8dfc-b5407b09cb8a None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:14.088475 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 159/313] 10.222.0.20 () {58 vars in 1334 bytes} [Wed Mar 30 07:02:13 2022] PUT /identity/v3/system/users/3819a014e8ee40d78644f5aae58dda4e/roles/5d79031a64754b57ba120367465e2252 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 07:02:14.152169 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c90cff-c5be-444f-acaf-052eedba7be8 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:14.195007 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324f676f-8800-4cae-8c2b-354b057bca9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:14.196168 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f676f-8800-4cae-8c2b-354b057bca9e None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:14.196667 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f676f-8800-4cae-8c2b-354b057bca9e None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:14.197143 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f676f-8800-4cae-8c2b-354b057bca9e None admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:14.198206 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324f676f-8800-4cae-8c2b-354b057bca9e None admin] RBAC: Adding query filter params (name=reader) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:14.198705 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324f676f-8800-4cae-8c2b-354b057bca9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:14.200393 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324f676f-8800-4cae-8c2b-354b057bca9e None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:14.220801 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 155/314] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Mar 30 07:02:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:14.229342 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02191751-6312-49af-8dfc-b5407b09cb8a None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:14.337117 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02191751-6312-49af-8dfc-b5407b09cb8a None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:14.370024 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9e6941-015b-41db-9d59-1681aeac77b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:14.370903 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9e6941-015b-41db-9d59-1681aeac77b2 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:14.371180 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9e6941-015b-41db-9d59-1681aeac77b2 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:14.371447 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9e6941-015b-41db-9d59-1681aeac77b2 None admin] PATH_INFO: `/v3/users/c0cef026a6b64738a0413171a0cea3f9` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:14.372672 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9e6941-015b-41db-9d59-1681aeac77b2 None admin] RBAC: Authorizing `identity:get_user(user_id=c0cef026a6b64738a0413171a0cea3f9)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:14.374123 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9e6941-015b-41db-9d59-1681aeac77b2 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:14.376067 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 160/315] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Mar 30 07:02:14 2022] GET /identity/v3/users/c0cef026a6b64738a0413171a0cea3f9 => generated 297 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:14.381641 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324f676f-8800-4cae-8c2b-354b057bca9e None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:14.482939 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324f676f-8800-4cae-8c2b-354b057bca9e None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:14.516503 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc470cc-cba7-4ab0-84ee-a8969e83e61a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:14.517519 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc470cc-cba7-4ab0-84ee-a8969e83e61a None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:14.518027 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc470cc-cba7-4ab0-84ee-a8969e83e61a None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:14.518504 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc470cc-cba7-4ab0-84ee-a8969e83e61a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:14.587407 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc470cc-cba7-4ab0-84ee-a8969e83e61a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:14.589397 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc470cc-cba7-4ab0-84ee-a8969e83e61a None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:14.688606 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 156/316] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Mar 30 07:02:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 30 07:02:14.697148 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9e6941-015b-41db-9d59-1681aeac77b2 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:14.802236 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9e6941-015b-41db-9d59-1681aeac77b2 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:14.835634 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9ef66e-5e7e-45d9-b369-2a0946312e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:14.836800 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9ef66e-5e7e-45d9-b369-2a0946312e6e None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:14.837232 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9ef66e-5e7e-45d9-b369-2a0946312e6e None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:14.837714 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9ef66e-5e7e-45d9-b369-2a0946312e6e None admin] PATH_INFO: `/v3/projects/e61749eb818249119b76cae445ffa9ff` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:14.839078 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9ef66e-5e7e-45d9-b369-2a0946312e6e None admin] RBAC: Authorizing `identity:get_project(project_id=e61749eb818249119b76cae445ffa9ff)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:14.840735 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9ef66e-5e7e-45d9-b369-2a0946312e6e None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:14.842943 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 161/317] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Mar 30 07:02:14 2022] GET /identity/v3/projects/e61749eb818249119b76cae445ffa9ff => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:14.848717 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc470cc-cba7-4ab0-84ee-a8969e83e61a None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:14.947736 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc470cc-cba7-4ab0-84ee-a8969e83e61a None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:14.983291 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3cdb8c-b3a8-4da0-934c-5ab17eafafd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:14.984306 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3cdb8c-b3a8-4da0-934c-5ab17eafafd1 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:14.984769 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3cdb8c-b3a8-4da0-934c-5ab17eafafd1 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:14.985233 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3cdb8c-b3a8-4da0-934c-5ab17eafafd1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:14.986586 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3cdb8c-b3a8-4da0-934c-5ab17eafafd1 None admin] RBAC: Adding query filter params (role.id=9c31475dead84051aacf6440785d5194, scope.project.id=e61749eb818249119b76cae445ffa9ff, user.id=c0cef026a6b64738a0413171a0cea3f9) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:14.987070 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3cdb8c-b3a8-4da0-934c-5ab17eafafd1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:14.988704 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3cdb8c-b3a8-4da0-934c-5ab17eafafd1 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:14.995345 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 157/318] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Mar 30 07:02:14 2022] GET /identity/v3/role_assignments?user.id=c0cef026a6b64738a0413171a0cea3f9&scope.project.id=e61749eb818249119b76cae445ffa9ff&role.id=9c31475dead84051aacf6440785d5194 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:15.511189 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8991ad79-4571-46b1-8d5e-8c4d6c018fe5 None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:15.511387 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8991ad79-4571-46b1-8d5e-8c4d6c018fe5 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:15.511663 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8991ad79-4571-46b1-8d5e-8c4d6c018fe5 None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:15.513640 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 162/319] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:02:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:02:15.518783 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa02fd9d-5cbc-4f8f-8416-ed5fa7906df4 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:15.519047 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa02fd9d-5cbc-4f8f-8416-ed5fa7906df4 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:15.519339 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa02fd9d-5cbc-4f8f-8416-ed5fa7906df4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:15.536308 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-aa02fd9d-5cbc-4f8f-8416-ed5fa7906df4 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:02:15.537455 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-aa02fd9d-5cbc-4f8f-8416-ed5fa7906df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:02:15.610424 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 158/320] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:02:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 07:02:15.633098 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8991ad79-4571-46b1-8d5e-8c4d6c018fe5 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:15.740461 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8991ad79-4571-46b1-8d5e-8c4d6c018fe5 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:15.774733 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b40ad3-1323-4183-8088-44f37f3654f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:15.775435 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b40ad3-1323-4183-8088-44f37f3654f8 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:15.775709 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b40ad3-1323-4183-8088-44f37f3654f8 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:15.776026 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b40ad3-1323-4183-8088-44f37f3654f8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:15.777174 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b40ad3-1323-4183-8088-44f37f3654f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:15.778616 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b40ad3-1323-4183-8088-44f37f3654f8 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:15.780460 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 163/321] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:02:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:15.785997 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa02fd9d-5cbc-4f8f-8416-ed5fa7906df4 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:15.883192 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa02fd9d-5cbc-4f8f-8416-ed5fa7906df4 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:15.917368 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d182bb-3086-4561-b137-5078a596a2c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:15.918036 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d182bb-3086-4561-b137-5078a596a2c0 None admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:15.918306 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d182bb-3086-4561-b137-5078a596a2c0 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:15.918641 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d182bb-3086-4561-b137-5078a596a2c0 None admin] PATH_INFO: `/v3/groups` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:15.919851 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d182bb-3086-4561-b137-5078a596a2c0 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:15.921858 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f17d52-dde0-4134-9fd3-0b5cb95a8536 None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:15.921979 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d182bb-3086-4561-b137-5078a596a2c0 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:15.922061 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f17d52-dde0-4134-9fd3-0b5cb95a8536 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:15.922061 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f17d52-dde0-4134-9fd3-0b5cb95a8536 None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:15.923661 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 164/322] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:02:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 30 07:02:15.929162 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d9cd4b-7013-444d-ac68-ab0a21f18c5a None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:15.929450 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d9cd4b-7013-444d-ac68-ab0a21f18c5a None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:15.929727 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d9cd4b-7013-444d-ac68-ab0a21f18c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:15.945656 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 159/323] 10.222.0.20 () {60 vars in 1134 bytes} [Wed Mar 30 07:02:15 2022] POST /identity/v3/groups => generated 226 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:02:15.949096 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-25d9cd4b-7013-444d-ac68-ab0a21f18c5a None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:02:15.950691 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-25d9cd4b-7013-444d-ac68-ab0a21f18c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:02:16.035935 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 165/324] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:02:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 07:02:16.057337 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d182bb-3086-4561-b137-5078a596a2c0 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:16.169005 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d182bb-3086-4561-b137-5078a596a2c0 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:16.208592 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d085d052-7e82-48fc-b8e3-d1e1b2848611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:16.209409 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d085d052-7e82-48fc-b8e3-d1e1b2848611 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:16.209689 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d085d052-7e82-48fc-b8e3-d1e1b2848611 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:16.209957 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d085d052-7e82-48fc-b8e3-d1e1b2848611 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:16.221039 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d085d052-7e82-48fc-b8e3-d1e1b2848611 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 07:02:16.228527 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-d085d052-7e82-48fc-b8e3-d1e1b2848611 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 30 07:02:16.230395 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 160/325] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Mar 30 07:02:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 07:02:16.235977 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d9cd4b-7013-444d-ac68-ab0a21f18c5a None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:16.345303 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d9cd4b-7013-444d-ac68-ab0a21f18c5a None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:16.378744 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0b55ba-341b-4a6f-a4e7-dde82143800e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:16.379420 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0b55ba-341b-4a6f-a4e7-dde82143800e None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:16.379694 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0b55ba-341b-4a6f-a4e7-dde82143800e None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:16.379995 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0b55ba-341b-4a6f-a4e7-dde82143800e None admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:16.380743 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0b55ba-341b-4a6f-a4e7-dde82143800e None admin] RBAC: Adding query filter params (name=reader) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:16.381040 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0b55ba-341b-4a6f-a4e7-dde82143800e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:16.382430 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0b55ba-341b-4a6f-a4e7-dde82143800e None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:16.391046 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 166/326] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Mar 30 07:02:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:16.396933 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d085d052-7e82-48fc-b8e3-d1e1b2848611 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:16.478095 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a81ef9-eff1-4c02-8869-16d98b7ec6e0 None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:16.478441 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a81ef9-eff1-4c02-8869-16d98b7ec6e0 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:16.478722 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a81ef9-eff1-4c02-8869-16d98b7ec6e0 None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:16.480694 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 167/327] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:02:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:02:16.486102 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf60987-f31e-4c40-bad2-95602d2536e4 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:16.487512 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf60987-f31e-4c40-bad2-95602d2536e4 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:16.487512 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf60987-f31e-4c40-bad2-95602d2536e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:16.506632 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-cbf60987-f31e-4c40-bad2-95602d2536e4 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:02:16.507802 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-cbf60987-f31e-4c40-bad2-95602d2536e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:02:16.509128 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d085d052-7e82-48fc-b8e3-d1e1b2848611 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:16.544763 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149112dc-160a-48d1-b619-8af33240bcdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:16.545779 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149112dc-160a-48d1-b619-8af33240bcdd None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:16.545977 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149112dc-160a-48d1-b619-8af33240bcdd None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:16.546198 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149112dc-160a-48d1-b619-8af33240bcdd None admin] PATH_INFO: `/v3/users/88e949a6c53f485280cf6f5142abca93` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:16.547406 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149112dc-160a-48d1-b619-8af33240bcdd None admin] RBAC: Authorizing `identity:get_user(user_id=88e949a6c53f485280cf6f5142abca93)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:16.548913 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149112dc-160a-48d1-b619-8af33240bcdd None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:16.550861 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 161/328] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Mar 30 07:02:16 2022] GET /identity/v3/users/88e949a6c53f485280cf6f5142abca93 => generated 293 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:02:16.558233 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149112dc-160a-48d1-b619-8af33240bcdd None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:16.592933 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 168/329] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:02:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 30 07:02:16.618394 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf60987-f31e-4c40-bad2-95602d2536e4 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:16.664506 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149112dc-160a-48d1-b619-8af33240bcdd None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:16.699313 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d572a29-7215-4859-9039-8d5a4749e899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:16.700475 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d572a29-7215-4859-9039-8d5a4749e899 None admin] REQUEST_METHOD: `PUT` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:16.700930 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d572a29-7215-4859-9039-8d5a4749e899 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:16.701359 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d572a29-7215-4859-9039-8d5a4749e899 None admin] PATH_INFO: `/v3/system/users/88e949a6c53f485280cf6f5142abca93/roles/9c31475dead84051aacf6440785d5194` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:16.703049 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d572a29-7215-4859-9039-8d5a4749e899 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=88e949a6c53f485280cf6f5142abca93, role_id=9c31475dead84051aacf6440785d5194)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:16.704679 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d572a29-7215-4859-9039-8d5a4749e899 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:16.717817 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 162/330] 10.222.0.20 () {58 vars in 1334 bytes} [Wed Mar 30 07:02:16 2022] PUT /identity/v3/system/users/88e949a6c53f485280cf6f5142abca93/roles/9c31475dead84051aacf6440785d5194 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 07:02:16.721022 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf60987-f31e-4c40-bad2-95602d2536e4 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:16.765081 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cba63bf-500d-46fd-8913-a24e7f80f1c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:16.765906 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cba63bf-500d-46fd-8913-a24e7f80f1c8 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:16.766191 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cba63bf-500d-46fd-8913-a24e7f80f1c8 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:16.766463 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cba63bf-500d-46fd-8913-a24e7f80f1c8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:16.778663 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cba63bf-500d-46fd-8913-a24e7f80f1c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 07:02:16.785826 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-0cba63bf-500d-46fd-8913-a24e7f80f1c8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 30 07:02:16.787419 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 169/331] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Mar 30 07:02:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:02:16.793499 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d572a29-7215-4859-9039-8d5a4749e899 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:16.923000 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d572a29-7215-4859-9039-8d5a4749e899 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:16.962081 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f857bb87-30f0-4da8-b3a6-2a21abe9b304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:16.962761 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f857bb87-30f0-4da8-b3a6-2a21abe9b304 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:16.963043 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f857bb87-30f0-4da8-b3a6-2a21abe9b304 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:16.963316 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f857bb87-30f0-4da8-b3a6-2a21abe9b304 None admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:16.964252 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f857bb87-30f0-4da8-b3a6-2a21abe9b304 None admin] RBAC: Adding query filter params (name=member) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:16.964557 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f857bb87-30f0-4da8-b3a6-2a21abe9b304 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:16.965953 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f857bb87-30f0-4da8-b3a6-2a21abe9b304 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:16.975778 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 163/332] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Mar 30 07:02:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:16.981430 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cba63bf-500d-46fd-8913-a24e7f80f1c8 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:17.106356 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cba63bf-500d-46fd-8913-a24e7f80f1c8 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:17.145141 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1f7a5b-6460-4b1b-a630-83c850bd29a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:17.146036 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1f7a5b-6460-4b1b-a630-83c850bd29a1 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:17.146308 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1f7a5b-6460-4b1b-a630-83c850bd29a1 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:17.146591 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1f7a5b-6460-4b1b-a630-83c850bd29a1 None admin] PATH_INFO: `/v3/users/3819a014e8ee40d78644f5aae58dda4e` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:17.147894 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1f7a5b-6460-4b1b-a630-83c850bd29a1 None admin] RBAC: Authorizing `identity:get_user(user_id=3819a014e8ee40d78644f5aae58dda4e)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:17.149366 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1f7a5b-6460-4b1b-a630-83c850bd29a1 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:17.151327 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 170/333] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Mar 30 07:02:16 2022] GET /identity/v3/users/3819a014e8ee40d78644f5aae58dda4e => generated 293 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:17.159184 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f857bb87-30f0-4da8-b3a6-2a21abe9b304 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:17.302683 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f857bb87-30f0-4da8-b3a6-2a21abe9b304 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:17.346498 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa610fe3-22ca-4d46-9376-bb4ae3a96463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:17.347430 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa610fe3-22ca-4d46-9376-bb4ae3a96463 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:17.347712 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa610fe3-22ca-4d46-9376-bb4ae3a96463 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:17.348006 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa610fe3-22ca-4d46-9376-bb4ae3a96463 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:17.348838 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa610fe3-22ca-4d46-9376-bb4ae3a96463 None admin] RBAC: Adding query filter params (role.id=5d79031a64754b57ba120367465e2252, user.id=3819a014e8ee40d78644f5aae58dda4e, scope.system=all) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:17.349141 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa610fe3-22ca-4d46-9376-bb4ae3a96463 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:17.350580 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa610fe3-22ca-4d46-9376-bb4ae3a96463 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:17.369836 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 164/334] 10.222.0.20 () {56 vars in 1308 bytes} [Wed Mar 30 07:02:17 2022] GET /identity/v3/role_assignments?user.id=3819a014e8ee40d78644f5aae58dda4e&scope.system=all&role.id=5d79031a64754b57ba120367465e2252 => generated 510 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:19.110278 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8850a092-e9db-4993-b31c-caab403ef11b None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:19.111670 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8850a092-e9db-4993-b31c-caab403ef11b None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:19.112187 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8850a092-e9db-4993-b31c-caab403ef11b None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:19.114456 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 171/335] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:02:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:02:19.119577 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255189ea-009e-405e-80d3-72002aa9e159 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:19.120071 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255189ea-009e-405e-80d3-72002aa9e159 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:19.120252 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255189ea-009e-405e-80d3-72002aa9e159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:19.143918 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-255189ea-009e-405e-80d3-72002aa9e159 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:02:19.145104 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-255189ea-009e-405e-80d3-72002aa9e159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:02:19.236004 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 165/336] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:02:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 07:02:19.269537 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8850a092-e9db-4993-b31c-caab403ef11b None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:19.390352 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8850a092-e9db-4993-b31c-caab403ef11b None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:19.427875 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da852fb-0c91-4a7a-af74-8d14df2030e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:19.429065 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da852fb-0c91-4a7a-af74-8d14df2030e8 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:19.429553 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da852fb-0c91-4a7a-af74-8d14df2030e8 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:19.430031 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da852fb-0c91-4a7a-af74-8d14df2030e8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:19.441101 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da852fb-0c91-4a7a-af74-8d14df2030e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 07:02:19.448562 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-0da852fb-0c91-4a7a-af74-8d14df2030e8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 30 07:02:19.450332 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 172/337] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Mar 30 07:02:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:02:19.459833 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255189ea-009e-405e-80d3-72002aa9e159 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:19.545955 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047e684c-9658-4199-b56e-e3e52848d885 None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:19.546586 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047e684c-9658-4199-b56e-e3e52848d885 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:19.547078 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047e684c-9658-4199-b56e-e3e52848d885 None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:19.549404 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 173/338] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:02:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:02:19.554433 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da328f5a-ace1-42d5-89d5-5a0bb64a65f7 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:19.554974 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da328f5a-ace1-42d5-89d5-5a0bb64a65f7 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:19.555454 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da328f5a-ace1-42d5-89d5-5a0bb64a65f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:19.567834 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255189ea-009e-405e-80d3-72002aa9e159 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:19.582152 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-da328f5a-ace1-42d5-89d5-5a0bb64a65f7 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:02:19.583713 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-da328f5a-ace1-42d5-89d5-5a0bb64a65f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:02:19.607780 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a588a460-c378-45a0-8293-225dff681060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:19.608455 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a588a460-c378-45a0-8293-225dff681060 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:19.608770 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a588a460-c378-45a0-8293-225dff681060 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:19.609044 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a588a460-c378-45a0-8293-225dff681060 None admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:19.609808 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a588a460-c378-45a0-8293-225dff681060 None admin] RBAC: Adding query filter params (name=member) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:19.610114 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a588a460-c378-45a0-8293-225dff681060 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:19.611920 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a588a460-c378-45a0-8293-225dff681060 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:19.625318 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 166/339] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Mar 30 07:02:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:02:19.632466 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a588a460-c378-45a0-8293-225dff681060 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:19.749612 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 174/340] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:02:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 07:02:19.764518 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a588a460-c378-45a0-8293-225dff681060 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:19.792276 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da328f5a-ace1-42d5-89d5-5a0bb64a65f7 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:19.808736 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2f0de4-9a2a-42c6-b92f-74d9ec60598c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:19.809403 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2f0de4-9a2a-42c6-b92f-74d9ec60598c None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:19.809691 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2f0de4-9a2a-42c6-b92f-74d9ec60598c None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:19.809962 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2f0de4-9a2a-42c6-b92f-74d9ec60598c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:19.881974 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2f0de4-9a2a-42c6-b92f-74d9ec60598c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:19.883782 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2f0de4-9a2a-42c6-b92f-74d9ec60598c None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:19.933071 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da328f5a-ace1-42d5-89d5-5a0bb64a65f7 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:19.966984 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639fa89c-8ff2-4983-8c83-de1b742261f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:19.968076 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639fa89c-8ff2-4983-8c83-de1b742261f6 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:19.968498 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639fa89c-8ff2-4983-8c83-de1b742261f6 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:19.968915 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639fa89c-8ff2-4983-8c83-de1b742261f6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:19.979844 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639fa89c-8ff2-4983-8c83-de1b742261f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 07:02:19.983159 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 167/341] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Mar 30 07:02:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 30 07:02:19.984739 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae425a-7e41-480a-9dc2-6d32be49be8e None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:19.985172 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae425a-7e41-480a-9dc2-6d32be49be8e None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:19.985604 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae425a-7e41-480a-9dc2-6d32be49be8e None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:19.987865 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-639fa89c-8ff2-4983-8c83-de1b742261f6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 30 07:02:19.988116 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 168/342] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:02:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:02:19.989040 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbae425a-7e41-480a-9dc2-6d32be49be8e None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:19.989268 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 175/343] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Mar 30 07:02:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 07:02:19.994658 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea540b1-8347-4af4-aec7-4fdca9b5b51f None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:19.994947 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea540b1-8347-4af4-aec7-4fdca9b5b51f None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:19.995288 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea540b1-8347-4af4-aec7-4fdca9b5b51f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:20.013465 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-2ea540b1-8347-4af4-aec7-4fdca9b5b51f None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:02:20.014935 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-2ea540b1-8347-4af4-aec7-4fdca9b5b51f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:02:20.095235 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 176/344] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:02:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 30 07:02:20.096363 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea540b1-8347-4af4-aec7-4fdca9b5b51f None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:20.097538 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbae425a-7e41-480a-9dc2-6d32be49be8e None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:20.164510 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e572358-94d3-499a-a4fb-db296a1071b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:20.166176 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e572358-94d3-499a-a4fb-db296a1071b8 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:20.166769 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e572358-94d3-499a-a4fb-db296a1071b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:20.167232 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e572358-94d3-499a-a4fb-db296a1071b8 None admin] PATH_INFO: `/v3/projects/03146c35f6b74534aaeb260041749b99` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:20.168810 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e572358-94d3-499a-a4fb-db296a1071b8 None admin] RBAC: Authorizing `identity:get_project(project_id=03146c35f6b74534aaeb260041749b99)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:20.170460 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e572358-94d3-499a-a4fb-db296a1071b8 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:20.172857 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 169/345] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Mar 30 07:02:19 2022] GET /identity/v3/projects/03146c35f6b74534aaeb260041749b99 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:02:20.174051 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e572358-94d3-499a-a4fb-db296a1071b8 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:20.304976 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e572358-94d3-499a-a4fb-db296a1071b8 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:20.329590 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea540b1-8347-4af4-aec7-4fdca9b5b51f None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:20.348311 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a0559e-a10b-464c-8600-76ce1e4a5a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:20.349354 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a0559e-a10b-464c-8600-76ce1e4a5a4a None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:20.350255 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a0559e-a10b-464c-8600-76ce1e4a5a4a None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:20.350685 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a0559e-a10b-464c-8600-76ce1e4a5a4a None admin] PATH_INFO: `/v3/roles/member` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:20.361823 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a0559e-a10b-464c-8600-76ce1e4a5a4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 07:02:20.363871 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab2e62a-094d-4af1-ac3d-c6393607ff7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:20.364733 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab2e62a-094d-4af1-ac3d-c6393607ff7b None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:20.365189 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab2e62a-094d-4af1-ac3d-c6393607ff7b None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:20.365606 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab2e62a-094d-4af1-ac3d-c6393607ff7b None admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:20.366510 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab2e62a-094d-4af1-ac3d-c6393607ff7b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:20.366958 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab2e62a-094d-4af1-ac3d-c6393607ff7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:20.368510 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab2e62a-094d-4af1-ac3d-c6393607ff7b None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:20.371421 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-23a0559e-a10b-464c-8600-76ce1e4a5a4a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 30 07:02:20.373008 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 170/346] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Mar 30 07:02:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:02:20.373806 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a0559e-a10b-464c-8600-76ce1e4a5a4a None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:20.378100 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 177/347] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Mar 30 07:02:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:20.379752 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab2e62a-094d-4af1-ac3d-c6393607ff7b None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:20.479684 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a0559e-a10b-464c-8600-76ce1e4a5a4a None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:20.481172 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab2e62a-094d-4af1-ac3d-c6393607ff7b None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:20.514254 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d4255a-5922-4fa3-aed2-9d56de22118f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:20.515428 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d4255a-5922-4fa3-aed2-9d56de22118f None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:20.515562 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593b0dc2-5a37-470a-96d0-77f97ebea822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:20.516030 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d4255a-5922-4fa3-aed2-9d56de22118f None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:20.516140 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593b0dc2-5a37-470a-96d0-77f97ebea822 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:20.516416 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593b0dc2-5a37-470a-96d0-77f97ebea822 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:20.516692 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593b0dc2-5a37-470a-96d0-77f97ebea822 None admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:20.516822 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d4255a-5922-4fa3-aed2-9d56de22118f None admin] PATH_INFO: `/v3/groups/155688e886b64c548896712bbf16a02b` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:20.517446 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593b0dc2-5a37-470a-96d0-77f97ebea822 None admin] RBAC: Adding query filter params (name=member) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:20.517747 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593b0dc2-5a37-470a-96d0-77f97ebea822 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:20.519131 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593b0dc2-5a37-470a-96d0-77f97ebea822 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:20.523796 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d4255a-5922-4fa3-aed2-9d56de22118f None admin] RBAC: Authorizing `identity:get_group(group_id=155688e886b64c548896712bbf16a02b)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:20.525502 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d4255a-5922-4fa3-aed2-9d56de22118f None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:20.527568 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 171/348] 10.222.0.20 () {56 vars in 1180 bytes} [Wed Mar 30 07:02:20 2022] GET /identity/v3/groups/155688e886b64c548896712bbf16a02b => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:20.528517 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d4255a-5922-4fa3-aed2-9d56de22118f None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:20.528634 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 178/349] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Mar 30 07:02:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:20.533608 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593b0dc2-5a37-470a-96d0-77f97ebea822 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:20.636481 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d4255a-5922-4fa3-aed2-9d56de22118f None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:20.636752 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593b0dc2-5a37-470a-96d0-77f97ebea822 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:20.672918 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9798ed4e-a70e-429a-95ab-7dcf87886843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:20.673846 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9798ed4e-a70e-429a-95ab-7dcf87886843 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:20.674168 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60186c4-959a-499e-a5a3-c51b8799bc4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:20.674311 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9798ed4e-a70e-429a-95ab-7dcf87886843 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:20.674545 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9798ed4e-a70e-429a-95ab-7dcf87886843 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:20.675482 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60186c4-959a-499e-a5a3-c51b8799bc4c None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:20.676010 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60186c4-959a-499e-a5a3-c51b8799bc4c None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:20.676477 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60186c4-959a-499e-a5a3-c51b8799bc4c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:20.677518 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60186c4-959a-499e-a5a3-c51b8799bc4c None admin] RBAC: Adding query filter params (group.id=155688e886b64c548896712bbf16a02b, role.id=5d79031a64754b57ba120367465e2252, scope.project.id=03146c35f6b74534aaeb260041749b99) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:20.678046 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60186c4-959a-499e-a5a3-c51b8799bc4c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:20.679699 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60186c4-959a-499e-a5a3-c51b8799bc4c None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:20.686414 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 179/350] 10.222.0.20 () {56 vars in 1376 bytes} [Wed Mar 30 07:02:20 2022] GET /identity/v3/role_assignments?group.id=155688e886b64c548896712bbf16a02b&scope.project.id=03146c35f6b74534aaeb260041749b99&role.id=5d79031a64754b57ba120367465e2252 => generated 260 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:02:20.687594 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60186c4-959a-499e-a5a3-c51b8799bc4c None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:20.769770 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9798ed4e-a70e-429a-95ab-7dcf87886843 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:20.771528 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9798ed4e-a70e-429a-95ab-7dcf87886843 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:20.804377 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60186c4-959a-499e-a5a3-c51b8799bc4c None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:20.860541 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64fff54-59e1-428b-a62c-7a007e13e741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:20.861956 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64fff54-59e1-428b-a62c-7a007e13e741 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:20.863202 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64fff54-59e1-428b-a62c-7a007e13e741 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:20.863705 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64fff54-59e1-428b-a62c-7a007e13e741 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:20.939166 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 172/351] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Mar 30 07:02:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 30 07:02:20.945346 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14435efa-9acd-4045-9d22-8f74a3b0b074 None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:20.948318 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14435efa-9acd-4045-9d22-8f74a3b0b074 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:20.948873 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14435efa-9acd-4045-9d22-8f74a3b0b074 None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:20.950997 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 173/352] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:02:20 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:02:20.953408 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14435efa-9acd-4045-9d22-8f74a3b0b074 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:21.002429 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64fff54-59e1-428b-a62c-7a007e13e741 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:21.004305 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64fff54-59e1-428b-a62c-7a007e13e741 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:21.131373 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14435efa-9acd-4045-9d22-8f74a3b0b074 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:21.151927 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 180/353] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Mar 30 07:02:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 30 07:02:21.153065 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffade91d-908a-4d60-81fa-78feb51059fe None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:21.153356 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffade91d-908a-4d60-81fa-78feb51059fe None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:21.153631 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffade91d-908a-4d60-81fa-78feb51059fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:21.175007 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c6a75c-eaab-4750-a64a-54a91e0bf3bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:21.176725 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c6a75c-eaab-4750-a64a-54a91e0bf3bb None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:21.177205 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c6a75c-eaab-4750-a64a-54a91e0bf3bb None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:21.177686 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c6a75c-eaab-4750-a64a-54a91e0bf3bb None admin] PATH_INFO: `/v3/projects/03146c35f6b74534aaeb260041749b99` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:21.179239 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c6a75c-eaab-4750-a64a-54a91e0bf3bb None admin] RBAC: Authorizing `identity:get_project(project_id=03146c35f6b74534aaeb260041749b99)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:21.179673 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-ffade91d-908a-4d60-81fa-78feb51059fe None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:02:21.180883 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-ffade91d-908a-4d60-81fa-78feb51059fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:02:21.181414 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c6a75c-eaab-4750-a64a-54a91e0bf3bb None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:21.183581 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 174/354] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Mar 30 07:02:20 2022] GET /identity/v3/projects/03146c35f6b74534aaeb260041749b99 => generated 298 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:21.184651 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c6a75c-eaab-4750-a64a-54a91e0bf3bb None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:21.287579 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 181/355] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:02:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 07:02:21.288999 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffade91d-908a-4d60-81fa-78feb51059fe None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:21.325358 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c6a75c-eaab-4750-a64a-54a91e0bf3bb None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:21.365380 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f944c2-85b4-46e2-8f44-602a43bd0ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:21.366251 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f944c2-85b4-46e2-8f44-602a43bd0ce8 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:21.366523 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f944c2-85b4-46e2-8f44-602a43bd0ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:21.366790 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f944c2-85b4-46e2-8f44-602a43bd0ce8 None admin] PATH_INFO: `/v3/projects/e61749eb818249119b76cae445ffa9ff` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:21.368017 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f944c2-85b4-46e2-8f44-602a43bd0ce8 None admin] RBAC: Authorizing `identity:get_project(project_id=e61749eb818249119b76cae445ffa9ff)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:21.369539 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f944c2-85b4-46e2-8f44-602a43bd0ce8 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:21.371458 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 175/356] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Mar 30 07:02:21 2022] GET /identity/v3/projects/e61749eb818249119b76cae445ffa9ff => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:21.372717 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ab692e-1d99-4d7e-a818-3d8c9aa459cf None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:21.372997 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ab692e-1d99-4d7e-a818-3d8c9aa459cf None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:21.373263 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ab692e-1d99-4d7e-a818-3d8c9aa459cf None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:21.375115 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 176/357] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:02:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:02:21.375900 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ab692e-1d99-4d7e-a818-3d8c9aa459cf None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:21.398611 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffade91d-908a-4d60-81fa-78feb51059fe None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:21.434273 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639107fb-06de-4a92-8586-bfc17f00a26d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:21.435164 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639107fb-06de-4a92-8586-bfc17f00a26d None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:21.435444 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639107fb-06de-4a92-8586-bfc17f00a26d None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:21.435720 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639107fb-06de-4a92-8586-bfc17f00a26d None admin] PATH_INFO: `/v3/groups/155688e886b64c548896712bbf16a02b` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:21.436927 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639107fb-06de-4a92-8586-bfc17f00a26d None admin] RBAC: Authorizing `identity:get_group(group_id=155688e886b64c548896712bbf16a02b)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:21.438377 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639107fb-06de-4a92-8586-bfc17f00a26d None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:21.440041 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 182/358] 10.222.0.20 () {56 vars in 1180 bytes} [Wed Mar 30 07:02:21 2022] GET /identity/v3/groups/155688e886b64c548896712bbf16a02b => generated 226 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:21.441245 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9b3d20-9457-4b50-9e30-ce1a7081275d None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:21.441528 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9b3d20-9457-4b50-9e30-ce1a7081275d None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:21.441801 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9b3d20-9457-4b50-9e30-ce1a7081275d None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:21.443705 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 183/359] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:02:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:02:21.444466 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9b3d20-9457-4b50-9e30-ce1a7081275d None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:21.512741 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ab692e-1d99-4d7e-a818-3d8c9aa459cf None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:21.561380 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac15465-f8ce-4f85-99a4-6afd9c6e379c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:21.562222 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac15465-f8ce-4f85-99a4-6afd9c6e379c None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:21.562502 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac15465-f8ce-4f85-99a4-6afd9c6e379c None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:21.562767 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac15465-f8ce-4f85-99a4-6afd9c6e379c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:21.565404 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9b3d20-9457-4b50-9e30-ce1a7081275d None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:21.581354 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac15465-f8ce-4f85-99a4-6afd9c6e379c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 07:02:21.588518 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-eac15465-f8ce-4f85-99a4-6afd9c6e379c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 30 07:02:21.594465 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 177/360] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Mar 30 07:02:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:02:21.594465 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f048ed-d474-45ff-abda-0e2905cf49b5 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:21.594465 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f048ed-d474-45ff-abda-0e2905cf49b5 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:21.594465 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f048ed-d474-45ff-abda-0e2905cf49b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:21.609475 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-a9f048ed-d474-45ff-abda-0e2905cf49b5 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:02:21.610640 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-a9f048ed-d474-45ff-abda-0e2905cf49b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:02:21.616241 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa6102c-7f1b-4b3f-8ba8-60f57862d67e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:21.617273 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa6102c-7f1b-4b3f-8ba8-60f57862d67e None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:21.617557 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa6102c-7f1b-4b3f-8ba8-60f57862d67e None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:21.617831 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa6102c-7f1b-4b3f-8ba8-60f57862d67e None admin] PATH_INFO: `/v3/groups/155688e886b64c548896712bbf16a02b` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:21.619037 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa6102c-7f1b-4b3f-8ba8-60f57862d67e None admin] RBAC: Authorizing `identity:get_group(group_id=155688e886b64c548896712bbf16a02b)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:21.620558 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa6102c-7f1b-4b3f-8ba8-60f57862d67e None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:21.622374 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 184/361] 10.222.0.20 () {56 vars in 1180 bytes} [Wed Mar 30 07:02:21 2022] GET /identity/v3/groups/155688e886b64c548896712bbf16a02b => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:21.623398 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92896a9-d5f1-49b7-8031-ccdf067f01b6 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:21.623683 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92896a9-d5f1-49b7-8031-ccdf067f01b6 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:21.624000 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92896a9-d5f1-49b7-8031-ccdf067f01b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:21.643631 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-e92896a9-d5f1-49b7-8031-ccdf067f01b6 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:02:21.644987 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-e92896a9-d5f1-49b7-8031-ccdf067f01b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:02:21.717531 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 178/362] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:02:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 07:02:21.718432 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f048ed-d474-45ff-abda-0e2905cf49b5 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:21.727643 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 185/363] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:02:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 07:02:21.733289 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92896a9-d5f1-49b7-8031-ccdf067f01b6 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:21.845649 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f048ed-d474-45ff-abda-0e2905cf49b5 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:21.863950 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92896a9-d5f1-49b7-8031-ccdf067f01b6 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:21.887958 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c88f51e-38a5-4fb2-bff9-f536c79daced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:21.888600 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c88f51e-38a5-4fb2-bff9-f536c79daced None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:21.888936 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c88f51e-38a5-4fb2-bff9-f536c79daced None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:21.889214 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c88f51e-38a5-4fb2-bff9-f536c79daced None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:21.890052 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c88f51e-38a5-4fb2-bff9-f536c79daced None admin] RBAC: Adding query filter params (group.id=155688e886b64c548896712bbf16a02b, role.id=075d8bdffff942c29baa73114127d3fa, scope.project.id=03146c35f6b74534aaeb260041749b99) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:21.890393 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c88f51e-38a5-4fb2-bff9-f536c79daced None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:21.891833 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c88f51e-38a5-4fb2-bff9-f536c79daced None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:21.897475 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 179/364] 10.222.0.20 () {56 vars in 1376 bytes} [Wed Mar 30 07:02:21 2022] GET /identity/v3/role_assignments?group.id=155688e886b64c548896712bbf16a02b&scope.project.id=03146c35f6b74534aaeb260041749b99&role.id=075d8bdffff942c29baa73114127d3fa => generated 260 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:21.899918 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c88f51e-38a5-4fb2-bff9-f536c79daced None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:21.906247 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a117da30-1e46-439e-a7e5-b9c5f93c7d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:21.906941 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a117da30-1e46-439e-a7e5-b9c5f93c7d83 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:21.907218 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a117da30-1e46-439e-a7e5-b9c5f93c7d83 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:21.907488 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a117da30-1e46-439e-a7e5-b9c5f93c7d83 None admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:21.910173 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a117da30-1e46-439e-a7e5-b9c5f93c7d83 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:21.910477 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a117da30-1e46-439e-a7e5-b9c5f93c7d83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:21.912476 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a117da30-1e46-439e-a7e5-b9c5f93c7d83 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:21.927964 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 186/365] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Mar 30 07:02:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:21.929010 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a117da30-1e46-439e-a7e5-b9c5f93c7d83 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:22.038511 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c88f51e-38a5-4fb2-bff9-f536c79daced None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:22.045940 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a117da30-1e46-439e-a7e5-b9c5f93c7d83 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:22.076203 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeed0b53-23d8-4c70-a659-687e16cfcd10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:22.076877 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeed0b53-23d8-4c70-a659-687e16cfcd10 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:22.077156 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeed0b53-23d8-4c70-a659-687e16cfcd10 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:22.077424 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeed0b53-23d8-4c70-a659-687e16cfcd10 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:22.078279 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeed0b53-23d8-4c70-a659-687e16cfcd10 None admin] RBAC: Adding query filter params (group.id=155688e886b64c548896712bbf16a02b, role.id=5d79031a64754b57ba120367465e2252, scope.project.id=e61749eb818249119b76cae445ffa9ff) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:22.078584 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeed0b53-23d8-4c70-a659-687e16cfcd10 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:22.080110 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeed0b53-23d8-4c70-a659-687e16cfcd10 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:22.083213 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bffb32-d880-44a0-9da6-db530a8de5e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:22.084083 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bffb32-d880-44a0-9da6-db530a8de5e1 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:22.084368 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bffb32-d880-44a0-9da6-db530a8de5e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:22.084644 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bffb32-d880-44a0-9da6-db530a8de5e1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:22.087267 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 180/366] 10.222.0.20 () {56 vars in 1376 bytes} [Wed Mar 30 07:02:21 2022] GET /identity/v3/role_assignments?group.id=155688e886b64c548896712bbf16a02b&scope.project.id=e61749eb818249119b76cae445ffa9ff&role.id=5d79031a64754b57ba120367465e2252 => generated 260 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:22.088100 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeed0b53-23d8-4c70-a659-687e16cfcd10 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:22.097047 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bffb32-d880-44a0-9da6-db530a8de5e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 07:02:22.104460 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-02bffb32-d880-44a0-9da6-db530a8de5e1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 30 07:02:22.106115 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 187/367] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Mar 30 07:02:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:02:22.106939 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bffb32-d880-44a0-9da6-db530a8de5e1 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:22.200081 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeed0b53-23d8-4c70-a659-687e16cfcd10 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:22.223844 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bffb32-d880-44a0-9da6-db530a8de5e1 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:22.238852 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c85d2b0-da96-420e-a5f3-971e75c72786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:22.240676 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c85d2b0-da96-420e-a5f3-971e75c72786 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:22.240966 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c85d2b0-da96-420e-a5f3-971e75c72786 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:22.241240 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c85d2b0-da96-420e-a5f3-971e75c72786 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:22.254534 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c85d2b0-da96-420e-a5f3-971e75c72786 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 07:02:22.258220 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458bf74b-32d2-4763-982b-9a6b953efc1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:22.259097 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458bf74b-32d2-4763-982b-9a6b953efc1a None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:22.259377 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458bf74b-32d2-4763-982b-9a6b953efc1a None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:22.259650 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458bf74b-32d2-4763-982b-9a6b953efc1a None admin] PATH_INFO: `/v3/users/88e949a6c53f485280cf6f5142abca93` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:22.260997 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458bf74b-32d2-4763-982b-9a6b953efc1a None admin] RBAC: Authorizing `identity:get_user(user_id=88e949a6c53f485280cf6f5142abca93)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:22.262470 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458bf74b-32d2-4763-982b-9a6b953efc1a None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:22.263386 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-9c85d2b0-da96-420e-a5f3-971e75c72786 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 30 07:02:22.264358 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 188/368] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Mar 30 07:02:22 2022] GET /identity/v3/users/88e949a6c53f485280cf6f5142abca93 => generated 293 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:22.265149 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458bf74b-32d2-4763-982b-9a6b953efc1a None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:22.268998 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 181/369] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Mar 30 07:02:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:02:22.276797 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c85d2b0-da96-420e-a5f3-971e75c72786 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:22.372391 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458bf74b-32d2-4763-982b-9a6b953efc1a None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:22.392442 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c85d2b0-da96-420e-a5f3-971e75c72786 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:22.412322 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97467b8d-5ed0-472a-ba35-931bcc925182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:22.413401 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97467b8d-5ed0-472a-ba35-931bcc925182 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:22.413700 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97467b8d-5ed0-472a-ba35-931bcc925182 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:22.413973 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97467b8d-5ed0-472a-ba35-931bcc925182 None admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:22.415008 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97467b8d-5ed0-472a-ba35-931bcc925182 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:22.415313 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97467b8d-5ed0-472a-ba35-931bcc925182 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:22.417952 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97467b8d-5ed0-472a-ba35-931bcc925182 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:22.427402 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0dfd6c-85bf-4375-827b-4ea4238cd167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:22.428115 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0dfd6c-85bf-4375-827b-4ea4238cd167 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:22.428395 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0dfd6c-85bf-4375-827b-4ea4238cd167 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:22.428670 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0dfd6c-85bf-4375-827b-4ea4238cd167 None admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:22.428784 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 189/370] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Mar 30 07:02:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:22.429422 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0dfd6c-85bf-4375-827b-4ea4238cd167 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:22.429586 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97467b8d-5ed0-472a-ba35-931bcc925182 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:22.429730 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0dfd6c-85bf-4375-827b-4ea4238cd167 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:22.431318 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0dfd6c-85bf-4375-827b-4ea4238cd167 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:22.445736 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 182/371] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Mar 30 07:02:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:22.446621 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0dfd6c-85bf-4375-827b-4ea4238cd167 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:22.612203 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97467b8d-5ed0-472a-ba35-931bcc925182 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:22.632457 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0dfd6c-85bf-4375-827b-4ea4238cd167 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:22.682016 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79464e73-dddc-4114-9a45-c6fbd63c40f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:22.683047 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79464e73-dddc-4114-9a45-c6fbd63c40f4 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:22.683334 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79464e73-dddc-4114-9a45-c6fbd63c40f4 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:22.683615 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79464e73-dddc-4114-9a45-c6fbd63c40f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:22.684505 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79464e73-dddc-4114-9a45-c6fbd63c40f4 None admin] RBAC: Adding query filter params (role.id=9c31475dead84051aacf6440785d5194, user.id=88e949a6c53f485280cf6f5142abca93, scope.system=all) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:22.684818 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79464e73-dddc-4114-9a45-c6fbd63c40f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:22.686277 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79464e73-dddc-4114-9a45-c6fbd63c40f4 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:22.692787 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a5ef18-d265-4cc2-b47c-0e703c3b7002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:22.693449 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a5ef18-d265-4cc2-b47c-0e703c3b7002 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:22.693731 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a5ef18-d265-4cc2-b47c-0e703c3b7002 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:22.694010 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a5ef18-d265-4cc2-b47c-0e703c3b7002 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:22.716051 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 190/372] 10.222.0.20 () {56 vars in 1308 bytes} [Wed Mar 30 07:02:22 2022] GET /identity/v3/role_assignments?user.id=88e949a6c53f485280cf6f5142abca93&scope.system=all&role.id=9c31475dead84051aacf6440785d5194 => generated 510 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:22.716915 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79464e73-dddc-4114-9a45-c6fbd63c40f4 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:22.835325 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a5ef18-d265-4cc2-b47c-0e703c3b7002 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:22.836918 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a5ef18-d265-4cc2-b47c-0e703c3b7002 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:22.935918 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79464e73-dddc-4114-9a45-c6fbd63c40f4 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:22.976562 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 183/373] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Mar 30 07:02:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 30 07:02:22.982341 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a5ef18-d265-4cc2-b47c-0e703c3b7002 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:23.014325 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65350a1f-97b5-4e57-91f7-82efe635a427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:23.015382 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65350a1f-97b5-4e57-91f7-82efe635a427 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:23.015875 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65350a1f-97b5-4e57-91f7-82efe635a427 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:23.016358 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65350a1f-97b5-4e57-91f7-82efe635a427 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:23.089463 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a5ef18-d265-4cc2-b47c-0e703c3b7002 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:23.125583 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58481ffd-aad8-44c1-8338-fad086a19292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:23.126466 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58481ffd-aad8-44c1-8338-fad086a19292 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:23.126744 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58481ffd-aad8-44c1-8338-fad086a19292 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:23.127017 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58481ffd-aad8-44c1-8338-fad086a19292 None admin] PATH_INFO: `/v3/projects/e0c9fc0b60d1476cbb305fe8a9512169` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:23.128263 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58481ffd-aad8-44c1-8338-fad086a19292 None admin] RBAC: Authorizing `identity:get_project(project_id=e0c9fc0b60d1476cbb305fe8a9512169)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:23.129717 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58481ffd-aad8-44c1-8338-fad086a19292 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:23.131733 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 184/374] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Mar 30 07:02:22 2022] GET /identity/v3/projects/e0c9fc0b60d1476cbb305fe8a9512169 => generated 344 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:02:23.139846 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58481ffd-aad8-44c1-8338-fad086a19292 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:23.174256 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65350a1f-97b5-4e57-91f7-82efe635a427 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:23.176151 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65350a1f-97b5-4e57-91f7-82efe635a427 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:23.251905 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58481ffd-aad8-44c1-8338-fad086a19292 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:23.285892 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a122e7ad-cf7b-4b00-82b5-3478c0ca363e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:23.286757 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a122e7ad-cf7b-4b00-82b5-3478c0ca363e None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:23.287037 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a122e7ad-cf7b-4b00-82b5-3478c0ca363e None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:23.287311 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a122e7ad-cf7b-4b00-82b5-3478c0ca363e None admin] PATH_INFO: `/v3/groups/9005d480268848caa4e54fca9a1a4469` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:23.292431 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a122e7ad-cf7b-4b00-82b5-3478c0ca363e None admin] RBAC: Authorizing `identity:get_group(group_id=9005d480268848caa4e54fca9a1a4469)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:23.293897 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a122e7ad-cf7b-4b00-82b5-3478c0ca363e None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:23.295932 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 185/375] 10.222.0.20 () {56 vars in 1180 bytes} [Wed Mar 30 07:02:23 2022] GET /identity/v3/groups/9005d480268848caa4e54fca9a1a4469 => generated 229 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:02:23.301659 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a122e7ad-cf7b-4b00-82b5-3478c0ca363e None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:23.316003 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 191/376] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Mar 30 07:02:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 599 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 30 07:02:23.325115 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65350a1f-97b5-4e57-91f7-82efe635a427 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:23.408050 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a122e7ad-cf7b-4b00-82b5-3478c0ca363e None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:23.443405 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c1a226-ae7d-46f4-a808-ac2643fc920b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:23.444454 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c1a226-ae7d-46f4-a808-ac2643fc920b None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:23.444892 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c1a226-ae7d-46f4-a808-ac2643fc920b None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:23.445310 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c1a226-ae7d-46f4-a808-ac2643fc920b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:23.446318 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c1a226-ae7d-46f4-a808-ac2643fc920b None admin] RBAC: Adding query filter params (group.id=9005d480268848caa4e54fca9a1a4469, role.id=1c39b9ab8cfd4c0ea71845831920a845, scope.project.id=e0c9fc0b60d1476cbb305fe8a9512169) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:23.446772 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c1a226-ae7d-46f4-a808-ac2643fc920b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:23.448615 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c1a226-ae7d-46f4-a808-ac2643fc920b None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:23.454747 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 186/377] 10.222.0.20 () {56 vars in 1376 bytes} [Wed Mar 30 07:02:23 2022] GET /identity/v3/role_assignments?group.id=9005d480268848caa4e54fca9a1a4469&scope.project.id=e0c9fc0b60d1476cbb305fe8a9512169&role.id=1c39b9ab8cfd4c0ea71845831920a845 => generated 260 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:02:23.513411 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65350a1f-97b5-4e57-91f7-82efe635a427 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:23.551444 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c6e449-415e-416c-8594-e84742a1b603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:23.552364 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c6e449-415e-416c-8594-e84742a1b603 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:23.552646 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c6e449-415e-416c-8594-e84742a1b603 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:23.552912 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c6e449-415e-416c-8594-e84742a1b603 None admin] PATH_INFO: `/v3/projects/e61749eb818249119b76cae445ffa9ff` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:23.554159 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c6e449-415e-416c-8594-e84742a1b603 None admin] RBAC: Authorizing `identity:get_project(project_id=e61749eb818249119b76cae445ffa9ff)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:23.555642 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c6e449-415e-416c-8594-e84742a1b603 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:23.558195 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 192/378] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Mar 30 07:02:23 2022] GET /identity/v3/projects/e61749eb818249119b76cae445ffa9ff => generated 302 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:23.563572 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c1a226-ae7d-46f4-a808-ac2643fc920b None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:23.689033 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c1a226-ae7d-46f4-a808-ac2643fc920b None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:23.689370 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b794c99-bf9c-4a09-8703-078728158a96 None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:23.689642 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b794c99-bf9c-4a09-8703-078728158a96 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:23.689912 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b794c99-bf9c-4a09-8703-078728158a96 None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:23.695833 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 193/379] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:02:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:02:23.697373 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055ffd6d-6c25-4367-99bc-94687f256ea2 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:23.699859 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055ffd6d-6c25-4367-99bc-94687f256ea2 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:23.700180 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055ffd6d-6c25-4367-99bc-94687f256ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:23.721072 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-055ffd6d-6c25-4367-99bc-94687f256ea2 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:02:23.722349 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-055ffd6d-6c25-4367-99bc-94687f256ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:02:23.733609 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8708a4e1-9720-462d-b4fa-ca15ec5f0e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:23.734830 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8708a4e1-9720-462d-b4fa-ca15ec5f0e1f None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:23.735336 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8708a4e1-9720-462d-b4fa-ca15ec5f0e1f None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:23.735833 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8708a4e1-9720-462d-b4fa-ca15ec5f0e1f None admin] PATH_INFO: `/v3/groups/155688e886b64c548896712bbf16a02b` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:23.737609 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8708a4e1-9720-462d-b4fa-ca15ec5f0e1f None admin] RBAC: Authorizing `identity:get_group(group_id=155688e886b64c548896712bbf16a02b)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:23.739301 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8708a4e1-9720-462d-b4fa-ca15ec5f0e1f None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:23.741562 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 187/380] 10.222.0.20 () {56 vars in 1180 bytes} [Wed Mar 30 07:02:23 2022] GET /identity/v3/groups/155688e886b64c548896712bbf16a02b => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:23.751968 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8708a4e1-9720-462d-b4fa-ca15ec5f0e1f None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:23.829038 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 194/381] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:02:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 07:02:23.860060 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055ffd6d-6c25-4367-99bc-94687f256ea2 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:23.917543 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8708a4e1-9720-462d-b4fa-ca15ec5f0e1f None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:23.981904 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e311ede5-0ed1-41f5-906a-d7f540a344d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:23.982570 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e311ede5-0ed1-41f5-906a-d7f540a344d9 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:23.982845 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e311ede5-0ed1-41f5-906a-d7f540a344d9 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:23.983116 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e311ede5-0ed1-41f5-906a-d7f540a344d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:23.983971 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e311ede5-0ed1-41f5-906a-d7f540a344d9 None admin] RBAC: Adding query filter params (group.id=155688e886b64c548896712bbf16a02b, role.id=075d8bdffff942c29baa73114127d3fa, scope.project.id=e61749eb818249119b76cae445ffa9ff) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:23.984278 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e311ede5-0ed1-41f5-906a-d7f540a344d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:23.985712 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e311ede5-0ed1-41f5-906a-d7f540a344d9 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:23.992450 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055ffd6d-6c25-4367-99bc-94687f256ea2 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:24.000365 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 188/382] 10.222.0.20 () {56 vars in 1376 bytes} [Wed Mar 30 07:02:23 2022] GET /identity/v3/role_assignments?group.id=155688e886b64c548896712bbf16a02b&scope.project.id=e61749eb818249119b76cae445ffa9ff&role.id=075d8bdffff942c29baa73114127d3fa => generated 260 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:02:24.044834 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b873c310-d0ff-442b-8b54-6ea5bc8cc561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:24.045696 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b873c310-d0ff-442b-8b54-6ea5bc8cc561 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:24.045982 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b873c310-d0ff-442b-8b54-6ea5bc8cc561 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:24.046252 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b873c310-d0ff-442b-8b54-6ea5bc8cc561 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:24.065543 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b873c310-d0ff-442b-8b54-6ea5bc8cc561 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 07:02:24.073319 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-b873c310-d0ff-442b-8b54-6ea5bc8cc561 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 30 07:02:24.074953 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 195/383] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Mar 30 07:02:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 07:02:24.080870 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e311ede5-0ed1-41f5-906a-d7f540a344d9 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:24.255688 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e311ede5-0ed1-41f5-906a-d7f540a344d9 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:24.300115 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fddae0e-459e-4e01-8b55-9d8a9982752f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:24.300800 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fddae0e-459e-4e01-8b55-9d8a9982752f None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:24.301084 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fddae0e-459e-4e01-8b55-9d8a9982752f None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:24.301358 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fddae0e-459e-4e01-8b55-9d8a9982752f None admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:24.302111 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fddae0e-459e-4e01-8b55-9d8a9982752f None admin] RBAC: Adding query filter params (name=member) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:24.302417 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fddae0e-459e-4e01-8b55-9d8a9982752f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:24.303796 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fddae0e-459e-4e01-8b55-9d8a9982752f None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:24.314002 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 189/384] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Mar 30 07:02:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:24.320052 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b873c310-d0ff-442b-8b54-6ea5bc8cc561 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:24.428996 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b873c310-d0ff-442b-8b54-6ea5bc8cc561 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:24.472083 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a95c70-b062-403e-be87-3f02fe59844f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:24.473378 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a95c70-b062-403e-be87-3f02fe59844f None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:24.473854 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a95c70-b062-403e-be87-3f02fe59844f None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:24.474317 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a95c70-b062-403e-be87-3f02fe59844f None admin] PATH_INFO: `/v3/groups/155688e886b64c548896712bbf16a02b` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:24.475726 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a95c70-b062-403e-be87-3f02fe59844f None admin] RBAC: Authorizing `identity:get_group(group_id=155688e886b64c548896712bbf16a02b)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:24.477407 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a95c70-b062-403e-be87-3f02fe59844f None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:24.479574 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 196/385] 10.222.0.20 () {56 vars in 1180 bytes} [Wed Mar 30 07:02:24 2022] GET /identity/v3/groups/155688e886b64c548896712bbf16a02b => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:24.486633 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fddae0e-459e-4e01-8b55-9d8a9982752f None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:24.625870 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fddae0e-459e-4e01-8b55-9d8a9982752f None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:24.671086 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecde1bff-f0e2-4a1b-a9ed-6a0488961176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:24.671980 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecde1bff-f0e2-4a1b-a9ed-6a0488961176 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:24.672259 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecde1bff-f0e2-4a1b-a9ed-6a0488961176 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:24.672531 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecde1bff-f0e2-4a1b-a9ed-6a0488961176 None admin] PATH_INFO: `/v3/projects/03146c35f6b74534aaeb260041749b99` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:24.673707 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecde1bff-f0e2-4a1b-a9ed-6a0488961176 None admin] RBAC: Authorizing `identity:get_project(project_id=03146c35f6b74534aaeb260041749b99)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:24.675149 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecde1bff-f0e2-4a1b-a9ed-6a0488961176 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:24.677182 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 190/386] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Mar 30 07:02:24 2022] GET /identity/v3/projects/03146c35f6b74534aaeb260041749b99 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:24.683653 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a95c70-b062-403e-be87-3f02fe59844f None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:24.803328 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a95c70-b062-403e-be87-3f02fe59844f None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:24.839331 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d6a872-3b05-4573-bb00-422494e3b15b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:24.840264 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d6a872-3b05-4573-bb00-422494e3b15b None admin] REQUEST_METHOD: `PUT` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:24.840548 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d6a872-3b05-4573-bb00-422494e3b15b None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:24.840826 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d6a872-3b05-4573-bb00-422494e3b15b None admin] PATH_INFO: `/v3/projects/03146c35f6b74534aaeb260041749b99/groups/155688e886b64c548896712bbf16a02b/roles/5d79031a64754b57ba120367465e2252` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:24.843877 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d6a872-3b05-4573-bb00-422494e3b15b None admin] RBAC: Authorizing `identity:create_grant(project_id=03146c35f6b74534aaeb260041749b99, group_id=155688e886b64c548896712bbf16a02b, role_id=5d79031a64754b57ba120367465e2252)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:24.845332 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d6a872-3b05-4573-bb00-422494e3b15b None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:24.870167 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 197/387] 10.222.0.20 () {58 vars in 1442 bytes} [Wed Mar 30 07:02:24 2022] PUT /identity/v3/projects/03146c35f6b74534aaeb260041749b99/groups/155688e886b64c548896712bbf16a02b/roles/5d79031a64754b57ba120367465e2252 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:02:25.065746 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd537bad-01f3-442d-926c-a4a01d034e9f None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:25.066144 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd537bad-01f3-442d-926c-a4a01d034e9f None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:25.066333 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd537bad-01f3-442d-926c-a4a01d034e9f None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:25.068641 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 191/388] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:02:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:02:25.074507 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b56db75-72ae-46eb-b5c8-ede6a58d2032 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:25.074801 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b56db75-72ae-46eb-b5c8-ede6a58d2032 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:25.075068 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b56db75-72ae-46eb-b5c8-ede6a58d2032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:25.100917 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-2b56db75-72ae-46eb-b5c8-ede6a58d2032 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:02:25.102148 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-2b56db75-72ae-46eb-b5c8-ede6a58d2032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:02:25.191722 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 198/389] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:02:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 07:02:25.214175 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd537bad-01f3-442d-926c-a4a01d034e9f None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:25.325559 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd537bad-01f3-442d-926c-a4a01d034e9f None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:25.368240 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69ceb67-1fe3-4ff9-8c31-f4adabc88a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:25.369239 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69ceb67-1fe3-4ff9-8c31-f4adabc88a5e None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:25.369558 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69ceb67-1fe3-4ff9-8c31-f4adabc88a5e None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:25.369834 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69ceb67-1fe3-4ff9-8c31-f4adabc88a5e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:25.380386 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69ceb67-1fe3-4ff9-8c31-f4adabc88a5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 07:02:25.388099 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-a69ceb67-1fe3-4ff9-8c31-f4adabc88a5e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 30 07:02:25.389650 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 192/390] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Mar 30 07:02:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:02:25.395622 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b56db75-72ae-46eb-b5c8-ede6a58d2032 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:25.511398 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b56db75-72ae-46eb-b5c8-ede6a58d2032 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:25.554898 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fdc04c-6b23-47b4-bf81-33c74d94133f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:25.555584 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fdc04c-6b23-47b4-bf81-33c74d94133f None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:25.555891 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fdc04c-6b23-47b4-bf81-33c74d94133f None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:25.556166 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fdc04c-6b23-47b4-bf81-33c74d94133f None admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:25.556954 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fdc04c-6b23-47b4-bf81-33c74d94133f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:25.557255 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fdc04c-6b23-47b4-bf81-33c74d94133f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:25.558644 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fdc04c-6b23-47b4-bf81-33c74d94133f None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:25.571356 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 199/391] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Mar 30 07:02:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:25.577453 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69ceb67-1fe3-4ff9-8c31-f4adabc88a5e None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:25.620683 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf4ca19-bccf-4bfe-8666-4a48b48e7ec3 None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:25.620999 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf4ca19-bccf-4bfe-8666-4a48b48e7ec3 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:25.621223 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf4ca19-bccf-4bfe-8666-4a48b48e7ec3 None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:25.623360 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 200/392] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:02:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 30 07:02:25.628742 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9278bf69-9b7e-4a89-a588-d3f48ba006f2 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:25.629021 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9278bf69-9b7e-4a89-a588-d3f48ba006f2 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:25.629295 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9278bf69-9b7e-4a89-a588-d3f48ba006f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:25.655961 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-9278bf69-9b7e-4a89-a588-d3f48ba006f2 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:02:25.657140 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-9278bf69-9b7e-4a89-a588-d3f48ba006f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:02:25.692912 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69ceb67-1fe3-4ff9-8c31-f4adabc88a5e None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:25.730876 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 201/393] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:02:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 30 07:02:25.733565 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9ee5d4-b81d-44bb-8a72-c5ad89f75ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:25.734455 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9ee5d4-b81d-44bb-8a72-c5ad89f75ee4 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:25.734735 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9ee5d4-b81d-44bb-8a72-c5ad89f75ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:25.735010 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9ee5d4-b81d-44bb-8a72-c5ad89f75ee4 None admin] PATH_INFO: `/v3/groups/155688e886b64c548896712bbf16a02b` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:25.736588 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9ee5d4-b81d-44bb-8a72-c5ad89f75ee4 None admin] RBAC: Authorizing `identity:get_group(group_id=155688e886b64c548896712bbf16a02b)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:25.738051 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9ee5d4-b81d-44bb-8a72-c5ad89f75ee4 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:25.739692 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 193/394] 10.222.0.20 () {56 vars in 1180 bytes} [Wed Mar 30 07:02:25 2022] GET /identity/v3/groups/155688e886b64c548896712bbf16a02b => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:25.745958 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9278bf69-9b7e-4a89-a588-d3f48ba006f2 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:25.791536 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9ee5d4-b81d-44bb-8a72-c5ad89f75ee4 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:25.867350 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9278bf69-9b7e-4a89-a588-d3f48ba006f2 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:25.904276 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b216a3f-ff56-4db5-86f3-c8243c89fbda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:25.905169 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b216a3f-ff56-4db5-86f3-c8243c89fbda None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:25.905443 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b216a3f-ff56-4db5-86f3-c8243c89fbda None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:25.905708 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b216a3f-ff56-4db5-86f3-c8243c89fbda None admin] PATH_INFO: `/v3/projects/03146c35f6b74534aaeb260041749b99` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:25.906972 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b216a3f-ff56-4db5-86f3-c8243c89fbda None admin] RBAC: Authorizing `identity:get_project(project_id=03146c35f6b74534aaeb260041749b99)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:25.908530 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b216a3f-ff56-4db5-86f3-c8243c89fbda None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:25.910673 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 202/395] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Mar 30 07:02:25 2022] GET /identity/v3/projects/03146c35f6b74534aaeb260041749b99 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:25.920858 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b216a3f-ff56-4db5-86f3-c8243c89fbda None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:25.931399 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9ee5d4-b81d-44bb-8a72-c5ad89f75ee4 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:25.977635 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10a27d4-c9df-42f8-b099-3b91357ff8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:25.978471 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10a27d4-c9df-42f8-b099-3b91357ff8ce None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:25.978841 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10a27d4-c9df-42f8-b099-3b91357ff8ce None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:25.979327 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10a27d4-c9df-42f8-b099-3b91357ff8ce None admin] PATH_INFO: `/v3/roles/member` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:26.001469 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10a27d4-c9df-42f8-b099-3b91357ff8ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 07:02:26.012889 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-a10a27d4-c9df-42f8-b099-3b91357ff8ce None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 30 07:02:26.014181 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 194/396] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Mar 30 07:02:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 07:02:26.020420 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10a27d4-c9df-42f8-b099-3b91357ff8ce None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:26.039361 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b216a3f-ff56-4db5-86f3-c8243c89fbda None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:26.073697 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78430139-d351-449a-ae4b-40c58d651272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:26.074642 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78430139-d351-449a-ae4b-40c58d651272 None admin] REQUEST_METHOD: `PUT` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:26.074915 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78430139-d351-449a-ae4b-40c58d651272 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:26.075177 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78430139-d351-449a-ae4b-40c58d651272 None admin] PATH_INFO: `/v3/projects/03146c35f6b74534aaeb260041749b99/groups/155688e886b64c548896712bbf16a02b/roles/075d8bdffff942c29baa73114127d3fa` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:26.077405 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78430139-d351-449a-ae4b-40c58d651272 None admin] RBAC: Authorizing `identity:create_grant(project_id=03146c35f6b74534aaeb260041749b99, group_id=155688e886b64c548896712bbf16a02b, role_id=075d8bdffff942c29baa73114127d3fa)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:26.078845 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78430139-d351-449a-ae4b-40c58d651272 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:26.100967 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 203/397] 10.222.0.20 () {58 vars in 1442 bytes} [Wed Mar 30 07:02:25 2022] PUT /identity/v3/projects/03146c35f6b74534aaeb260041749b99/groups/155688e886b64c548896712bbf16a02b/roles/075d8bdffff942c29baa73114127d3fa => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:02:26.143141 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10a27d4-c9df-42f8-b099-3b91357ff8ce None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:26.183607 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adebab31-416b-4155-99a9-fb40bcf6ea72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:26.184334 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adebab31-416b-4155-99a9-fb40bcf6ea72 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:26.184749 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adebab31-416b-4155-99a9-fb40bcf6ea72 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:26.185059 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adebab31-416b-4155-99a9-fb40bcf6ea72 None admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:26.185837 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adebab31-416b-4155-99a9-fb40bcf6ea72 None admin] RBAC: Adding query filter params (name=member) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:26.186147 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adebab31-416b-4155-99a9-fb40bcf6ea72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:26.187551 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adebab31-416b-4155-99a9-fb40bcf6ea72 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:26.197405 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 195/398] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Mar 30 07:02:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:02:26.203724 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78430139-d351-449a-ae4b-40c58d651272 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:26.310437 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c34e6d-7ef9-4949-a87a-24e623607af3 None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:26.310777 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c34e6d-7ef9-4949-a87a-24e623607af3 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:26.310996 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c34e6d-7ef9-4949-a87a-24e623607af3 None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:26.313109 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 196/399] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:02:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:02:26.318344 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cc8c06-82c7-41b2-9f19-2a08a837d703 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:26.318635 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cc8c06-82c7-41b2-9f19-2a08a837d703 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:26.318919 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cc8c06-82c7-41b2-9f19-2a08a837d703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:26.324110 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78430139-d351-449a-ae4b-40c58d651272 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:26.346508 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-b1cc8c06-82c7-41b2-9f19-2a08a837d703 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:02:26.347705 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-b1cc8c06-82c7-41b2-9f19-2a08a837d703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:02:26.391516 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95660c22-81c0-47ee-a121-c649696c1fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:26.392430 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95660c22-81c0-47ee-a121-c649696c1fb2 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:26.392705 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95660c22-81c0-47ee-a121-c649696c1fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:26.392972 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95660c22-81c0-47ee-a121-c649696c1fb2 None admin] PATH_INFO: `/v3/groups/155688e886b64c548896712bbf16a02b` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:26.395359 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95660c22-81c0-47ee-a121-c649696c1fb2 None admin] RBAC: Authorizing `identity:get_group(group_id=155688e886b64c548896712bbf16a02b)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:26.396780 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95660c22-81c0-47ee-a121-c649696c1fb2 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:26.398440 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 204/400] 10.222.0.20 () {56 vars in 1180 bytes} [Wed Mar 30 07:02:26 2022] GET /identity/v3/groups/155688e886b64c548896712bbf16a02b => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:26.404597 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95660c22-81c0-47ee-a121-c649696c1fb2 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:26.459916 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 197/401] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:02:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 30 07:02:26.495923 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cc8c06-82c7-41b2-9f19-2a08a837d703 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:26.572281 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95660c22-81c0-47ee-a121-c649696c1fb2 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:26.635346 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c379e4a0-253b-43a7-be42-ae862a48f9a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:26.636249 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c379e4a0-253b-43a7-be42-ae862a48f9a1 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:26.636524 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c379e4a0-253b-43a7-be42-ae862a48f9a1 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:26.636788 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c379e4a0-253b-43a7-be42-ae862a48f9a1 None admin] PATH_INFO: `/v3/projects/e61749eb818249119b76cae445ffa9ff` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:26.639019 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c379e4a0-253b-43a7-be42-ae862a48f9a1 None admin] RBAC: Authorizing `identity:get_project(project_id=e61749eb818249119b76cae445ffa9ff)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:26.640489 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c379e4a0-253b-43a7-be42-ae862a48f9a1 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:26.642200 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 205/402] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Mar 30 07:02:26 2022] GET /identity/v3/projects/e61749eb818249119b76cae445ffa9ff => generated 302 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:02:26.648348 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c379e4a0-253b-43a7-be42-ae862a48f9a1 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:26.679689 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cc8c06-82c7-41b2-9f19-2a08a837d703 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:26.717690 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58a70ab-006d-4fea-aecb-d8df4e548397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:26.718539 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58a70ab-006d-4fea-aecb-d8df4e548397 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:26.718818 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58a70ab-006d-4fea-aecb-d8df4e548397 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:26.719091 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58a70ab-006d-4fea-aecb-d8df4e548397 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:26.732462 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58a70ab-006d-4fea-aecb-d8df4e548397 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 07:02:26.739983 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-f58a70ab-006d-4fea-aecb-d8df4e548397 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 30 07:02:26.742404 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 198/403] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Mar 30 07:02:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 07:02:26.750953 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58a70ab-006d-4fea-aecb-d8df4e548397 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:26.859998 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58a70ab-006d-4fea-aecb-d8df4e548397 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:26.894212 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c379e4a0-253b-43a7-be42-ae862a48f9a1 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:26.895605 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0351a07a-7cfe-4c03-a444-5bf58c47cdd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:26.896464 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0351a07a-7cfe-4c03-a444-5bf58c47cdd9 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:26.897541 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0351a07a-7cfe-4c03-a444-5bf58c47cdd9 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:26.897813 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0351a07a-7cfe-4c03-a444-5bf58c47cdd9 None admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:26.898618 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0351a07a-7cfe-4c03-a444-5bf58c47cdd9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:26.898868 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0351a07a-7cfe-4c03-a444-5bf58c47cdd9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:26.900374 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0351a07a-7cfe-4c03-a444-5bf58c47cdd9 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:26.910237 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 199/404] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Mar 30 07:02:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:26.918979 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0351a07a-7cfe-4c03-a444-5bf58c47cdd9 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:26.949176 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed52e0ff-8fbe-4327-a384-7be43224cbd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:26.950069 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed52e0ff-8fbe-4327-a384-7be43224cbd5 None admin] REQUEST_METHOD: `PUT` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:26.950345 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed52e0ff-8fbe-4327-a384-7be43224cbd5 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:26.950610 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed52e0ff-8fbe-4327-a384-7be43224cbd5 None admin] PATH_INFO: `/v3/projects/e61749eb818249119b76cae445ffa9ff/groups/155688e886b64c548896712bbf16a02b/roles/5d79031a64754b57ba120367465e2252` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:26.952577 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed52e0ff-8fbe-4327-a384-7be43224cbd5 None admin] RBAC: Authorizing `identity:create_grant(project_id=e61749eb818249119b76cae445ffa9ff, group_id=155688e886b64c548896712bbf16a02b, role_id=5d79031a64754b57ba120367465e2252)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:26.954005 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed52e0ff-8fbe-4327-a384-7be43224cbd5 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:26.978506 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 206/405] 10.222.0.20 () {58 vars in 1442 bytes} [Wed Mar 30 07:02:26 2022] PUT /identity/v3/projects/e61749eb818249119b76cae445ffa9ff/groups/155688e886b64c548896712bbf16a02b/roles/5d79031a64754b57ba120367465e2252 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:02:27.100074 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0351a07a-7cfe-4c03-a444-5bf58c47cdd9 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:27.153515 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614d5ae2-7f25-4425-ae33-82c33592d199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:27.154748 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614d5ae2-7f25-4425-ae33-82c33592d199 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:27.155228 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614d5ae2-7f25-4425-ae33-82c33592d199 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:27.155712 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614d5ae2-7f25-4425-ae33-82c33592d199 None admin] PATH_INFO: `/v3/groups/9005d480268848caa4e54fca9a1a4469` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:27.157207 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614d5ae2-7f25-4425-ae33-82c33592d199 None admin] RBAC: Authorizing `identity:get_group(group_id=9005d480268848caa4e54fca9a1a4469)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:27.158952 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614d5ae2-7f25-4425-ae33-82c33592d199 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:27.160929 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 200/406] 10.222.0.20 () {56 vars in 1180 bytes} [Wed Mar 30 07:02:26 2022] GET /identity/v3/groups/9005d480268848caa4e54fca9a1a4469 => generated 229 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:27.167745 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed52e0ff-8fbe-4327-a384-7be43224cbd5 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:27.281455 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed52e0ff-8fbe-4327-a384-7be43224cbd5 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:27.317616 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b0a120-9b43-4dde-867e-b7937b9696a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:27.318485 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b0a120-9b43-4dde-867e-b7937b9696a0 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:27.318761 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b0a120-9b43-4dde-867e-b7937b9696a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:27.319026 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b0a120-9b43-4dde-867e-b7937b9696a0 None admin] PATH_INFO: `/v3/projects/e0c9fc0b60d1476cbb305fe8a9512169` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:27.320226 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b0a120-9b43-4dde-867e-b7937b9696a0 None admin] RBAC: Authorizing `identity:get_project(project_id=e0c9fc0b60d1476cbb305fe8a9512169)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:27.321655 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b0a120-9b43-4dde-867e-b7937b9696a0 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:27.327923 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 207/407] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Mar 30 07:02:27 2022] GET /identity/v3/projects/e0c9fc0b60d1476cbb305fe8a9512169 => generated 344 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:27.329497 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614d5ae2-7f25-4425-ae33-82c33592d199 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:27.462771 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614d5ae2-7f25-4425-ae33-82c33592d199 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:27.503252 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66aabc4-3fc0-49bd-9b52-098a1cebfaa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:27.504565 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66aabc4-3fc0-49bd-9b52-098a1cebfaa3 None admin] REQUEST_METHOD: `PUT` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:27.505049 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66aabc4-3fc0-49bd-9b52-098a1cebfaa3 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:27.505518 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66aabc4-3fc0-49bd-9b52-098a1cebfaa3 None admin] PATH_INFO: `/v3/projects/e0c9fc0b60d1476cbb305fe8a9512169/groups/9005d480268848caa4e54fca9a1a4469/roles/1c39b9ab8cfd4c0ea71845831920a845` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:27.513212 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66aabc4-3fc0-49bd-9b52-098a1cebfaa3 None admin] RBAC: Authorizing `identity:create_grant(project_id=e0c9fc0b60d1476cbb305fe8a9512169, group_id=9005d480268848caa4e54fca9a1a4469, role_id=1c39b9ab8cfd4c0ea71845831920a845)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:27.514976 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66aabc4-3fc0-49bd-9b52-098a1cebfaa3 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:27.543903 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 201/408] 10.222.0.20 () {58 vars in 1442 bytes} [Wed Mar 30 07:02:27 2022] PUT /identity/v3/projects/e0c9fc0b60d1476cbb305fe8a9512169/groups/9005d480268848caa4e54fca9a1a4469/roles/1c39b9ab8cfd4c0ea71845831920a845 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:02:27.581435 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aa54fe-8714-4852-a3a2-477ee343297a None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:27.581760 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aa54fe-8714-4852-a3a2-477ee343297a None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:27.581979 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aa54fe-8714-4852-a3a2-477ee343297a None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:27.584450 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 208/409] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:02:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:02:27.597496 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd0cc1-bca2-44ca-a26e-44315a3b634f None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:27.598155 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd0cc1-bca2-44ca-a26e-44315a3b634f None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:27.598662 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd0cc1-bca2-44ca-a26e-44315a3b634f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:27.622860 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-77dd0cc1-bca2-44ca-a26e-44315a3b634f None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:02:27.624461 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-77dd0cc1-bca2-44ca-a26e-44315a3b634f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:02:27.702570 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 202/410] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:02:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 07:02:27.737937 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aa54fe-8714-4852-a3a2-477ee343297a None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:27.862076 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aa54fe-8714-4852-a3a2-477ee343297a None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:27.898509 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5416772d-4acc-4710-8b11-b7defb95a7b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:27.899322 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5416772d-4acc-4710-8b11-b7defb95a7b7 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:27.899598 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5416772d-4acc-4710-8b11-b7defb95a7b7 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:27.899922 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5416772d-4acc-4710-8b11-b7defb95a7b7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:27.910139 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5416772d-4acc-4710-8b11-b7defb95a7b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 07:02:27.917937 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-5416772d-4acc-4710-8b11-b7defb95a7b7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 30 07:02:27.919501 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 209/411] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Mar 30 07:02:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:02:27.925101 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dd0cc1-bca2-44ca-a26e-44315a3b634f None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:28.067393 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dd0cc1-bca2-44ca-a26e-44315a3b634f None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:28.115472 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0882484-8904-4782-bab0-f9f0deeeda68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:28.116173 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0882484-8904-4782-bab0-f9f0deeeda68 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:28.116454 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0882484-8904-4782-bab0-f9f0deeeda68 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:28.116729 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0882484-8904-4782-bab0-f9f0deeeda68 None admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:28.117487 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0882484-8904-4782-bab0-f9f0deeeda68 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:28.117789 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0882484-8904-4782-bab0-f9f0deeeda68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:28.119175 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0882484-8904-4782-bab0-f9f0deeeda68 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:28.126363 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b210b4-6cd3-46af-bdfd-2e647bbc80d9 None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:28.126363 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b210b4-6cd3-46af-bdfd-2e647bbc80d9 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:28.126363 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b210b4-6cd3-46af-bdfd-2e647bbc80d9 None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:28.127009 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 210/412] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:02:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:02:28.134207 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 203/413] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Mar 30 07:02:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:28.140260 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b210b4-6cd3-46af-bdfd-2e647bbc80d9 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:28.143059 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c0d050-c208-47f7-a366-7d755e051183 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:28.143344 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c0d050-c208-47f7-a366-7d755e051183 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:28.143715 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c0d050-c208-47f7-a366-7d755e051183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:28.170149 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-b1c0d050-c208-47f7-a366-7d755e051183 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:02:28.171675 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-b1c0d050-c208-47f7-a366-7d755e051183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:02:28.259412 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 204/414] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:02:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 30 07:02:28.283584 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c0d050-c208-47f7-a366-7d755e051183 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:28.390820 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c0d050-c208-47f7-a366-7d755e051183 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:28.401637 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b210b4-6cd3-46af-bdfd-2e647bbc80d9 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:28.427089 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edd1fea-18ab-4f0b-bf3c-cc7a95df3278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:28.427923 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd1fea-18ab-4f0b-bf3c-cc7a95df3278 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:28.428199 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd1fea-18ab-4f0b-bf3c-cc7a95df3278 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:28.428464 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd1fea-18ab-4f0b-bf3c-cc7a95df3278 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:28.439797 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edd1fea-18ab-4f0b-bf3c-cc7a95df3278 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 07:02:28.448100 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-4edd1fea-18ab-4f0b-bf3c-cc7a95df3278 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 30 07:02:28.449647 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 205/415] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Mar 30 07:02:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 07:02:28.455438 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edd1fea-18ab-4f0b-bf3c-cc7a95df3278 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:28.482332 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9654947-47f7-423e-a195-102a49fc1af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:28.483222 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9654947-47f7-423e-a195-102a49fc1af1 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:28.483512 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9654947-47f7-423e-a195-102a49fc1af1 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:28.483777 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9654947-47f7-423e-a195-102a49fc1af1 None admin] PATH_INFO: `/v3/groups/155688e886b64c548896712bbf16a02b` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:28.488530 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9654947-47f7-423e-a195-102a49fc1af1 None admin] RBAC: Authorizing `identity:get_group(group_id=155688e886b64c548896712bbf16a02b)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:28.490006 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9654947-47f7-423e-a195-102a49fc1af1 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:28.492001 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 211/416] 10.222.0.20 () {56 vars in 1180 bytes} [Wed Mar 30 07:02:28 2022] GET /identity/v3/groups/155688e886b64c548896712bbf16a02b => generated 226 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:28.497765 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9654947-47f7-423e-a195-102a49fc1af1 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:28.564093 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edd1fea-18ab-4f0b-bf3c-cc7a95df3278 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:28.607386 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aa21c3-4bb5-4aff-be2e-97ec8fdf2219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:28.608428 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aa21c3-4bb5-4aff-be2e-97ec8fdf2219 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:28.611835 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aa21c3-4bb5-4aff-be2e-97ec8fdf2219 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:28.611835 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aa21c3-4bb5-4aff-be2e-97ec8fdf2219 None admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:28.611835 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aa21c3-4bb5-4aff-be2e-97ec8fdf2219 None admin] RBAC: Adding query filter params (name=member) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:28.611835 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aa21c3-4bb5-4aff-be2e-97ec8fdf2219 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:28.612142 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aa21c3-4bb5-4aff-be2e-97ec8fdf2219 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:28.621934 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 206/417] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Mar 30 07:02:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:02:28.630191 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aa21c3-4bb5-4aff-be2e-97ec8fdf2219 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:28.708835 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9654947-47f7-423e-a195-102a49fc1af1 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:28.753714 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca93cf33-fcc9-404b-b912-910c11983d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:28.755000 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca93cf33-fcc9-404b-b912-910c11983d0e None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:28.755470 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca93cf33-fcc9-404b-b912-910c11983d0e None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:28.755974 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca93cf33-fcc9-404b-b912-910c11983d0e None admin] PATH_INFO: `/v3/projects/e61749eb818249119b76cae445ffa9ff` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:28.757347 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca93cf33-fcc9-404b-b912-910c11983d0e None admin] RBAC: Authorizing `identity:get_project(project_id=e61749eb818249119b76cae445ffa9ff)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:28.759023 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca93cf33-fcc9-404b-b912-910c11983d0e None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:28.765731 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 212/418] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Mar 30 07:02:28 2022] GET /identity/v3/projects/e61749eb818249119b76cae445ffa9ff => generated 302 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:02:28.767155 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca93cf33-fcc9-404b-b912-910c11983d0e None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:28.822287 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aa21c3-4bb5-4aff-be2e-97ec8fdf2219 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:28.880424 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca93cf33-fcc9-404b-b912-910c11983d0e None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:28.904508 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0155f5c-1d79-4323-9c02-ff446729d070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:28.905510 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0155f5c-1d79-4323-9c02-ff446729d070 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:28.906005 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0155f5c-1d79-4323-9c02-ff446729d070 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:28.906464 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0155f5c-1d79-4323-9c02-ff446729d070 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:28.934376 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cf3a4b-949d-4c54-a19f-8bae887e28b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:28.936364 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf3a4b-949d-4c54-a19f-8bae887e28b9 None admin] REQUEST_METHOD: `PUT` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:28.936657 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf3a4b-949d-4c54-a19f-8bae887e28b9 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:28.937248 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf3a4b-949d-4c54-a19f-8bae887e28b9 None admin] PATH_INFO: `/v3/projects/e61749eb818249119b76cae445ffa9ff/groups/155688e886b64c548896712bbf16a02b/roles/075d8bdffff942c29baa73114127d3fa` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:28.939245 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cf3a4b-949d-4c54-a19f-8bae887e28b9 None admin] RBAC: Authorizing `identity:create_grant(project_id=e61749eb818249119b76cae445ffa9ff, group_id=155688e886b64c548896712bbf16a02b, role_id=075d8bdffff942c29baa73114127d3fa)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:28.940743 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cf3a4b-949d-4c54-a19f-8bae887e28b9 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:28.961584 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 213/419] 10.222.0.20 () {58 vars in 1442 bytes} [Wed Mar 30 07:02:28 2022] PUT /identity/v3/projects/e61749eb818249119b76cae445ffa9ff/groups/155688e886b64c548896712bbf16a02b/roles/075d8bdffff942c29baa73114127d3fa => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:02:28.961584 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69501cf1-f324-464c-9f27-c121bd445698 None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:28.961584 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69501cf1-f324-464c-9f27-c121bd445698 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:28.961584 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69501cf1-f324-464c-9f27-c121bd445698 None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:28.961584 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 214/420] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:02:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:02:28.968323 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca66427-d630-4858-8a2d-49886eb1cc75 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:28.968607 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca66427-d630-4858-8a2d-49886eb1cc75 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:28.969007 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca66427-d630-4858-8a2d-49886eb1cc75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:28.990949 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-1ca66427-d630-4858-8a2d-49886eb1cc75 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:02:28.992487 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-1ca66427-d630-4858-8a2d-49886eb1cc75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:02:29.028850 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0155f5c-1d79-4323-9c02-ff446729d070 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:29.030698 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0155f5c-1d79-4323-9c02-ff446729d070 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:29.131759 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 215/421] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:02:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 07:02:29.164832 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 207/422] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Mar 30 07:02:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 535 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 30 07:02:29.171238 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca66427-d630-4858-8a2d-49886eb1cc75 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:29.178856 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0155f5c-1d79-4323-9c02-ff446729d070 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:29.301604 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca66427-d630-4858-8a2d-49886eb1cc75 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:29.318657 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0155f5c-1d79-4323-9c02-ff446729d070 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:29.356014 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f738d26-b64c-45b2-bfda-757688881de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:29.356932 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f738d26-b64c-45b2-bfda-757688881de7 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:29.357206 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f738d26-b64c-45b2-bfda-757688881de7 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:29.357473 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f738d26-b64c-45b2-bfda-757688881de7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:29.361000 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de46001c-8c4b-4398-be0a-22b1ab686c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:29.362249 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de46001c-8c4b-4398-be0a-22b1ab686c79 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:29.362529 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de46001c-8c4b-4398-be0a-22b1ab686c79 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:29.362801 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de46001c-8c4b-4398-be0a-22b1ab686c79 None admin] PATH_INFO: `/v3/projects/03146c35f6b74534aaeb260041749b99` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:29.368321 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f738d26-b64c-45b2-bfda-757688881de7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 07:02:29.368577 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de46001c-8c4b-4398-be0a-22b1ab686c79 None admin] RBAC: Authorizing `identity:get_project(project_id=03146c35f6b74534aaeb260041749b99)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:29.370222 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de46001c-8c4b-4398-be0a-22b1ab686c79 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:29.372306 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 216/423] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Mar 30 07:02:29 2022] GET /identity/v3/projects/03146c35f6b74534aaeb260041749b99 => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:29.375644 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-1f738d26-b64c-45b2-bfda-757688881de7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 30 07:02:29.377169 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 208/424] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Mar 30 07:02:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:02:29.378020 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de46001c-8c4b-4398-be0a-22b1ab686c79 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:29.384679 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f738d26-b64c-45b2-bfda-757688881de7 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:29.541320 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de46001c-8c4b-4398-be0a-22b1ab686c79 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:29.567966 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f738d26-b64c-45b2-bfda-757688881de7 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:29.581907 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d90c1a-bc2e-4215-86f4-165042246333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:29.583061 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d90c1a-bc2e-4215-86f4-165042246333 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:29.583441 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d90c1a-bc2e-4215-86f4-165042246333 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:29.583828 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d90c1a-bc2e-4215-86f4-165042246333 None admin] PATH_INFO: `/v3/groups/155688e886b64c548896712bbf16a02b` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:29.585296 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d90c1a-bc2e-4215-86f4-165042246333 None admin] RBAC: Authorizing `identity:get_group(group_id=155688e886b64c548896712bbf16a02b)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:29.587522 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d90c1a-bc2e-4215-86f4-165042246333 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:29.590342 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 217/425] 10.222.0.20 () {56 vars in 1180 bytes} [Wed Mar 30 07:02:29 2022] GET /identity/v3/groups/155688e886b64c548896712bbf16a02b => generated 226 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:29.596484 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d90c1a-bc2e-4215-86f4-165042246333 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:29.651718 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc601d71-1b7c-48e3-a215-e7f4244deefc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:29.652512 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc601d71-1b7c-48e3-a215-e7f4244deefc None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:29.652788 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc601d71-1b7c-48e3-a215-e7f4244deefc None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:29.653054 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc601d71-1b7c-48e3-a215-e7f4244deefc None admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:29.653804 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc601d71-1b7c-48e3-a215-e7f4244deefc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:29.654100 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc601d71-1b7c-48e3-a215-e7f4244deefc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:29.655473 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc601d71-1b7c-48e3-a215-e7f4244deefc None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:29.668909 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 209/426] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Mar 30 07:02:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:29.676760 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc601d71-1b7c-48e3-a215-e7f4244deefc None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:29.724835 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d90c1a-bc2e-4215-86f4-165042246333 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:29.761592 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466e06fb-a3f6-48a0-863e-3ba6a6d10294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:29.762254 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e06fb-a3f6-48a0-863e-3ba6a6d10294 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:29.762537 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e06fb-a3f6-48a0-863e-3ba6a6d10294 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:29.762812 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e06fb-a3f6-48a0-863e-3ba6a6d10294 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:29.763647 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466e06fb-a3f6-48a0-863e-3ba6a6d10294 None admin] RBAC: Adding query filter params (group.id=155688e886b64c548896712bbf16a02b, role.id=5d79031a64754b57ba120367465e2252, scope.project.id=03146c35f6b74534aaeb260041749b99) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:29.763993 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466e06fb-a3f6-48a0-863e-3ba6a6d10294 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:29.765818 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466e06fb-a3f6-48a0-863e-3ba6a6d10294 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:29.772693 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 218/427] 10.222.0.20 () {56 vars in 1376 bytes} [Wed Mar 30 07:02:29 2022] GET /identity/v3/role_assignments?group.id=155688e886b64c548896712bbf16a02b&scope.project.id=03146c35f6b74534aaeb260041749b99&role.id=5d79031a64754b57ba120367465e2252 => generated 611 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:29.865552 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc601d71-1b7c-48e3-a215-e7f4244deefc None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:29.907563 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc1cb64-66d9-4cd2-88c6-4eba0c797389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:29.908254 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc1cb64-66d9-4cd2-88c6-4eba0c797389 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:29.908532 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc1cb64-66d9-4cd2-88c6-4eba0c797389 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:29.908808 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc1cb64-66d9-4cd2-88c6-4eba0c797389 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:29.981564 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc1cb64-66d9-4cd2-88c6-4eba0c797389 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:29.983085 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc1cb64-66d9-4cd2-88c6-4eba0c797389 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:30.028642 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a2dc25-99f0-4a94-b8bc-36e6b5848940 None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:30.028642 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a2dc25-99f0-4a94-b8bc-36e6b5848940 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:30.028642 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a2dc25-99f0-4a94-b8bc-36e6b5848940 None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:30.029765 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 219/428] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:02:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 30 07:02:30.035781 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7396b13e-e140-472c-910d-ec694606a8fa None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:30.036442 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7396b13e-e140-472c-910d-ec694606a8fa None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:30.036909 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7396b13e-e140-472c-910d-ec694606a8fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:30.074568 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-7396b13e-e140-472c-910d-ec694606a8fa None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:02:30.084493 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-7396b13e-e140-472c-910d-ec694606a8fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:02:30.100438 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 210/429] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Mar 30 07:02:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 30 07:02:30.101054 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc1cb64-66d9-4cd2-88c6-4eba0c797389 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:30.163902 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 220/430] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:02:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 30 07:02:30.188342 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7396b13e-e140-472c-910d-ec694606a8fa None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:30.202574 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc1cb64-66d9-4cd2-88c6-4eba0c797389 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:30.237286 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa51341a-908c-4896-b4fd-0877f830ac23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:30.238163 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa51341a-908c-4896-b4fd-0877f830ac23 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:30.238441 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa51341a-908c-4896-b4fd-0877f830ac23 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:30.238713 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa51341a-908c-4896-b4fd-0877f830ac23 None admin] PATH_INFO: `/v3/projects/03146c35f6b74534aaeb260041749b99` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:30.240003 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa51341a-908c-4896-b4fd-0877f830ac23 None admin] RBAC: Authorizing `identity:get_project(project_id=03146c35f6b74534aaeb260041749b99)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:30.241456 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa51341a-908c-4896-b4fd-0877f830ac23 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:30.243617 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 211/431] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Mar 30 07:02:30 2022] GET /identity/v3/projects/03146c35f6b74534aaeb260041749b99 => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:30.249179 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa51341a-908c-4896-b4fd-0877f830ac23 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:30.302071 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7396b13e-e140-472c-910d-ec694606a8fa None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:30.335563 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4e00e0-cd65-4f1a-9a45-69a5888a20cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:30.336743 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4e00e0-cd65-4f1a-9a45-69a5888a20cb None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:30.337232 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4e00e0-cd65-4f1a-9a45-69a5888a20cb None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:30.337709 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4e00e0-cd65-4f1a-9a45-69a5888a20cb None admin] PATH_INFO: `/v3/roles/member` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:30.348366 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4e00e0-cd65-4f1a-9a45-69a5888a20cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 07:02:30.350337 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa51341a-908c-4896-b4fd-0877f830ac23 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:30.355873 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-af4e00e0-cd65-4f1a-9a45-69a5888a20cb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 30 07:02:30.357616 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 221/432] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Mar 30 07:02:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:02:30.363838 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4e00e0-cd65-4f1a-9a45-69a5888a20cb None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:30.386683 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be64322-5858-4089-a2d3-e6c299f35282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:30.387604 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be64322-5858-4089-a2d3-e6c299f35282 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:30.388055 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be64322-5858-4089-a2d3-e6c299f35282 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:30.388342 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be64322-5858-4089-a2d3-e6c299f35282 None admin] PATH_INFO: `/v3/groups/155688e886b64c548896712bbf16a02b` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:30.389577 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be64322-5858-4089-a2d3-e6c299f35282 None admin] RBAC: Authorizing `identity:get_group(group_id=155688e886b64c548896712bbf16a02b)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:30.391025 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be64322-5858-4089-a2d3-e6c299f35282 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:30.394189 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 212/433] 10.222.0.20 () {56 vars in 1180 bytes} [Wed Mar 30 07:02:30 2022] GET /identity/v3/groups/155688e886b64c548896712bbf16a02b => generated 226 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:02:30.400117 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be64322-5858-4089-a2d3-e6c299f35282 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:30.478649 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4e00e0-cd65-4f1a-9a45-69a5888a20cb None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:30.523888 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be64322-5858-4089-a2d3-e6c299f35282 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:30.524883 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be88d947-37be-47e2-b0f7-1628cb603906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:30.525615 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be88d947-37be-47e2-b0f7-1628cb603906 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:30.526364 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be88d947-37be-47e2-b0f7-1628cb603906 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:30.526364 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be88d947-37be-47e2-b0f7-1628cb603906 None admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:30.527399 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be88d947-37be-47e2-b0f7-1628cb603906 None admin] RBAC: Adding query filter params (name=member) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:30.527399 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be88d947-37be-47e2-b0f7-1628cb603906 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:30.528782 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be88d947-37be-47e2-b0f7-1628cb603906 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:30.541515 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 222/434] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Mar 30 07:02:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:30.541515 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4e386b-0943-4239-a6e9-ffa15236eab6 None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:30.541515 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4e386b-0943-4239-a6e9-ffa15236eab6 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:30.541515 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4e386b-0943-4239-a6e9-ffa15236eab6 None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:30.541515 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 223/435] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:02:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:02:30.546148 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4e386b-0943-4239-a6e9-ffa15236eab6 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:30.570275 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26ae93a-cda9-4b9f-89c9-47c9b32db443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:30.570947 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ae93a-cda9-4b9f-89c9-47c9b32db443 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:30.571470 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ae93a-cda9-4b9f-89c9-47c9b32db443 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:30.571470 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ae93a-cda9-4b9f-89c9-47c9b32db443 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:30.572663 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26ae93a-cda9-4b9f-89c9-47c9b32db443 None admin] RBAC: Adding query filter params (group.id=155688e886b64c548896712bbf16a02b, role.id=075d8bdffff942c29baa73114127d3fa, scope.project.id=03146c35f6b74534aaeb260041749b99) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:30.572981 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26ae93a-cda9-4b9f-89c9-47c9b32db443 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:30.574429 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26ae93a-cda9-4b9f-89c9-47c9b32db443 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:30.583407 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 213/436] 10.222.0.20 () {56 vars in 1376 bytes} [Wed Mar 30 07:02:30 2022] GET /identity/v3/role_assignments?group.id=155688e886b64c548896712bbf16a02b&scope.project.id=03146c35f6b74534aaeb260041749b99&role.id=075d8bdffff942c29baa73114127d3fa => generated 611 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:02:30.584692 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9fe0bf-da1f-49da-9f2a-4d8afca90eef None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:30.585023 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9fe0bf-da1f-49da-9f2a-4d8afca90eef None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:30.585301 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9fe0bf-da1f-49da-9f2a-4d8afca90eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:30.617993 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-df9fe0bf-da1f-49da-9f2a-4d8afca90eef None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:02:30.620635 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-df9fe0bf-da1f-49da-9f2a-4d8afca90eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:02:30.680411 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4e386b-0943-4239-a6e9-ffa15236eab6 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:30.711260 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 214/437] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:02:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 07:02:30.729352 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd41962-2cdf-40f5-b73b-892774255b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:30.730117 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd41962-2cdf-40f5-b73b-892774255b47 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:30.730397 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd41962-2cdf-40f5-b73b-892774255b47 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:30.730669 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd41962-2cdf-40f5-b73b-892774255b47 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:30.737408 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9fe0bf-da1f-49da-9f2a-4d8afca90eef None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:30.817400 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd41962-2cdf-40f5-b73b-892774255b47 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:30.819218 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd41962-2cdf-40f5-b73b-892774255b47 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:30.864694 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9fe0bf-da1f-49da-9f2a-4d8afca90eef None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:30.918471 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36083abd-9853-49aa-a244-5ee8151c93ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:30.919278 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36083abd-9853-49aa-a244-5ee8151c93ae None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:30.919559 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36083abd-9853-49aa-a244-5ee8151c93ae None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:30.919856 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36083abd-9853-49aa-a244-5ee8151c93ae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:30.933464 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36083abd-9853-49aa-a244-5ee8151c93ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 07:02:30.942164 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-36083abd-9853-49aa-a244-5ee8151c93ae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 30 07:02:30.942907 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 224/438] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Mar 30 07:02:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 30 07:02:30.943379 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 215/439] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Mar 30 07:02:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 07:02:30.949037 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd41962-2cdf-40f5-b73b-892774255b47 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:30.949295 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36083abd-9853-49aa-a244-5ee8151c93ae None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:31.072335 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd41962-2cdf-40f5-b73b-892774255b47 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:31.080270 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36083abd-9853-49aa-a244-5ee8151c93ae None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:31.108348 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23308750-2fed-44b2-adf0-e42aa9ef01a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:31.109240 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23308750-2fed-44b2-adf0-e42aa9ef01a1 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:31.109524 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23308750-2fed-44b2-adf0-e42aa9ef01a1 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:31.109799 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23308750-2fed-44b2-adf0-e42aa9ef01a1 None admin] PATH_INFO: `/v3/projects/e61749eb818249119b76cae445ffa9ff` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:31.110984 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23308750-2fed-44b2-adf0-e42aa9ef01a1 None admin] RBAC: Authorizing `identity:get_project(project_id=e61749eb818249119b76cae445ffa9ff)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:31.112828 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23308750-2fed-44b2-adf0-e42aa9ef01a1 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:31.114585 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 225/440] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Mar 30 07:02:30 2022] GET /identity/v3/projects/e61749eb818249119b76cae445ffa9ff => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:31.119535 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d772e4-6e43-40a4-9528-09be2d319a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:31.119535 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d772e4-6e43-40a4-9528-09be2d319a7a None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:31.119535 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d772e4-6e43-40a4-9528-09be2d319a7a None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:31.119535 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d772e4-6e43-40a4-9528-09be2d319a7a None admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:31.120249 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d772e4-6e43-40a4-9528-09be2d319a7a None admin] RBAC: Adding query filter params (name=admin) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:31.120249 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d772e4-6e43-40a4-9528-09be2d319a7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:31.120249 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d772e4-6e43-40a4-9528-09be2d319a7a None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:31.120555 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23308750-2fed-44b2-adf0-e42aa9ef01a1 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:31.128371 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 216/441] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Mar 30 07:02:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:31.133553 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d772e4-6e43-40a4-9528-09be2d319a7a None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:31.220162 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23308750-2fed-44b2-adf0-e42aa9ef01a1 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:31.232117 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d772e4-6e43-40a4-9528-09be2d319a7a None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:31.254528 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dcba1f-b311-4bf8-8fef-90e13e21eced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:31.255426 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dcba1f-b311-4bf8-8fef-90e13e21eced None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:31.255704 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dcba1f-b311-4bf8-8fef-90e13e21eced None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:31.256012 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dcba1f-b311-4bf8-8fef-90e13e21eced None admin] PATH_INFO: `/v3/groups/155688e886b64c548896712bbf16a02b` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:31.257288 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dcba1f-b311-4bf8-8fef-90e13e21eced None admin] RBAC: Authorizing `identity:get_group(group_id=155688e886b64c548896712bbf16a02b)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:31.258780 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dcba1f-b311-4bf8-8fef-90e13e21eced None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:31.260973 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 226/442] 10.222.0.20 () {56 vars in 1180 bytes} [Wed Mar 30 07:02:31 2022] GET /identity/v3/groups/155688e886b64c548896712bbf16a02b => generated 226 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:02:31.266880 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dcba1f-b311-4bf8-8fef-90e13e21eced None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:31.267384 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfd798b-f517-41b5-8805-29cc6d6bcf87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:31.268088 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfd798b-f517-41b5-8805-29cc6d6bcf87 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:31.268367 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfd798b-f517-41b5-8805-29cc6d6bcf87 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:31.268636 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfd798b-f517-41b5-8805-29cc6d6bcf87 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:31.335890 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfd798b-f517-41b5-8805-29cc6d6bcf87 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:31.337287 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfd798b-f517-41b5-8805-29cc6d6bcf87 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:31.367984 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dcba1f-b311-4bf8-8fef-90e13e21eced None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:31.401868 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d698b800-99cc-4901-8ef0-955722ab4115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:31.402514 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d698b800-99cc-4901-8ef0-955722ab4115 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:31.402789 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d698b800-99cc-4901-8ef0-955722ab4115 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:31.403054 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d698b800-99cc-4901-8ef0-955722ab4115 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:31.403899 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d698b800-99cc-4901-8ef0-955722ab4115 None admin] RBAC: Adding query filter params (group.id=155688e886b64c548896712bbf16a02b, role.id=5d79031a64754b57ba120367465e2252, scope.project.id=e61749eb818249119b76cae445ffa9ff) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:31.404203 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d698b800-99cc-4901-8ef0-955722ab4115 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:31.405654 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d698b800-99cc-4901-8ef0-955722ab4115 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:31.411316 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 227/443] 10.222.0.20 () {56 vars in 1376 bytes} [Wed Mar 30 07:02:31 2022] GET /identity/v3/role_assignments?group.id=155688e886b64c548896712bbf16a02b&scope.project.id=e61749eb818249119b76cae445ffa9ff&role.id=5d79031a64754b57ba120367465e2252 => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:02:31.437252 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 217/444] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Mar 30 07:02:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 30 07:02:31.443090 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d698b800-99cc-4901-8ef0-955722ab4115 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:31.550142 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d698b800-99cc-4901-8ef0-955722ab4115 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:31.592484 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034d8c31-4c37-4fce-bccc-ccdb5f7bf6c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:31.593340 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034d8c31-4c37-4fce-bccc-ccdb5f7bf6c9 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:31.593595 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034d8c31-4c37-4fce-bccc-ccdb5f7bf6c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:31.593886 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034d8c31-4c37-4fce-bccc-ccdb5f7bf6c9 None admin] PATH_INFO: `/v3/projects/e0c9fc0b60d1476cbb305fe8a9512169` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:31.595120 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034d8c31-4c37-4fce-bccc-ccdb5f7bf6c9 None admin] RBAC: Authorizing `identity:get_project(project_id=e0c9fc0b60d1476cbb305fe8a9512169)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:31.596555 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034d8c31-4c37-4fce-bccc-ccdb5f7bf6c9 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:31.598280 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 228/445] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Mar 30 07:02:31 2022] GET /identity/v3/projects/e0c9fc0b60d1476cbb305fe8a9512169 => generated 344 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:31.604163 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfd798b-f517-41b5-8805-29cc6d6bcf87 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:31.625206 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a88d43-96fd-4327-8fe3-2a45c6b0e00f None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:31.625492 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a88d43-96fd-4327-8fe3-2a45c6b0e00f None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:31.625770 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a88d43-96fd-4327-8fe3-2a45c6b0e00f None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:31.627691 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 229/446] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:02:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 30 07:02:31.632638 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e363b7-4e60-45f3-bd91-82a3ea1d0923 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:31.632924 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e363b7-4e60-45f3-bd91-82a3ea1d0923 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:31.633204 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e363b7-4e60-45f3-bd91-82a3ea1d0923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:31.650092 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-69e363b7-4e60-45f3-bd91-82a3ea1d0923 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:02:31.651343 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-69e363b7-4e60-45f3-bd91-82a3ea1d0923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:02:31.707260 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfd798b-f517-41b5-8805-29cc6d6bcf87 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:31.727439 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 230/447] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:02:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 30 07:02:31.744063 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f5cb46-fa55-4151-8e97-9c885491cec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:31.744307 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f5cb46-fa55-4151-8e97-9c885491cec7 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:31.744591 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f5cb46-fa55-4151-8e97-9c885491cec7 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:31.744864 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f5cb46-fa55-4151-8e97-9c885491cec7 None admin] PATH_INFO: `/v3/groups/9005d480268848caa4e54fca9a1a4469` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:31.746062 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f5cb46-fa55-4151-8e97-9c885491cec7 None admin] RBAC: Authorizing `identity:get_group(group_id=9005d480268848caa4e54fca9a1a4469)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:31.747574 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f5cb46-fa55-4151-8e97-9c885491cec7 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:31.749432 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 218/448] 10.222.0.20 () {56 vars in 1180 bytes} [Wed Mar 30 07:02:31 2022] GET /identity/v3/groups/9005d480268848caa4e54fca9a1a4469 => generated 229 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:31.751737 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e363b7-4e60-45f3-bd91-82a3ea1d0923 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:31.755176 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f5cb46-fa55-4151-8e97-9c885491cec7 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:31.856527 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f5cb46-fa55-4151-8e97-9c885491cec7 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:31.857552 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e363b7-4e60-45f3-bd91-82a3ea1d0923 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:31.890702 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977c53b3-44eb-43d2-8a7c-0de9050f8d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:31.891510 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977c53b3-44eb-43d2-8a7c-0de9050f8d92 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:31.891785 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977c53b3-44eb-43d2-8a7c-0de9050f8d92 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:31.891990 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0579a38-0334-4268-84ef-b2749ffa3db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:31.892098 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977c53b3-44eb-43d2-8a7c-0de9050f8d92 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:31.892641 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0579a38-0334-4268-84ef-b2749ffa3db1 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:31.892925 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0579a38-0334-4268-84ef-b2749ffa3db1 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:31.893195 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0579a38-0334-4268-84ef-b2749ffa3db1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:31.894025 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0579a38-0334-4268-84ef-b2749ffa3db1 None admin] RBAC: Adding query filter params (group.id=9005d480268848caa4e54fca9a1a4469, role.id=1c39b9ab8cfd4c0ea71845831920a845, scope.project.id=e0c9fc0b60d1476cbb305fe8a9512169) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:31.894329 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0579a38-0334-4268-84ef-b2749ffa3db1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:31.895776 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0579a38-0334-4268-84ef-b2749ffa3db1 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:31.901664 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 219/449] 10.222.0.20 () {56 vars in 1376 bytes} [Wed Mar 30 07:02:31 2022] GET /identity/v3/role_assignments?group.id=9005d480268848caa4e54fca9a1a4469&scope.project.id=e0c9fc0b60d1476cbb305fe8a9512169&role.id=1c39b9ab8cfd4c0ea71845831920a845 => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:02:31.901916 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977c53b3-44eb-43d2-8a7c-0de9050f8d92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 07:02:31.909428 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-977c53b3-44eb-43d2-8a7c-0de9050f8d92 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 30 07:02:31.910697 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 231/450] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Mar 30 07:02:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:02:31.917039 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0579a38-0334-4268-84ef-b2749ffa3db1 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:32.025142 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0579a38-0334-4268-84ef-b2749ffa3db1 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:32.063059 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23ed5fb-97f4-4711-b6da-8dc6497cc132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:32.063800 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ed5fb-97f4-4711-b6da-8dc6497cc132 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:32.064104 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ed5fb-97f4-4711-b6da-8dc6497cc132 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:32.064373 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ed5fb-97f4-4711-b6da-8dc6497cc132 None admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:32.065127 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23ed5fb-97f4-4711-b6da-8dc6497cc132 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:32.065423 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23ed5fb-97f4-4711-b6da-8dc6497cc132 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:32.066821 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23ed5fb-97f4-4711-b6da-8dc6497cc132 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:32.075843 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 220/451] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Mar 30 07:02:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:02:32.081762 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977c53b3-44eb-43d2-8a7c-0de9050f8d92 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:32.187305 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977c53b3-44eb-43d2-8a7c-0de9050f8d92 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:32.222733 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992ca85c-16e4-480f-84c2-3af0582ee447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:32.223383 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ca85c-16e4-480f-84c2-3af0582ee447 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:32.223668 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ca85c-16e4-480f-84c2-3af0582ee447 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:32.223969 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ca85c-16e4-480f-84c2-3af0582ee447 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:32.291832 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992ca85c-16e4-480f-84c2-3af0582ee447 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:32.293318 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992ca85c-16e4-480f-84c2-3af0582ee447 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:32.389671 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 232/452] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Mar 30 07:02:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 30 07:02:32.398314 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23ed5fb-97f4-4711-b6da-8dc6497cc132 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:32.498944 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23ed5fb-97f4-4711-b6da-8dc6497cc132 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:32.531742 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6c3c01-32b6-4383-978f-cc341cef2c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:32.532606 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6c3c01-32b6-4383-978f-cc341cef2c7d None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:32.532884 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6c3c01-32b6-4383-978f-cc341cef2c7d None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:32.533155 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6c3c01-32b6-4383-978f-cc341cef2c7d None admin] PATH_INFO: `/v3/projects/e61749eb818249119b76cae445ffa9ff` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:32.534367 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6c3c01-32b6-4383-978f-cc341cef2c7d None admin] RBAC: Authorizing `identity:get_project(project_id=e61749eb818249119b76cae445ffa9ff)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:32.535837 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6c3c01-32b6-4383-978f-cc341cef2c7d None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:32.537479 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 221/453] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Mar 30 07:02:32 2022] GET /identity/v3/projects/e61749eb818249119b76cae445ffa9ff => generated 302 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:32.543952 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992ca85c-16e4-480f-84c2-3af0582ee447 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:32.648052 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992ca85c-16e4-480f-84c2-3af0582ee447 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:32.682400 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc266fe-d515-4fff-9e8b-18131043008f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:32.683243 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc266fe-d515-4fff-9e8b-18131043008f None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:32.683519 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc266fe-d515-4fff-9e8b-18131043008f None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:32.683792 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc266fe-d515-4fff-9e8b-18131043008f None admin] PATH_INFO: `/v3/groups/155688e886b64c548896712bbf16a02b` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:32.685105 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc266fe-d515-4fff-9e8b-18131043008f None admin] RBAC: Authorizing `identity:get_group(group_id=155688e886b64c548896712bbf16a02b)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:32.686537 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc266fe-d515-4fff-9e8b-18131043008f None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:32.688176 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 233/454] 10.222.0.20 () {56 vars in 1180 bytes} [Wed Mar 30 07:02:32 2022] GET /identity/v3/groups/155688e886b64c548896712bbf16a02b => generated 226 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:32.696945 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6c3c01-32b6-4383-978f-cc341cef2c7d None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:32.810448 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6c3c01-32b6-4383-978f-cc341cef2c7d None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:32.845418 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9657a85b-9d98-476f-b94a-1b54380c8d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:32.846054 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9657a85b-9d98-476f-b94a-1b54380c8d33 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:32.846331 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9657a85b-9d98-476f-b94a-1b54380c8d33 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:32.846598 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9657a85b-9d98-476f-b94a-1b54380c8d33 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:32.847417 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9657a85b-9d98-476f-b94a-1b54380c8d33 None admin] RBAC: Adding query filter params (group.id=155688e886b64c548896712bbf16a02b, role.id=075d8bdffff942c29baa73114127d3fa, scope.project.id=e61749eb818249119b76cae445ffa9ff) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:32.847726 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9657a85b-9d98-476f-b94a-1b54380c8d33 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:32.849184 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9657a85b-9d98-476f-b94a-1b54380c8d33 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:32.855390 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 222/455] 10.222.0.20 () {56 vars in 1376 bytes} [Wed Mar 30 07:02:32 2022] GET /identity/v3/role_assignments?group.id=155688e886b64c548896712bbf16a02b&scope.project.id=e61749eb818249119b76cae445ffa9ff&role.id=075d8bdffff942c29baa73114127d3fa => generated 611 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:35.912875 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620179e3-0a89-47f6-be6d-f4d3d6599d8d None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:35.913405 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620179e3-0a89-47f6-be6d-f4d3d6599d8d None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:35.913405 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620179e3-0a89-47f6-be6d-f4d3d6599d8d None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:35.915484 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 234/456] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:02:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:02:35.921017 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43efd4e4-33f9-425d-b970-31d3805ee61d None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:35.921518 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43efd4e4-33f9-425d-b970-31d3805ee61d None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:35.921592 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43efd4e4-33f9-425d-b970-31d3805ee61d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:35.944402 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-43efd4e4-33f9-425d-b970-31d3805ee61d None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:02:35.945595 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-43efd4e4-33f9-425d-b970-31d3805ee61d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:02:35.966864 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd7faaf-3f7f-4c83-84ad-f8ff15ef0016 None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:35.967501 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd7faaf-3f7f-4c83-84ad-f8ff15ef0016 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:35.968009 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd7faaf-3f7f-4c83-84ad-f8ff15ef0016 None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:35.970446 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 235/457] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:02:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 30 07:02:35.992334 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a428095b-ec9b-4b79-9477-9bfe5879d076 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:35.992954 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a428095b-ec9b-4b79-9477-9bfe5879d076 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:35.993429 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a428095b-ec9b-4b79-9477-9bfe5879d076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:36.024980 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-a428095b-ec9b-4b79-9477-9bfe5879d076 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:02:36.026555 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-a428095b-ec9b-4b79-9477-9bfe5879d076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:02:36.034937 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 223/458] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:02:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 07:02:36.114584 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43efd4e4-33f9-425d-b970-31d3805ee61d None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:36.126347 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 236/459] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:02:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 30 07:02:36.171756 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a428095b-ec9b-4b79-9477-9bfe5879d076 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:36.212794 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43efd4e4-33f9-425d-b970-31d3805ee61d None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:36.253539 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead5d28a-c36e-477f-a88f-6cba7dcf0baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:36.254343 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead5d28a-c36e-477f-a88f-6cba7dcf0baa None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:36.254618 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead5d28a-c36e-477f-a88f-6cba7dcf0baa None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:36.254889 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead5d28a-c36e-477f-a88f-6cba7dcf0baa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:36.269038 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead5d28a-c36e-477f-a88f-6cba7dcf0baa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:36.270506 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead5d28a-c36e-477f-a88f-6cba7dcf0baa None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:36.291880 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-ead5d28a-c36e-477f-a88f-6cba7dcf0baa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 07:02:36.298614 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 224/460] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:02:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 07:02:36.300451 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead5d28a-c36e-477f-a88f-6cba7dcf0baa None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:36.371592 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a428095b-ec9b-4b79-9477-9bfe5879d076 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:36.406650 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead5d28a-c36e-477f-a88f-6cba7dcf0baa None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:36.418819 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4653801c-3a7b-49be-a26c-7fd3ca5c3754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:36.419970 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4653801c-3a7b-49be-a26c-7fd3ca5c3754 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:36.420417 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4653801c-3a7b-49be-a26c-7fd3ca5c3754 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:36.420882 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4653801c-3a7b-49be-a26c-7fd3ca5c3754 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:36.431333 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4653801c-3a7b-49be-a26c-7fd3ca5c3754 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:36.433260 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4653801c-3a7b-49be-a26c-7fd3ca5c3754 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:36.450320 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e011e4-a363-4907-b4f5-8cd59d139b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:36.450742 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-4653801c-3a7b-49be-a26c-7fd3ca5c3754 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 07:02:36.451145 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e011e4-a363-4907-b4f5-8cd59d139b28 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:36.451486 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e011e4-a363-4907-b4f5-8cd59d139b28 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:36.451839 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e011e4-a363-4907-b4f5-8cd59d139b28 None admin] PATH_INFO: `/v3/domains` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:36.452758 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e011e4-a363-4907-b4f5-8cd59d139b28 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:36.452938 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e011e4-a363-4907-b4f5-8cd59d139b28 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:36.453360 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 237/461] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:02:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 07:02:36.454521 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e011e4-a363-4907-b4f5-8cd59d139b28 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:36.455032 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f5f4a2-20a4-4911-85c4-364aa6a2f07b None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:36.455469 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f5f4a2-20a4-4911-85c4-364aa6a2f07b None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:36.455941 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f5f4a2-20a4-4911-85c4-364aa6a2f07b None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:36.458192 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 238/462] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:02:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:02:36.459104 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f5f4a2-20a4-4911-85c4-364aa6a2f07b None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:36.477566 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 225/463] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Mar 30 07:02:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:36.477566 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fe5fa6-cfcb-4913-a7fe-5e514911e312 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:36.477566 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fe5fa6-cfcb-4913-a7fe-5e514911e312 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:36.477566 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fe5fa6-cfcb-4913-a7fe-5e514911e312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:36.494818 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-b0fe5fa6-cfcb-4913-a7fe-5e514911e312 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:02:36.496386 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-b0fe5fa6-cfcb-4913-a7fe-5e514911e312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:02:36.573861 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 226/464] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:02:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 07:02:36.575224 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fe5fa6-cfcb-4913-a7fe-5e514911e312 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:36.609881 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f5f4a2-20a4-4911-85c4-364aa6a2f07b None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:36.645255 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f46b9a-3551-434c-8a25-d51f4de81a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:36.645984 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f46b9a-3551-434c-8a25-d51f4de81a2e None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:36.646266 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f46b9a-3551-434c-8a25-d51f4de81a2e None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:36.646527 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f46b9a-3551-434c-8a25-d51f4de81a2e None admin] PATH_INFO: `/v3/domains` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:36.647296 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f46b9a-3551-434c-8a25-d51f4de81a2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:36.647875 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f46b9a-3551-434c-8a25-d51f4de81a2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:36.649008 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f46b9a-3551-434c-8a25-d51f4de81a2e None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:36.660991 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 239/465] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Mar 30 07:02:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:36.661854 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f46b9a-3551-434c-8a25-d51f4de81a2e None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:36.705545 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fe5fa6-cfcb-4913-a7fe-5e514911e312 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:36.737829 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33449275-76a5-49e6-b11f-e85e1724761c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:36.738499 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33449275-76a5-49e6-b11f-e85e1724761c None admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:36.738773 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33449275-76a5-49e6-b11f-e85e1724761c None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:36.739042 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33449275-76a5-49e6-b11f-e85e1724761c None admin] PATH_INFO: `/v3/users` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:36.739740 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33449275-76a5-49e6-b11f-e85e1724761c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:36.741200 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33449275-76a5-49e6-b11f-e85e1724761c None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:36.761475 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 227/466] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Mar 30 07:02:36 2022] POST /identity/v3/users => generated 246 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:02:36.762159 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f46b9a-3551-434c-8a25-d51f4de81a2e None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:36.762821 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33449275-76a5-49e6-b11f-e85e1724761c None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:36.816307 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff30413f-bd75-44f0-8b5c-7745e7e2b74d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:36.817552 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff30413f-bd75-44f0-8b5c-7745e7e2b74d None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:36.818034 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff30413f-bd75-44f0-8b5c-7745e7e2b74d None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:36.818504 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff30413f-bd75-44f0-8b5c-7745e7e2b74d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:36.834478 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff30413f-bd75-44f0-8b5c-7745e7e2b74d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:36.837205 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff30413f-bd75-44f0-8b5c-7745e7e2b74d None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:36.860910 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-ff30413f-bd75-44f0-8b5c-7745e7e2b74d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 07:02:36.863565 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 240/467] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:02:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:02:36.865183 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46cc1fa-89c9-4bb0-a5d5-a8763f3fc150 None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:36.865659 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46cc1fa-89c9-4bb0-a5d5-a8763f3fc150 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:36.866121 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46cc1fa-89c9-4bb0-a5d5-a8763f3fc150 None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:36.873049 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 241/468] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:02:36 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:02:36.873242 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46cc1fa-89c9-4bb0-a5d5-a8763f3fc150 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:36.899120 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33449275-76a5-49e6-b11f-e85e1724761c None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:36.938029 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceb3ae7-c113-424c-a6ed-aad5f056a02f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:36.938721 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceb3ae7-c113-424c-a6ed-aad5f056a02f None admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:36.938800 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceb3ae7-c113-424c-a6ed-aad5f056a02f None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:36.939029 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceb3ae7-c113-424c-a6ed-aad5f056a02f None admin] PATH_INFO: `/v3/users` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:36.939762 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceb3ae7-c113-424c-a6ed-aad5f056a02f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:36.941270 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceb3ae7-c113-424c-a6ed-aad5f056a02f None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:36.963849 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 228/469] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Mar 30 07:02:36 2022] POST /identity/v3/users => generated 248 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:02:36.965098 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c8810-b862-4394-abac-9b1d4fb39469 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:36.965386 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c8810-b862-4394-abac-9b1d4fb39469 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:36.965655 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c8810-b862-4394-abac-9b1d4fb39469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:36.991552 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-769c8810-b862-4394-abac-9b1d4fb39469 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:02:36.992817 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-769c8810-b862-4394-abac-9b1d4fb39469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:02:37.005379 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46cc1fa-89c9-4bb0-a5d5-a8763f3fc150 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:37.045263 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db893ac1-45fb-4dc0-963d-a1f6501fab4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:37.046288 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db893ac1-45fb-4dc0-963d-a1f6501fab4b None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:37.046756 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db893ac1-45fb-4dc0-963d-a1f6501fab4b None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:37.047242 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db893ac1-45fb-4dc0-963d-a1f6501fab4b None admin] PATH_INFO: `/v3/domains` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:37.048218 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db893ac1-45fb-4dc0-963d-a1f6501fab4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:37.048697 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db893ac1-45fb-4dc0-963d-a1f6501fab4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:37.050304 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db893ac1-45fb-4dc0-963d-a1f6501fab4b None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:37.067916 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 242/470] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Mar 30 07:02:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:37.069854 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74638e14-f9fe-4ed8-bb9e-5321d3bf6265 None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:37.070147 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74638e14-f9fe-4ed8-bb9e-5321d3bf6265 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:37.070419 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74638e14-f9fe-4ed8-bb9e-5321d3bf6265 None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:37.072495 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 243/471] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:02:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:02:37.073082 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74638e14-f9fe-4ed8-bb9e-5321d3bf6265 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:37.093278 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 229/472] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:02:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 07:02:37.094641 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9ce4ab-3bb8-4ea4-afe7-b852d7bdac30 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:37.094922 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9ce4ab-3bb8-4ea4-afe7-b852d7bdac30 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:37.095193 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9ce4ab-3bb8-4ea4-afe7-b852d7bdac30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:37.113325 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-ee9ce4ab-3bb8-4ea4-afe7-b852d7bdac30 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:02:37.114528 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-ee9ce4ab-3bb8-4ea4-afe7-b852d7bdac30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:02:37.190628 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 230/473] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:02:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 07:02:37.191378 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9ce4ab-3bb8-4ea4-afe7-b852d7bdac30 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:37.207023 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74638e14-f9fe-4ed8-bb9e-5321d3bf6265 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:37.250362 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2222cd4a-243e-480b-b924-91ef7e0ea3a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:37.251400 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2222cd4a-243e-480b-b924-91ef7e0ea3a6 None admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:37.251678 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2222cd4a-243e-480b-b924-91ef7e0ea3a6 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:37.252121 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2222cd4a-243e-480b-b924-91ef7e0ea3a6 None admin] PATH_INFO: `/v3/users` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:37.252947 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2222cd4a-243e-480b-b924-91ef7e0ea3a6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:37.254910 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2222cd4a-243e-480b-b924-91ef7e0ea3a6 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:37.277184 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 244/474] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Mar 30 07:02:37 2022] POST /identity/v3/users => generated 248 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:02:37.278079 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2222cd4a-243e-480b-b924-91ef7e0ea3a6 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:37.306391 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9ce4ab-3bb8-4ea4-afe7-b852d7bdac30 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:37.344612 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e871639-e04a-4a55-9f47-02b91cf4320d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:37.345440 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e871639-e04a-4a55-9f47-02b91cf4320d None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:37.345718 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e871639-e04a-4a55-9f47-02b91cf4320d None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:37.345990 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e871639-e04a-4a55-9f47-02b91cf4320d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:37.359387 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e871639-e04a-4a55-9f47-02b91cf4320d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:37.361304 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e871639-e04a-4a55-9f47-02b91cf4320d None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:37.380399 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-4e871639-e04a-4a55-9f47-02b91cf4320d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 07:02:37.381993 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 231/475] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:02:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:02:37.388852 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e871639-e04a-4a55-9f47-02b91cf4320d None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:37.408497 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2222cd4a-243e-480b-b924-91ef7e0ea3a6 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:37.447602 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e223d71a-2241-4d76-9164-eb2b49a6f505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:37.448741 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e223d71a-2241-4d76-9164-eb2b49a6f505 None admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:37.449226 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e223d71a-2241-4d76-9164-eb2b49a6f505 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:37.449723 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e223d71a-2241-4d76-9164-eb2b49a6f505 None admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:37.450803 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e223d71a-2241-4d76-9164-eb2b49a6f505 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:37.452350 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e223d71a-2241-4d76-9164-eb2b49a6f505 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:37.462789 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.sql.core [None req-e223d71a-2241-4d76-9164-eb2b49a6f505 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Mar 30 07:02:37.462789 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Mar 30 07:02:37.462789 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [parameters: {'id': 'cf1dee6b095047549881c3a1bae159f1', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Mar 30 07:02:37.462789 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79960) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Mar 30 07:02:37.482182 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-e223d71a-2241-4d76-9164-eb2b49a6f505 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Mar 30 07:02:37.487880 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 245/476] 10.222.0.20 () {60 vars in 1131 bytes} [Wed Mar 30 07:02:37 2022] POST /identity/v3/roles => generated 144 bytes in 206 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:02:37.490934 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e223d71a-2241-4d76-9164-eb2b49a6f505 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:37.578154 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e871639-e04a-4a55-9f47-02b91cf4320d None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:37.621864 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6118b20e-6268-4721-82b9-730fb33ed357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:37.622203 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e223d71a-2241-4d76-9164-eb2b49a6f505 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:37.622535 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6118b20e-6268-4721-82b9-730fb33ed357 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:37.622816 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6118b20e-6268-4721-82b9-730fb33ed357 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:37.623088 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6118b20e-6268-4721-82b9-730fb33ed357 None admin] PATH_INFO: `/v3/domains` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:37.624028 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6118b20e-6268-4721-82b9-730fb33ed357 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:37.625161 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6118b20e-6268-4721-82b9-730fb33ed357 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:37.626569 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6118b20e-6268-4721-82b9-730fb33ed357 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:37.642052 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 232/477] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Mar 30 07:02:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:37.648755 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6118b20e-6268-4721-82b9-730fb33ed357 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:37.668529 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ea8a39-172c-496a-81e1-10edc4c921ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:37.669374 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea8a39-172c-496a-81e1-10edc4c921ef None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:37.669648 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea8a39-172c-496a-81e1-10edc4c921ef None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:37.670085 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea8a39-172c-496a-81e1-10edc4c921ef None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:37.683383 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ea8a39-172c-496a-81e1-10edc4c921ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 07:02:37.693300 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-97ea8a39-172c-496a-81e1-10edc4c921ef None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 30 07:02:37.694820 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 246/478] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Mar 30 07:02:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 07:02:37.700783 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ea8a39-172c-496a-81e1-10edc4c921ef None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:37.776852 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6118b20e-6268-4721-82b9-730fb33ed357 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:37.821344 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340651a5-e0b6-4929-acc9-0dac24486d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:37.823069 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340651a5-e0b6-4929-acc9-0dac24486d6e None admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:37.823674 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340651a5-e0b6-4929-acc9-0dac24486d6e None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:37.824162 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340651a5-e0b6-4929-acc9-0dac24486d6e None admin] PATH_INFO: `/v3/users` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:37.824795 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ea8a39-172c-496a-81e1-10edc4c921ef None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:37.825240 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340651a5-e0b6-4929-acc9-0dac24486d6e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:37.827864 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340651a5-e0b6-4929-acc9-0dac24486d6e None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:37.852979 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 233/479] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Mar 30 07:02:37 2022] POST /identity/v3/users => generated 249 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:02:37.872404 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174fc4ca-68f7-44e8-ad07-0f6d6272d22b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:37.873631 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174fc4ca-68f7-44e8-ad07-0f6d6272d22b None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:37.874161 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174fc4ca-68f7-44e8-ad07-0f6d6272d22b None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:37.874739 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174fc4ca-68f7-44e8-ad07-0f6d6272d22b None admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:37.876255 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174fc4ca-68f7-44e8-ad07-0f6d6272d22b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:37.877067 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174fc4ca-68f7-44e8-ad07-0f6d6272d22b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:37.878802 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174fc4ca-68f7-44e8-ad07-0f6d6272d22b None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:37.889801 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 247/480] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Mar 30 07:02:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:39.561948 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dcc58b-3acf-4cac-b719-4675a97a0dab None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:39.562880 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dcc58b-3acf-4cac-b719-4675a97a0dab None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:39.563300 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dcc58b-3acf-4cac-b719-4675a97a0dab None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:39.565587 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 234/481] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:02:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:02:39.571297 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e401b-a262-4817-9ac3-d22ff3a3e21b None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:39.572153 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e401b-a262-4817-9ac3-d22ff3a3e21b None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:39.572694 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e401b-a262-4817-9ac3-d22ff3a3e21b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:39.590954 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-bf7e401b-a262-4817-9ac3-d22ff3a3e21b None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:02:39.592524 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-bf7e401b-a262-4817-9ac3-d22ff3a3e21b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:02:39.662606 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 248/482] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:02:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 07:02:39.686919 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dcc58b-3acf-4cac-b719-4675a97a0dab None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:39.712031 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6392a04f-bbb5-414c-ae0b-078416f15c79 None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:39.712650 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6392a04f-bbb5-414c-ae0b-078416f15c79 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:39.713151 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6392a04f-bbb5-414c-ae0b-078416f15c79 None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:39.715741 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 249/483] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:02:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 30 07:02:39.722607 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0453ba-e829-42c4-a738-d183a46eac1b None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:39.722982 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0453ba-e829-42c4-a738-d183a46eac1b None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:39.723254 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0453ba-e829-42c4-a738-d183a46eac1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:39.744638 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-1a0453ba-e829-42c4-a738-d183a46eac1b None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:02:39.746029 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-1a0453ba-e829-42c4-a738-d183a46eac1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:02:39.802256 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dcc58b-3acf-4cac-b719-4675a97a0dab None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:39.813853 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 250/484] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:02:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 30 07:02:39.837438 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9a948e-e900-45f0-8c66-3d6dfd22fab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:39.838878 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9a948e-e900-45f0-8c66-3d6dfd22fab8 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:39.839907 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9a948e-e900-45f0-8c66-3d6dfd22fab8 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:39.840386 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9a948e-e900-45f0-8c66-3d6dfd22fab8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:39.840716 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0453ba-e829-42c4-a738-d183a46eac1b None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:39.861538 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9a948e-e900-45f0-8c66-3d6dfd22fab8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 07:02:39.868803 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-8d9a948e-e900-45f0-8c66-3d6dfd22fab8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 30 07:02:39.877260 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 235/485] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Mar 30 07:02:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:02:39.890611 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9a948e-e900-45f0-8c66-3d6dfd22fab8 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:39.962591 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0453ba-e829-42c4-a738-d183a46eac1b None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:40.023044 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899f1f31-457e-4b44-9e71-ecd55de22b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:40.024028 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899f1f31-457e-4b44-9e71-ecd55de22b69 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:40.024311 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899f1f31-457e-4b44-9e71-ecd55de22b69 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:40.024583 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899f1f31-457e-4b44-9e71-ecd55de22b69 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:40.046148 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899f1f31-457e-4b44-9e71-ecd55de22b69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 07:02:40.054238 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-899f1f31-457e-4b44-9e71-ecd55de22b69 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 30 07:02:40.055894 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 251/486] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Mar 30 07:02:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 07:02:40.063465 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899f1f31-457e-4b44-9e71-ecd55de22b69 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:40.133719 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9a948e-e900-45f0-8c66-3d6dfd22fab8 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:40.176321 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3a06cb-5eed-4958-b89e-12a46559c5d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:40.176989 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a06cb-5eed-4958-b89e-12a46559c5d6 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:40.177271 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a06cb-5eed-4958-b89e-12a46559c5d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:40.177532 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a06cb-5eed-4958-b89e-12a46559c5d6 None admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:40.178533 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3a06cb-5eed-4958-b89e-12a46559c5d6 None admin] RBAC: Adding query filter params (name=service) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:40.178835 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3a06cb-5eed-4958-b89e-12a46559c5d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:40.180261 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3a06cb-5eed-4958-b89e-12a46559c5d6 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:40.192355 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 236/487] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Mar 30 07:02:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:02:40.198068 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3a06cb-5eed-4958-b89e-12a46559c5d6 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:40.249962 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899f1f31-457e-4b44-9e71-ecd55de22b69 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:40.315574 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c4ffb6-77a4-49a2-9f90-2a0d31200c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:40.316271 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c4ffb6-77a4-49a2-9f90-2a0d31200c8f None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:40.316546 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c4ffb6-77a4-49a2-9f90-2a0d31200c8f None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:40.316807 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c4ffb6-77a4-49a2-9f90-2a0d31200c8f None admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:40.317555 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c4ffb6-77a4-49a2-9f90-2a0d31200c8f None admin] RBAC: Adding query filter params (name=service) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:40.317852 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c4ffb6-77a4-49a2-9f90-2a0d31200c8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:40.319225 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c4ffb6-77a4-49a2-9f90-2a0d31200c8f None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:40.339403 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 252/488] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Mar 30 07:02:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:02:40.344436 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c4ffb6-77a4-49a2-9f90-2a0d31200c8f None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:40.350563 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3a06cb-5eed-4958-b89e-12a46559c5d6 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:40.384415 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fb5946-45d4-4ba0-9590-bf143bed6475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:40.385513 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fb5946-45d4-4ba0-9590-bf143bed6475 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:40.385793 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fb5946-45d4-4ba0-9590-bf143bed6475 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:40.386157 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fb5946-45d4-4ba0-9590-bf143bed6475 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:40.397388 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fb5946-45d4-4ba0-9590-bf143bed6475 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:40.398867 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fb5946-45d4-4ba0-9590-bf143bed6475 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:40.415833 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-68fb5946-45d4-4ba0-9590-bf143bed6475 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 07:02:40.417609 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 237/489] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:02:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:02:40.422920 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf7d7f9-1a94-4df3-aae5-52c9d8f9226b None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:40.423205 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf7d7f9-1a94-4df3-aae5-52c9d8f9226b None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:40.423478 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf7d7f9-1a94-4df3-aae5-52c9d8f9226b None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:40.425490 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 238/490] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:02:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 30 07:02:40.426193 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf7d7f9-1a94-4df3-aae5-52c9d8f9226b None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:40.493438 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c4ffb6-77a4-49a2-9f90-2a0d31200c8f None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:40.527073 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c15f20-6e1d-426c-9969-6b7d073e8cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:40.527896 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c15f20-6e1d-426c-9969-6b7d073e8cfa None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:40.528001 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf7d7f9-1a94-4df3-aae5-52c9d8f9226b None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:40.528167 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c15f20-6e1d-426c-9969-6b7d073e8cfa None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:40.528437 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c15f20-6e1d-426c-9969-6b7d073e8cfa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:40.539429 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c15f20-6e1d-426c-9969-6b7d073e8cfa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:40.540962 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c15f20-6e1d-426c-9969-6b7d073e8cfa None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:40.558801 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-55c15f20-6e1d-426c-9969-6b7d073e8cfa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 07:02:40.560474 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 253/491] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:02:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 07:02:40.562039 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da37c79-16a4-473f-8977-5444670297bb None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:40.562380 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da37c79-16a4-473f-8977-5444670297bb None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:40.562653 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da37c79-16a4-473f-8977-5444670297bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:40.565420 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc1875a-256e-4cb7-be3f-0b6f5d5bde0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:40.566250 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc1875a-256e-4cb7-be3f-0b6f5d5bde0c None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:40.566419 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc1875a-256e-4cb7-be3f-0b6f5d5bde0c None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:40.566884 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc1875a-256e-4cb7-be3f-0b6f5d5bde0c None admin] PATH_INFO: `/v3/domains` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:40.567842 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc1875a-256e-4cb7-be3f-0b6f5d5bde0c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:40.568292 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc1875a-256e-4cb7-be3f-0b6f5d5bde0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:40.569976 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc1875a-256e-4cb7-be3f-0b6f5d5bde0c None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:40.583157 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-0da37c79-16a4-473f-8977-5444670297bb None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:02:40.583878 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 239/492] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Mar 30 07:02:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:40.584430 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc1875a-256e-4cb7-be3f-0b6f5d5bde0c None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:40.585908 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-0da37c79-16a4-473f-8977-5444670297bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:02:40.658886 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 254/493] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:02:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 07:02:40.665621 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da37c79-16a4-473f-8977-5444670297bb None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:40.696524 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc1875a-256e-4cb7-be3f-0b6f5d5bde0c None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:40.730683 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d17241e-9985-48b0-ab11-d108fd100c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:40.731346 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d17241e-9985-48b0-ab11-d108fd100c97 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:40.731785 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d17241e-9985-48b0-ab11-d108fd100c97 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:40.732232 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d17241e-9985-48b0-ab11-d108fd100c97 None admin] PATH_INFO: `/v3/domains` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:40.733172 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d17241e-9985-48b0-ab11-d108fd100c97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:40.733616 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d17241e-9985-48b0-ab11-d108fd100c97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:40.735146 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d17241e-9985-48b0-ab11-d108fd100c97 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:40.748553 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 240/494] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Mar 30 07:02:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:40.749567 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d17241e-9985-48b0-ab11-d108fd100c97 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:40.787387 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da37c79-16a4-473f-8977-5444670297bb None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:40.820957 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95cad21-1044-4a9e-ad83-1040e52c48ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:40.821765 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95cad21-1044-4a9e-ad83-1040e52c48ad None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:40.822047 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95cad21-1044-4a9e-ad83-1040e52c48ad None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:40.822321 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95cad21-1044-4a9e-ad83-1040e52c48ad None admin] PATH_INFO: `/v3/users/nova` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:40.829743 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95cad21-1044-4a9e-ad83-1040e52c48ad None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:40.831218 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95cad21-1044-4a9e-ad83-1040e52c48ad None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:40.845058 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-b95cad21-1044-4a9e-ad83-1040e52c48ad None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 30 07:02:40.846599 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 255/495] 10.222.0.20 () {56 vars in 1093 bytes} [Wed Mar 30 07:02:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:02:40.847523 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95cad21-1044-4a9e-ad83-1040e52c48ad None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:40.850227 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d17241e-9985-48b0-ab11-d108fd100c97 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:40.886301 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d42ad0-95f6-4022-a2a9-4fcd724e4c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:40.887401 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d42ad0-95f6-4022-a2a9-4fcd724e4c99 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:40.887845 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d42ad0-95f6-4022-a2a9-4fcd724e4c99 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:40.888257 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d42ad0-95f6-4022-a2a9-4fcd724e4c99 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:40.899173 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d42ad0-95f6-4022-a2a9-4fcd724e4c99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 07:02:40.906582 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-76d42ad0-95f6-4022-a2a9-4fcd724e4c99 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 30 07:02:40.908311 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 241/496] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Mar 30 07:02:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:02:40.909283 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d42ad0-95f6-4022-a2a9-4fcd724e4c99 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:40.953800 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95cad21-1044-4a9e-ad83-1040e52c48ad None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:40.988069 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffdd10d-3cf4-496f-b213-4a0951a7c1eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:40.988870 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffdd10d-3cf4-496f-b213-4a0951a7c1eb None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:40.989152 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffdd10d-3cf4-496f-b213-4a0951a7c1eb None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:40.989419 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffdd10d-3cf4-496f-b213-4a0951a7c1eb None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:40.996666 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffdd10d-3cf4-496f-b213-4a0951a7c1eb None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:40.998146 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffdd10d-3cf4-496f-b213-4a0951a7c1eb None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:41.012241 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-8ffdd10d-3cf4-496f-b213-4a0951a7c1eb None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Mar 30 07:02:41.013433 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 256/497] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Mar 30 07:02:40 2022] GET /identity/v3/users/cinder => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:02:41.014264 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffdd10d-3cf4-496f-b213-4a0951a7c1eb None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:41.030209 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d42ad0-95f6-4022-a2a9-4fcd724e4c99 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:41.065218 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d9703c-ca74-4d66-88f0-972ee7b3d9bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:41.065901 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d9703c-ca74-4d66-88f0-972ee7b3d9bc None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:41.066181 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d9703c-ca74-4d66-88f0-972ee7b3d9bc None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:41.066456 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d9703c-ca74-4d66-88f0-972ee7b3d9bc None admin] PATH_INFO: `/v3/users` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:41.067289 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d9703c-ca74-4d66-88f0-972ee7b3d9bc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:41.067595 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d9703c-ca74-4d66-88f0-972ee7b3d9bc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:41.069101 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d9703c-ca74-4d66-88f0-972ee7b3d9bc None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:41.105172 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 242/498] 10.222.0.20 () {56 vars in 1133 bytes} [Wed Mar 30 07:02:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:41.106463 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ef5505-f6d9-4aa2-863d-39195a4c24f3 None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:41.106722 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ef5505-f6d9-4aa2-863d-39195a4c24f3 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:41.106994 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ef5505-f6d9-4aa2-863d-39195a4c24f3 None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:41.108661 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 243/499] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:02:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:02:41.109340 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ef5505-f6d9-4aa2-863d-39195a4c24f3 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:41.114097 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffdd10d-3cf4-496f-b213-4a0951a7c1eb None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:41.147334 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf294d8-3088-4966-9714-6d2b8f5c398d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:41.148027 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf294d8-3088-4966-9714-6d2b8f5c398d None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:41.148303 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf294d8-3088-4966-9714-6d2b8f5c398d None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:41.148572 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf294d8-3088-4966-9714-6d2b8f5c398d None admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:41.149312 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf294d8-3088-4966-9714-6d2b8f5c398d None admin] RBAC: Adding query filter params (name=service) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:41.149609 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf294d8-3088-4966-9714-6d2b8f5c398d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:41.151014 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf294d8-3088-4966-9714-6d2b8f5c398d None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:41.159014 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 257/500] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Mar 30 07:02:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:41.160395 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7373e1ce-7e51-4d33-8f0c-fdd0e17cc848 None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:41.160630 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7373e1ce-7e51-4d33-8f0c-fdd0e17cc848 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:41.160897 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7373e1ce-7e51-4d33-8f0c-fdd0e17cc848 None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:41.162666 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 258/501] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:02:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:02:41.163343 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7373e1ce-7e51-4d33-8f0c-fdd0e17cc848 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:41.210533 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ef5505-f6d9-4aa2-863d-39195a4c24f3 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:41.243279 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4705246-f40c-45cd-8e01-0eb30ad4f82e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:41.243966 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4705246-f40c-45cd-8e01-0eb30ad4f82e None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:41.244243 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4705246-f40c-45cd-8e01-0eb30ad4f82e None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:41.244613 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4705246-f40c-45cd-8e01-0eb30ad4f82e None admin] PATH_INFO: `/v3/users` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:41.245442 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4705246-f40c-45cd-8e01-0eb30ad4f82e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:41.245739 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4705246-f40c-45cd-8e01-0eb30ad4f82e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:41.247179 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4705246-f40c-45cd-8e01-0eb30ad4f82e None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:41.261586 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7373e1ce-7e51-4d33-8f0c-fdd0e17cc848 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:41.263521 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 244/502] 10.222.0.20 () {56 vars in 1137 bytes} [Wed Mar 30 07:02:41 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:41.264855 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b49d4-5bf9-42b0-8c5c-3d46aaad4a1d None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:41.265138 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b49d4-5bf9-42b0-8c5c-3d46aaad4a1d None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:41.265407 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b49d4-5bf9-42b0-8c5c-3d46aaad4a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:41.281851 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-be8b49d4-5bf9-42b0-8c5c-3d46aaad4a1d None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:02:41.283042 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-be8b49d4-5bf9-42b0-8c5c-3d46aaad4a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:02:41.294131 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb4789c-3ba6-4804-9730-b5ab6c0c9180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:41.294782 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb4789c-3ba6-4804-9730-b5ab6c0c9180 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:41.295061 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb4789c-3ba6-4804-9730-b5ab6c0c9180 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:41.295335 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb4789c-3ba6-4804-9730-b5ab6c0c9180 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:41.344511 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 245/503] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:02:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 07:02:41.345328 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8b49d4-5bf9-42b0-8c5c-3d46aaad4a1d None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:41.364489 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb4789c-3ba6-4804-9730-b5ab6c0c9180 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:41.366235 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb4789c-3ba6-4804-9730-b5ab6c0c9180 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:41.448179 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8b49d4-5bf9-42b0-8c5c-3d46aaad4a1d None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:41.460460 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 259/504] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Mar 30 07:02:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 30 07:02:41.461757 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba2cccc-365a-411c-9d7b-333761746232 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:41.462040 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba2cccc-365a-411c-9d7b-333761746232 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:41.462378 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba2cccc-365a-411c-9d7b-333761746232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:41.477780 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-0ba2cccc-365a-411c-9d7b-333761746232 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:02:41.478971 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-0ba2cccc-365a-411c-9d7b-333761746232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:02:41.483059 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c8451b-0210-43c6-94a4-fec09f74b3f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:41.483886 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c8451b-0210-43c6-94a4-fec09f74b3f1 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:41.484163 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c8451b-0210-43c6-94a4-fec09f74b3f1 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:41.484428 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c8451b-0210-43c6-94a4-fec09f74b3f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:41.494485 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c8451b-0210-43c6-94a4-fec09f74b3f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:41.495971 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c8451b-0210-43c6-94a4-fec09f74b3f1 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:41.512386 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-32c8451b-0210-43c6-94a4-fec09f74b3f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 07:02:41.513533 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 246/505] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:02:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:02:41.518131 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c8451b-0210-43c6-94a4-fec09f74b3f1 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:41.542946 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 260/506] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:02:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 07:02:41.543789 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba2cccc-365a-411c-9d7b-333761746232 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:41.612498 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c8451b-0210-43c6-94a4-fec09f74b3f1 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:41.640402 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba2cccc-365a-411c-9d7b-333761746232 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:41.645906 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e597695-ac2a-4694-a79f-d26bb1cf9807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:41.646552 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e597695-ac2a-4694-a79f-d26bb1cf9807 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:41.646810 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e597695-ac2a-4694-a79f-d26bb1cf9807 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:41.647082 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e597695-ac2a-4694-a79f-d26bb1cf9807 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:41.673487 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfbfe16-739e-4e0d-820a-c2bae80f23cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:41.674411 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfbfe16-739e-4e0d-820a-c2bae80f23cc None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:41.674756 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfbfe16-739e-4e0d-820a-c2bae80f23cc None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:41.675090 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfbfe16-739e-4e0d-820a-c2bae80f23cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:41.685803 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfbfe16-739e-4e0d-820a-c2bae80f23cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:41.687330 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfbfe16-739e-4e0d-820a-c2bae80f23cc None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:41.703055 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-ddfbfe16-739e-4e0d-820a-c2bae80f23cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 07:02:41.704350 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 261/507] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:02:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:02:41.705022 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfbfe16-739e-4e0d-820a-c2bae80f23cc None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:41.710406 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e597695-ac2a-4694-a79f-d26bb1cf9807 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:41.711920 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e597695-ac2a-4694-a79f-d26bb1cf9807 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:41.800309 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfbfe16-739e-4e0d-820a-c2bae80f23cc None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:41.807944 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 247/508] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Mar 30 07:02:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 30 07:02:41.808780 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e597695-ac2a-4694-a79f-d26bb1cf9807 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:41.833598 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9d7b87-ad02-4ad1-9f62-25913b9c404d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:41.834392 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9d7b87-ad02-4ad1-9f62-25913b9c404d None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:41.834667 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9d7b87-ad02-4ad1-9f62-25913b9c404d None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:41.834931 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9d7b87-ad02-4ad1-9f62-25913b9c404d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:41.845211 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9d7b87-ad02-4ad1-9f62-25913b9c404d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:41.846635 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9d7b87-ad02-4ad1-9f62-25913b9c404d None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:41.863143 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-ab9d7b87-ad02-4ad1-9f62-25913b9c404d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 07:02:41.864336 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 262/509] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:02:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:02:41.865089 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9d7b87-ad02-4ad1-9f62-25913b9c404d None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:41.906611 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e597695-ac2a-4694-a79f-d26bb1cf9807 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:41.940934 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94089bdc-4218-4f67-9c3f-526de6349bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:41.941595 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94089bdc-4218-4f67-9c3f-526de6349bec None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:41.941873 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94089bdc-4218-4f67-9c3f-526de6349bec None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:41.942141 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94089bdc-4218-4f67-9c3f-526de6349bec None admin] PATH_INFO: `/v3/domains` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:41.942854 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94089bdc-4218-4f67-9c3f-526de6349bec None admin] RBAC: Adding query filter params (name=Default) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:41.943165 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94089bdc-4218-4f67-9c3f-526de6349bec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:41.944594 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94089bdc-4218-4f67-9c3f-526de6349bec None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:41.955858 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 248/510] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Mar 30 07:02:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:41.956577 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94089bdc-4218-4f67-9c3f-526de6349bec None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:41.960850 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9d7b87-ad02-4ad1-9f62-25913b9c404d None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:41.993167 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858d3a34-5a3f-40d2-b4ed-4074aa5c8dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:41.993975 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858d3a34-5a3f-40d2-b4ed-4074aa5c8dae None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:41.994272 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858d3a34-5a3f-40d2-b4ed-4074aa5c8dae None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:41.994709 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858d3a34-5a3f-40d2-b4ed-4074aa5c8dae None admin] PATH_INFO: `/v3/roles/service` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:42.004431 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858d3a34-5a3f-40d2-b4ed-4074aa5c8dae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 07:02:42.011566 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-858d3a34-5a3f-40d2-b4ed-4074aa5c8dae None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 30 07:02:42.012954 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 263/511] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Mar 30 07:02:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:02:42.013594 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858d3a34-5a3f-40d2-b4ed-4074aa5c8dae None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:42.051552 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94089bdc-4218-4f67-9c3f-526de6349bec None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:42.085043 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a37525d-ae96-4952-a52b-3c344b74298b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:42.085701 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a37525d-ae96-4952-a52b-3c344b74298b None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:42.085978 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a37525d-ae96-4952-a52b-3c344b74298b None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:42.086246 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a37525d-ae96-4952-a52b-3c344b74298b None admin] PATH_INFO: `/v3/domains` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:42.086960 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a37525d-ae96-4952-a52b-3c344b74298b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:42.087264 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a37525d-ae96-4952-a52b-3c344b74298b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:42.088711 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a37525d-ae96-4952-a52b-3c344b74298b None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:42.100218 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 249/512] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Mar 30 07:02:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:42.101088 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a37525d-ae96-4952-a52b-3c344b74298b None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:42.107113 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858d3a34-5a3f-40d2-b4ed-4074aa5c8dae None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:42.142686 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0623f6-6ec8-4c17-a4b7-cb64e1ea195e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:42.143511 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0623f6-6ec8-4c17-a4b7-cb64e1ea195e None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:42.143787 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0623f6-6ec8-4c17-a4b7-cb64e1ea195e None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:42.144093 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0623f6-6ec8-4c17-a4b7-cb64e1ea195e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:42.155758 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0623f6-6ec8-4c17-a4b7-cb64e1ea195e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:42.157256 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0623f6-6ec8-4c17-a4b7-cb64e1ea195e None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:42.173339 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-7d0623f6-6ec8-4c17-a4b7-cb64e1ea195e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 07:02:42.174516 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 264/513] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:02:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:02:42.175282 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0623f6-6ec8-4c17-a4b7-cb64e1ea195e None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:42.200782 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a37525d-ae96-4952-a52b-3c344b74298b None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:42.235135 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed367a2-0255-40cb-ad97-976e96842b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:42.235793 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed367a2-0255-40cb-ad97-976e96842b21 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:42.236472 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed367a2-0255-40cb-ad97-976e96842b21 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:42.236745 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed367a2-0255-40cb-ad97-976e96842b21 None admin] PATH_INFO: `/v3/domains` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:42.237465 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed367a2-0255-40cb-ad97-976e96842b21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:42.237769 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed367a2-0255-40cb-ad97-976e96842b21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:42.239175 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed367a2-0255-40cb-ad97-976e96842b21 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:42.250196 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 250/514] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Mar 30 07:02:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:42.250820 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed367a2-0255-40cb-ad97-976e96842b21 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:42.274629 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0623f6-6ec8-4c17-a4b7-cb64e1ea195e None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:42.305866 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6c9f42-f22d-423a-bd88-901046a03c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:42.306673 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6c9f42-f22d-423a-bd88-901046a03c2f None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:42.307024 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6c9f42-f22d-423a-bd88-901046a03c2f None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:42.307299 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6c9f42-f22d-423a-bd88-901046a03c2f None admin] PATH_INFO: `/v3/users/glance` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:42.314740 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6c9f42-f22d-423a-bd88-901046a03c2f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:42.316213 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6c9f42-f22d-423a-bd88-901046a03c2f None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:42.329609 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-0b6c9f42-f22d-423a-bd88-901046a03c2f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Mar 30 07:02:42.330774 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 265/515] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Mar 30 07:02:42 2022] GET /identity/v3/users/glance => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:02:42.331518 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6c9f42-f22d-423a-bd88-901046a03c2f None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:42.346175 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed367a2-0255-40cb-ad97-976e96842b21 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:42.379490 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f5bfb2-3cc2-4fe1-86c6-1c0484067e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:42.380189 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f5bfb2-3cc2-4fe1-86c6-1c0484067e02 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:42.380467 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f5bfb2-3cc2-4fe1-86c6-1c0484067e02 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:42.380739 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f5bfb2-3cc2-4fe1-86c6-1c0484067e02 None admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:42.381488 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f5bfb2-3cc2-4fe1-86c6-1c0484067e02 None admin] RBAC: Adding query filter params (name=service) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:42.381791 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f5bfb2-3cc2-4fe1-86c6-1c0484067e02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:42.383174 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f5bfb2-3cc2-4fe1-86c6-1c0484067e02 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:42.391249 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 251/516] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Mar 30 07:02:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:42.392017 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f5bfb2-3cc2-4fe1-86c6-1c0484067e02 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:42.426724 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6c9f42-f22d-423a-bd88-901046a03c2f None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:42.459427 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374eabe0-bc0e-422f-9db0-1518eef9d460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:42.460181 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374eabe0-bc0e-422f-9db0-1518eef9d460 None admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:42.460405 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374eabe0-bc0e-422f-9db0-1518eef9d460 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:42.460677 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374eabe0-bc0e-422f-9db0-1518eef9d460 None admin] PATH_INFO: `/v3/users` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:42.461381 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374eabe0-bc0e-422f-9db0-1518eef9d460 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:42.462802 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374eabe0-bc0e-422f-9db0-1518eef9d460 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:42.482631 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 266/517] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Mar 30 07:02:42 2022] POST /identity/v3/users => generated 247 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:02:42.483433 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374eabe0-bc0e-422f-9db0-1518eef9d460 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:42.487949 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f5bfb2-3cc2-4fe1-86c6-1c0484067e02 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:42.525244 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bc598f-85a9-4301-ab29-bf6f5386c8d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:42.526031 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bc598f-85a9-4301-ab29-bf6f5386c8d1 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:42.526314 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bc598f-85a9-4301-ab29-bf6f5386c8d1 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:42.526684 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bc598f-85a9-4301-ab29-bf6f5386c8d1 None admin] PATH_INFO: `/v3/domains` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:42.527450 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bc598f-85a9-4301-ab29-bf6f5386c8d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:42.527760 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bc598f-85a9-4301-ab29-bf6f5386c8d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:42.529216 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bc598f-85a9-4301-ab29-bf6f5386c8d1 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:42.542106 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 252/518] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Mar 30 07:02:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:42.543335 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bc598f-85a9-4301-ab29-bf6f5386c8d1 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:42.602027 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374eabe0-bc0e-422f-9db0-1518eef9d460 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:42.637801 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809a7187-737d-4016-8d74-36bcf98e465a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:42.638630 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a7187-737d-4016-8d74-36bcf98e465a None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:42.638913 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a7187-737d-4016-8d74-36bcf98e465a None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:42.639186 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a7187-737d-4016-8d74-36bcf98e465a None admin] PATH_INFO: `/v3/projects/service` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:42.646566 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809a7187-737d-4016-8d74-36bcf98e465a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:42.648097 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809a7187-737d-4016-8d74-36bcf98e465a None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:42.648196 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bc598f-85a9-4301-ab29-bf6f5386c8d1 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:42.662553 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-809a7187-737d-4016-8d74-36bcf98e465a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 30 07:02:42.669187 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 267/519] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Mar 30 07:02:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:02:42.669187 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809a7187-737d-4016-8d74-36bcf98e465a None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:42.684760 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62608469-9fd5-4d36-8b86-39d9e34b274b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:42.686075 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62608469-9fd5-4d36-8b86-39d9e34b274b None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:42.686075 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62608469-9fd5-4d36-8b86-39d9e34b274b None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:42.686075 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62608469-9fd5-4d36-8b86-39d9e34b274b None admin] PATH_INFO: `/v3/users` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:42.686840 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62608469-9fd5-4d36-8b86-39d9e34b274b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:42.687167 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62608469-9fd5-4d36-8b86-39d9e34b274b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:42.688845 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62608469-9fd5-4d36-8b86-39d9e34b274b None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:42.707076 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 253/520] 10.222.0.20 () {56 vars in 1137 bytes} [Wed Mar 30 07:02:42 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:42.708237 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62608469-9fd5-4d36-8b86-39d9e34b274b None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:42.772571 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809a7187-737d-4016-8d74-36bcf98e465a None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:42.805532 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940ca0da-7839-4896-b997-bea29e839d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:42.806443 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940ca0da-7839-4896-b997-bea29e839d59 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:42.806564 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62608469-9fd5-4d36-8b86-39d9e34b274b None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:42.806883 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940ca0da-7839-4896-b997-bea29e839d59 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:42.807229 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940ca0da-7839-4896-b997-bea29e839d59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:42.817345 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940ca0da-7839-4896-b997-bea29e839d59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:42.818832 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940ca0da-7839-4896-b997-bea29e839d59 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:42.836741 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-940ca0da-7839-4896-b997-bea29e839d59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 07:02:42.838022 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 268/521] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:02:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:02:42.839106 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940ca0da-7839-4896-b997-bea29e839d59 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:42.843899 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e832547-dc6d-4719-926c-10db5831fe2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:42.844731 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e832547-dc6d-4719-926c-10db5831fe2f None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:42.845009 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e832547-dc6d-4719-926c-10db5831fe2f None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:42.845280 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e832547-dc6d-4719-926c-10db5831fe2f None admin] PATH_INFO: `/v3/projects/service` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:42.852208 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e832547-dc6d-4719-926c-10db5831fe2f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:42.853771 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e832547-dc6d-4719-926c-10db5831fe2f None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:42.867129 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-4e832547-dc6d-4719-926c-10db5831fe2f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 30 07:02:42.868563 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 254/522] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Mar 30 07:02:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:02:42.869246 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e832547-dc6d-4719-926c-10db5831fe2f None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:42.939957 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940ca0da-7839-4896-b997-bea29e839d59 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:42.969561 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e832547-dc6d-4719-926c-10db5831fe2f None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:42.978075 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e22fa9-2cbd-46b3-a416-5d5c573fde14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:42.978740 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e22fa9-2cbd-46b3-a416-5d5c573fde14 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:42.979081 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e22fa9-2cbd-46b3-a416-5d5c573fde14 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:42.979344 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e22fa9-2cbd-46b3-a416-5d5c573fde14 None admin] PATH_INFO: `/v3/projects` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:42.980212 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e22fa9-2cbd-46b3-a416-5d5c573fde14 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:42.980520 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e22fa9-2cbd-46b3-a416-5d5c573fde14 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:42.982015 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e22fa9-2cbd-46b3-a416-5d5c573fde14 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:43.000627 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 269/523] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Mar 30 07:02:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:43.001751 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e22fa9-2cbd-46b3-a416-5d5c573fde14 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:43.007357 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44091967-43e4-40c5-aeb8-9e77051fa126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:43.008026 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44091967-43e4-40c5-aeb8-9e77051fa126 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:43.008303 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44091967-43e4-40c5-aeb8-9e77051fa126 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:43.008574 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44091967-43e4-40c5-aeb8-9e77051fa126 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:43.074145 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44091967-43e4-40c5-aeb8-9e77051fa126 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:43.075895 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44091967-43e4-40c5-aeb8-9e77051fa126 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:43.101695 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e22fa9-2cbd-46b3-a416-5d5c573fde14 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:43.134200 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f3fdac-d982-407f-8f21-0d0c2a958f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:43.134896 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f3fdac-d982-407f-8f21-0d0c2a958f06 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:43.135188 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f3fdac-d982-407f-8f21-0d0c2a958f06 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:43.135455 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f3fdac-d982-407f-8f21-0d0c2a958f06 None admin] PATH_INFO: `/v3/domains` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:43.136199 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f3fdac-d982-407f-8f21-0d0c2a958f06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:43.136499 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f3fdac-d982-407f-8f21-0d0c2a958f06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:43.137867 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f3fdac-d982-407f-8f21-0d0c2a958f06 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:43.149365 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 270/524] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Mar 30 07:02:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:43.150196 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f3fdac-d982-407f-8f21-0d0c2a958f06 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:43.174399 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 255/525] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Mar 30 07:02:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 30 07:02:43.175261 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44091967-43e4-40c5-aeb8-9e77051fa126 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:43.255905 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f3fdac-d982-407f-8f21-0d0c2a958f06 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:43.273311 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44091967-43e4-40c5-aeb8-9e77051fa126 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:43.287379 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f706e0-988b-4f2e-b0c9-4c8f423f2405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:43.288069 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f706e0-988b-4f2e-b0c9-4c8f423f2405 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:43.288346 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f706e0-988b-4f2e-b0c9-4c8f423f2405 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:43.288615 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f706e0-988b-4f2e-b0c9-4c8f423f2405 None admin] PATH_INFO: `/v3/projects` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:43.289391 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f706e0-988b-4f2e-b0c9-4c8f423f2405 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:43.289693 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f706e0-988b-4f2e-b0c9-4c8f423f2405 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:43.291189 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f706e0-988b-4f2e-b0c9-4c8f423f2405 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:43.307949 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 271/526] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Mar 30 07:02:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:43.307949 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f706e0-988b-4f2e-b0c9-4c8f423f2405 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:43.310860 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552efb3a-d13c-44b9-a330-18171bf99500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:43.311513 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552efb3a-d13c-44b9-a330-18171bf99500 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:43.311787 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552efb3a-d13c-44b9-a330-18171bf99500 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:43.312075 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552efb3a-d13c-44b9-a330-18171bf99500 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:43.312899 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552efb3a-d13c-44b9-a330-18171bf99500 None admin] RBAC: Adding query filter params (role.id=4848e2a52e0b428997632ab8a8d36e91, scope.project.id=7e4eda4c5cd84307b36a5b48642e816f, user.id=72b398c5ed14484d8b7a51fee900597b) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:43.313198 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552efb3a-d13c-44b9-a330-18171bf99500 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:43.314634 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552efb3a-d13c-44b9-a330-18171bf99500 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:43.320308 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 256/527] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Mar 30 07:02:43 2022] GET /identity/v3/role_assignments?user.id=72b398c5ed14484d8b7a51fee900597b&scope.project.id=7e4eda4c5cd84307b36a5b48642e816f&role.id=4848e2a52e0b428997632ab8a8d36e91 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:43.321090 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552efb3a-d13c-44b9-a330-18171bf99500 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:43.438667 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f706e0-988b-4f2e-b0c9-4c8f423f2405 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:43.447796 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552efb3a-d13c-44b9-a330-18171bf99500 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:43.474090 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f07debc-d7aa-4246-9177-8be1b2dc52d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:43.474910 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f07debc-d7aa-4246-9177-8be1b2dc52d0 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:43.475187 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f07debc-d7aa-4246-9177-8be1b2dc52d0 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:43.475456 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f07debc-d7aa-4246-9177-8be1b2dc52d0 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:43.483923 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f07debc-d7aa-4246-9177-8be1b2dc52d0 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:43.485415 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f07debc-d7aa-4246-9177-8be1b2dc52d0 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:43.486767 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bbe0e4-34cd-4d52-8153-c3efc29bfd7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:43.487653 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bbe0e4-34cd-4d52-8153-c3efc29bfd7d None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:43.488043 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bbe0e4-34cd-4d52-8153-c3efc29bfd7d None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:43.488383 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bbe0e4-34cd-4d52-8153-c3efc29bfd7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:43.500196 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bbe0e4-34cd-4d52-8153-c3efc29bfd7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:43.501119 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-4f07debc-d7aa-4246-9177-8be1b2dc52d0 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Mar 30 07:02:43.501868 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bbe0e4-34cd-4d52-8153-c3efc29bfd7d None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:43.502752 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 272/528] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Mar 30 07:02:43 2022] GET /identity/v3/users/neutron => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:02:43.503636 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f07debc-d7aa-4246-9177-8be1b2dc52d0 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:43.527039 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-08bbe0e4-34cd-4d52-8153-c3efc29bfd7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 07:02:43.529557 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 257/529] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:02:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:02:43.530535 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bbe0e4-34cd-4d52-8153-c3efc29bfd7d None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:43.620565 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f07debc-d7aa-4246-9177-8be1b2dc52d0 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:43.635594 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bbe0e4-34cd-4d52-8153-c3efc29bfd7d None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:43.657543 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b948b87-68b0-4448-a1ca-e9c5c95c42b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:43.658356 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b948b87-68b0-4448-a1ca-e9c5c95c42b2 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:43.658728 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b948b87-68b0-4448-a1ca-e9c5c95c42b2 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:43.659089 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b948b87-68b0-4448-a1ca-e9c5c95c42b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:43.660050 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b948b87-68b0-4448-a1ca-e9c5c95c42b2 None admin] RBAC: Adding query filter params (role.id=4848e2a52e0b428997632ab8a8d36e91, scope.project.id=7e4eda4c5cd84307b36a5b48642e816f, user.id=5e2fda180e8d448d895c40cdad34bc4c) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:43.660453 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b948b87-68b0-4448-a1ca-e9c5c95c42b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:43.662021 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b948b87-68b0-4448-a1ca-e9c5c95c42b2 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:43.668465 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 273/530] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Mar 30 07:02:43 2022] GET /identity/v3/role_assignments?user.id=5e2fda180e8d448d895c40cdad34bc4c&scope.project.id=7e4eda4c5cd84307b36a5b48642e816f&role.id=4848e2a52e0b428997632ab8a8d36e91 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:43.669416 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b948b87-68b0-4448-a1ca-e9c5c95c42b2 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:43.690727 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81060d62-0fa8-43fc-b622-873a62466c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:43.695844 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81060d62-0fa8-43fc-b622-873a62466c62 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:43.695844 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81060d62-0fa8-43fc-b622-873a62466c62 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:43.695844 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81060d62-0fa8-43fc-b622-873a62466c62 None admin] PATH_INFO: `/v3/users` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:43.695844 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81060d62-0fa8-43fc-b622-873a62466c62 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:43.695844 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81060d62-0fa8-43fc-b622-873a62466c62 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:43.696769 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81060d62-0fa8-43fc-b622-873a62466c62 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:43.743123 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 258/531] 10.222.0.20 () {56 vars in 1139 bytes} [Wed Mar 30 07:02:43 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:43.756802 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81060d62-0fa8-43fc-b622-873a62466c62 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:43.877027 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b948b87-68b0-4448-a1ca-e9c5c95c42b2 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:43.916081 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467b0473-ecf2-43fc-889f-6947f0007470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:43.917667 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467b0473-ecf2-43fc-889f-6947f0007470 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:43.918155 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467b0473-ecf2-43fc-889f-6947f0007470 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:43.918625 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467b0473-ecf2-43fc-889f-6947f0007470 None admin] PATH_INFO: `/v3/domains` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:43.919947 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467b0473-ecf2-43fc-889f-6947f0007470 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:43.920457 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467b0473-ecf2-43fc-889f-6947f0007470 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:43.922397 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467b0473-ecf2-43fc-889f-6947f0007470 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:43.935588 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 274/532] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Mar 30 07:02:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:43.942387 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467b0473-ecf2-43fc-889f-6947f0007470 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:43.946793 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81060d62-0fa8-43fc-b622-873a62466c62 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:43.991245 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b09edc-ca20-4f2d-bbe3-4a6afb29a015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:43.991913 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b09edc-ca20-4f2d-bbe3-4a6afb29a015 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:43.992194 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b09edc-ca20-4f2d-bbe3-4a6afb29a015 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:43.992466 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b09edc-ca20-4f2d-bbe3-4a6afb29a015 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:44.044818 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467b0473-ecf2-43fc-889f-6947f0007470 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:44.079598 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeb5e65-4548-4111-81c3-f70c89955ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:44.080817 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb5e65-4548-4111-81c3-f70c89955ceb None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:44.081298 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb5e65-4548-4111-81c3-f70c89955ceb None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:44.081761 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb5e65-4548-4111-81c3-f70c89955ceb None admin] PATH_INFO: `/v3/projects/service` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:44.089728 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeb5e65-4548-4111-81c3-f70c89955ceb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:44.091488 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeb5e65-4548-4111-81c3-f70c89955ceb None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:44.106197 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-efeb5e65-4548-4111-81c3-f70c89955ceb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 30 07:02:44.108067 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 275/533] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Mar 30 07:02:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:02:44.113770 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeb5e65-4548-4111-81c3-f70c89955ceb None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:44.164501 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b09edc-ca20-4f2d-bbe3-4a6afb29a015 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:44.165981 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b09edc-ca20-4f2d-bbe3-4a6afb29a015 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:44.221092 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeb5e65-4548-4111-81c3-f70c89955ceb None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:44.265894 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2229dd-5a37-4fa5-b754-8304a47007dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:44.266929 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2229dd-5a37-4fa5-b754-8304a47007dd None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:44.267454 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2229dd-5a37-4fa5-b754-8304a47007dd None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:44.267963 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2229dd-5a37-4fa5-b754-8304a47007dd None admin] PATH_INFO: `/v3/projects` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:44.268985 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2229dd-5a37-4fa5-b754-8304a47007dd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:44.269478 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2229dd-5a37-4fa5-b754-8304a47007dd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:44.271185 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2229dd-5a37-4fa5-b754-8304a47007dd None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:44.281709 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 259/534] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Mar 30 07:02:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 30 07:02:44.288783 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b09edc-ca20-4f2d-bbe3-4a6afb29a015 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:44.295108 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 276/535] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Mar 30 07:02:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:02:44.297238 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2229dd-5a37-4fa5-b754-8304a47007dd None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:44.392250 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b09edc-ca20-4f2d-bbe3-4a6afb29a015 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:44.394186 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2229dd-5a37-4fa5-b754-8304a47007dd None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:44.427738 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8432f04-1a45-43c9-9208-50d0fe0f1ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:44.428972 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8432f04-1a45-43c9-9208-50d0fe0f1ccf None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:44.429511 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8432f04-1a45-43c9-9208-50d0fe0f1ccf None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:44.429971 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8432f04-1a45-43c9-9208-50d0fe0f1ccf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:44.431001 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8432f04-1a45-43c9-9208-50d0fe0f1ccf None admin] RBAC: Adding query filter params (role.id=4848e2a52e0b428997632ab8a8d36e91, scope.project.id=7e4eda4c5cd84307b36a5b48642e816f, user.id=e880ade912f3412abf44ba73939d6e50) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:44.431520 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8432f04-1a45-43c9-9208-50d0fe0f1ccf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:44.433712 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8432f04-1a45-43c9-9208-50d0fe0f1ccf None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:44.437793 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2093d55d-ded7-40dc-a334-9c15ed9e7e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:44.438580 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093d55d-ded7-40dc-a334-9c15ed9e7e49 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:44.438855 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093d55d-ded7-40dc-a334-9c15ed9e7e49 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:44.439123 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093d55d-ded7-40dc-a334-9c15ed9e7e49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:44.448082 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 277/536] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Mar 30 07:02:44 2022] GET /identity/v3/role_assignments?user.id=e880ade912f3412abf44ba73939d6e50&scope.project.id=7e4eda4c5cd84307b36a5b48642e816f&role.id=4848e2a52e0b428997632ab8a8d36e91 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:02:44.463191 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2093d55d-ded7-40dc-a334-9c15ed9e7e49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:44.472949 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2093d55d-ded7-40dc-a334-9c15ed9e7e49 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:44.497558 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-2093d55d-ded7-40dc-a334-9c15ed9e7e49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 07:02:44.499072 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 260/537] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:02:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:02:44.505146 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8432f04-1a45-43c9-9208-50d0fe0f1ccf None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:44.638447 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8432f04-1a45-43c9-9208-50d0fe0f1ccf None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:44.675416 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f931ab6-9444-48ca-b9b5-300fee93b3d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:44.676966 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f931ab6-9444-48ca-b9b5-300fee93b3d2 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:44.677435 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f931ab6-9444-48ca-b9b5-300fee93b3d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:44.677890 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f931ab6-9444-48ca-b9b5-300fee93b3d2 None admin] PATH_INFO: `/v3/domains` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:44.678807 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f931ab6-9444-48ca-b9b5-300fee93b3d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:44.679416 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f931ab6-9444-48ca-b9b5-300fee93b3d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:44.681084 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f931ab6-9444-48ca-b9b5-300fee93b3d2 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:44.695922 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 278/538] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Mar 30 07:02:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:44.701748 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2093d55d-ded7-40dc-a334-9c15ed9e7e49 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:44.826424 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2093d55d-ded7-40dc-a334-9c15ed9e7e49 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:44.859298 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37ab2c0-330c-4936-af2e-ed547f093284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:44.860127 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ab2c0-330c-4936-af2e-ed547f093284 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:44.860410 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ab2c0-330c-4936-af2e-ed547f093284 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:44.860685 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ab2c0-330c-4936-af2e-ed547f093284 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:44.867843 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37ab2c0-330c-4936-af2e-ed547f093284 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:44.869374 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37ab2c0-330c-4936-af2e-ed547f093284 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:44.882956 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-b37ab2c0-330c-4936-af2e-ed547f093284 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 30 07:02:44.884586 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 261/539] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Mar 30 07:02:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:02:44.890455 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f931ab6-9444-48ca-b9b5-300fee93b3d2 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:45.039326 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f931ab6-9444-48ca-b9b5-300fee93b3d2 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:45.089359 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cedd2c-565a-4b6d-84b0-0717273fa576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:45.089953 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cedd2c-565a-4b6d-84b0-0717273fa576 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:45.090233 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cedd2c-565a-4b6d-84b0-0717273fa576 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:45.090506 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cedd2c-565a-4b6d-84b0-0717273fa576 None admin] PATH_INFO: `/v3/projects` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:45.091293 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cedd2c-565a-4b6d-84b0-0717273fa576 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:45.091598 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cedd2c-565a-4b6d-84b0-0717273fa576 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:45.093070 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cedd2c-565a-4b6d-84b0-0717273fa576 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:45.109193 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 279/540] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Mar 30 07:02:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:45.115643 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37ab2c0-330c-4936-af2e-ed547f093284 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:45.181782 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e822379d-997b-4e59-9b38-ffdc50df525b None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:45.182789 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e822379d-997b-4e59-9b38-ffdc50df525b None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:45.183284 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e822379d-997b-4e59-9b38-ffdc50df525b None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:45.185596 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 280/541] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:02:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 30 07:02:45.190805 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f4f49f-5038-4e07-a426-1f5745f313e6 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:45.191481 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f4f49f-5038-4e07-a426-1f5745f313e6 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:45.192058 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f4f49f-5038-4e07-a426-1f5745f313e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:45.223741 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-a3f4f49f-5038-4e07-a426-1f5745f313e6 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:02:45.224967 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-a3f4f49f-5038-4e07-a426-1f5745f313e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:02:45.312786 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37ab2c0-330c-4936-af2e-ed547f093284 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:45.317041 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 281/542] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:02:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 30 07:02:45.341544 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f4f49f-5038-4e07-a426-1f5745f313e6 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:45.358869 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac640abf-1b23-4ed3-ab8d-bdc681033752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:45.359857 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac640abf-1b23-4ed3-ab8d-bdc681033752 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:45.361404 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac640abf-1b23-4ed3-ab8d-bdc681033752 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:45.362033 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac640abf-1b23-4ed3-ab8d-bdc681033752 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:45.363872 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac640abf-1b23-4ed3-ab8d-bdc681033752 None admin] RBAC: Adding query filter params (role.id=4848e2a52e0b428997632ab8a8d36e91, scope.project.id=7e4eda4c5cd84307b36a5b48642e816f, user.id=54f3802cb341445f994b9204744060ae) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:45.364556 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac640abf-1b23-4ed3-ab8d-bdc681033752 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:45.367339 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac640abf-1b23-4ed3-ab8d-bdc681033752 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:45.380543 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 262/543] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Mar 30 07:02:45 2022] GET /identity/v3/role_assignments?user.id=54f3802cb341445f994b9204744060ae&scope.project.id=7e4eda4c5cd84307b36a5b48642e816f&role.id=4848e2a52e0b428997632ab8a8d36e91 => generated 259 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:45.498667 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f4f49f-5038-4e07-a426-1f5745f313e6 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:45.555052 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a005ed3-6a83-426d-a799-4ebde63018ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:45.555983 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a005ed3-6a83-426d-a799-4ebde63018ee None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:45.556272 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a005ed3-6a83-426d-a799-4ebde63018ee None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:45.556555 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a005ed3-6a83-426d-a799-4ebde63018ee None admin] PATH_INFO: `/v3/roles/service` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:45.578048 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a005ed3-6a83-426d-a799-4ebde63018ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 07:02:45.585603 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-4a005ed3-6a83-426d-a799-4ebde63018ee None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 30 07:02:45.587337 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 282/544] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Mar 30 07:02:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:02:45.593845 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac640abf-1b23-4ed3-ab8d-bdc681033752 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:45.709221 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac640abf-1b23-4ed3-ab8d-bdc681033752 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:45.745748 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bb9b66-ae73-4fe9-9fba-19f2b1eead18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:45.746830 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb9b66-ae73-4fe9-9fba-19f2b1eead18 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:45.747323 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb9b66-ae73-4fe9-9fba-19f2b1eead18 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:45.747887 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb9b66-ae73-4fe9-9fba-19f2b1eead18 None admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:45.748868 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bb9b66-ae73-4fe9-9fba-19f2b1eead18 None admin] RBAC: Adding query filter params (name=service) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:45.749383 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bb9b66-ae73-4fe9-9fba-19f2b1eead18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:45.750981 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bb9b66-ae73-4fe9-9fba-19f2b1eead18 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:45.760281 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 263/545] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Mar 30 07:02:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:45.766212 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a005ed3-6a83-426d-a799-4ebde63018ee None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:45.876548 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a005ed3-6a83-426d-a799-4ebde63018ee None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:45.921471 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15c6dbb-cda5-4613-9545-d57cb6fba403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:45.922686 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15c6dbb-cda5-4613-9545-d57cb6fba403 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:45.923176 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15c6dbb-cda5-4613-9545-d57cb6fba403 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:45.923648 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15c6dbb-cda5-4613-9545-d57cb6fba403 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:45.941592 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15c6dbb-cda5-4613-9545-d57cb6fba403 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:45.943608 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15c6dbb-cda5-4613-9545-d57cb6fba403 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:45.963382 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-c15c6dbb-cda5-4613-9545-d57cb6fba403 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 07:02:45.965394 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 283/546] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:02:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:02:45.971102 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bb9b66-ae73-4fe9-9fba-19f2b1eead18 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:46.075694 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bb9b66-ae73-4fe9-9fba-19f2b1eead18 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:46.109713 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500ae7e6-f25a-41c5-aefa-11905a320745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:46.111205 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ae7e6-f25a-41c5-aefa-11905a320745 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:46.111688 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ae7e6-f25a-41c5-aefa-11905a320745 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:46.112187 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ae7e6-f25a-41c5-aefa-11905a320745 None admin] PATH_INFO: `/v3/domains` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:46.113110 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500ae7e6-f25a-41c5-aefa-11905a320745 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:46.113613 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500ae7e6-f25a-41c5-aefa-11905a320745 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:46.115207 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500ae7e6-f25a-41c5-aefa-11905a320745 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:46.128105 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 264/547] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Mar 30 07:02:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:46.137706 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15c6dbb-cda5-4613-9545-d57cb6fba403 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:46.271394 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15c6dbb-cda5-4613-9545-d57cb6fba403 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:46.280576 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3e2785-25b8-4fda-9bcf-762745ce5d61 None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:46.281145 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3e2785-25b8-4fda-9bcf-762745ce5d61 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:46.281620 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3e2785-25b8-4fda-9bcf-762745ce5d61 None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:46.287485 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 265/548] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:02:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:02:46.288866 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce2fbd-cdc4-49dc-aa3c-176b54e45e3d None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:46.289353 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce2fbd-cdc4-49dc-aa3c-176b54e45e3d None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:46.289827 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce2fbd-cdc4-49dc-aa3c-176b54e45e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:46.304941 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973cda92-bb28-42a4-9076-83e9a88e65c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:46.306124 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973cda92-bb28-42a4-9076-83e9a88e65c9 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:46.307291 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973cda92-bb28-42a4-9076-83e9a88e65c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:46.307568 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973cda92-bb28-42a4-9076-83e9a88e65c9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:46.316664 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973cda92-bb28-42a4-9076-83e9a88e65c9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:46.318392 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973cda92-bb28-42a4-9076-83e9a88e65c9 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:46.324817 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-55ce2fbd-cdc4-49dc-aa3c-176b54e45e3d None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:02:46.326014 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-55ce2fbd-cdc4-49dc-aa3c-176b54e45e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:02:46.333729 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-973cda92-bb28-42a4-9076-83e9a88e65c9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Mar 30 07:02:46.335441 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 284/549] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Mar 30 07:02:46 2022] GET /identity/v3/users/swift => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:02:46.341060 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973cda92-bb28-42a4-9076-83e9a88e65c9 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:46.407156 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 266/550] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:02:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 07:02:46.429755 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ce2fbd-cdc4-49dc-aa3c-176b54e45e3d None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:46.504657 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973cda92-bb28-42a4-9076-83e9a88e65c9 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:46.546518 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a07a3ad-3b09-482e-8ec1-4aaacd26bbc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:46.547468 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a07a3ad-3b09-482e-8ec1-4aaacd26bbc0 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:46.547750 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a07a3ad-3b09-482e-8ec1-4aaacd26bbc0 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:46.548214 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a07a3ad-3b09-482e-8ec1-4aaacd26bbc0 None admin] PATH_INFO: `/v3/users` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:46.549497 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a07a3ad-3b09-482e-8ec1-4aaacd26bbc0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:46.549928 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a07a3ad-3b09-482e-8ec1-4aaacd26bbc0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:46.551345 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ce2fbd-cdc4-49dc-aa3c-176b54e45e3d None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:46.551467 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a07a3ad-3b09-482e-8ec1-4aaacd26bbc0 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:46.584902 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa12142-48c9-44f7-9a33-61825804acd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:46.585704 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa12142-48c9-44f7-9a33-61825804acd3 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:46.585981 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa12142-48c9-44f7-9a33-61825804acd3 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:46.586250 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa12142-48c9-44f7-9a33-61825804acd3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:46.596586 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa12142-48c9-44f7-9a33-61825804acd3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 07:02:46.598591 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 285/551] 10.222.0.20 () {56 vars in 1135 bytes} [Wed Mar 30 07:02:46 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:46.600027 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d3d3f-283f-4b7c-b525-5c1d36bedbb0 None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:46.600318 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d3d3f-283f-4b7c-b525-5c1d36bedbb0 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:46.600594 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d3d3f-283f-4b7c-b525-5c1d36bedbb0 None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:46.606736 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 286/552] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:02:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:02:46.607571 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362d3d3f-283f-4b7c-b525-5c1d36bedbb0 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:46.608094 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-8fa12142-48c9-44f7-9a33-61825804acd3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 30 07:02:46.609566 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 267/553] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Mar 30 07:02:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:02:46.610761 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a2efb-c038-4d6d-82f2-125129280b26 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:46.611407 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a2efb-c038-4d6d-82f2-125129280b26 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:46.611677 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a2efb-c038-4d6d-82f2-125129280b26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:46.633680 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-6f0a2efb-c038-4d6d-82f2-125129280b26 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:02:46.634928 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-6f0a2efb-c038-4d6d-82f2-125129280b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:02:46.710276 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 268/554] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:02:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 07:02:46.711051 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0a2efb-c038-4d6d-82f2-125129280b26 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:46.728803 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362d3d3f-283f-4b7c-b525-5c1d36bedbb0 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:46.766775 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b44025-a167-4eba-b9f3-46a53b89330b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:46.767452 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b44025-a167-4eba-b9f3-46a53b89330b None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:46.767794 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b44025-a167-4eba-b9f3-46a53b89330b None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:46.768088 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b44025-a167-4eba-b9f3-46a53b89330b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:46.835237 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b44025-a167-4eba-b9f3-46a53b89330b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:46.836703 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b44025-a167-4eba-b9f3-46a53b89330b None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:46.841218 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0a2efb-c038-4d6d-82f2-125129280b26 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:46.875310 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96323d1-ae6a-4efb-a5d9-bcbf269b71de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:46.876005 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96323d1-ae6a-4efb-a5d9-bcbf269b71de None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:46.876282 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96323d1-ae6a-4efb-a5d9-bcbf269b71de None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:46.876852 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96323d1-ae6a-4efb-a5d9-bcbf269b71de None admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:46.877285 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96323d1-ae6a-4efb-a5d9-bcbf269b71de None admin] RBAC: Adding query filter params (name=service) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:46.877581 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96323d1-ae6a-4efb-a5d9-bcbf269b71de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:46.878964 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96323d1-ae6a-4efb-a5d9-bcbf269b71de None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:46.887302 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 269/555] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Mar 30 07:02:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:46.892425 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96323d1-ae6a-4efb-a5d9-bcbf269b71de None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:46.939237 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 287/556] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Mar 30 07:02:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 30 07:02:46.940711 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b44025-a167-4eba-b9f3-46a53b89330b None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:46.998036 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96323d1-ae6a-4efb-a5d9-bcbf269b71de None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:47.031399 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84e8e10-1b32-4ef8-b872-62820a7d7b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:47.032311 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84e8e10-1b32-4ef8-b872-62820a7d7b52 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:47.032605 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84e8e10-1b32-4ef8-b872-62820a7d7b52 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:47.032888 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84e8e10-1b32-4ef8-b872-62820a7d7b52 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:47.042408 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b44025-a167-4eba-b9f3-46a53b89330b None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:47.043227 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84e8e10-1b32-4ef8-b872-62820a7d7b52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 07:02:47.050553 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-b84e8e10-1b32-4ef8-b872-62820a7d7b52 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 30 07:02:47.051657 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 270/557] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Mar 30 07:02:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:02:47.052244 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84e8e10-1b32-4ef8-b872-62820a7d7b52 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:47.081190 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89be504a-e19c-4107-a942-3b13b2e78b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:47.082382 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89be504a-e19c-4107-a942-3b13b2e78b03 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:47.082877 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89be504a-e19c-4107-a942-3b13b2e78b03 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:47.083350 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89be504a-e19c-4107-a942-3b13b2e78b03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:47.093718 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89be504a-e19c-4107-a942-3b13b2e78b03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:47.095185 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89be504a-e19c-4107-a942-3b13b2e78b03 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:47.113271 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-89be504a-e19c-4107-a942-3b13b2e78b03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 07:02:47.114442 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 288/558] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:02:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:02:47.115274 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89be504a-e19c-4107-a942-3b13b2e78b03 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:47.152901 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84e8e10-1b32-4ef8-b872-62820a7d7b52 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:47.186334 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a83d55-6f95-40fa-800e-c1b46c718a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:47.187131 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a83d55-6f95-40fa-800e-c1b46c718a2b None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:47.187410 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a83d55-6f95-40fa-800e-c1b46c718a2b None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:47.187677 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a83d55-6f95-40fa-800e-c1b46c718a2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:47.198265 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a83d55-6f95-40fa-800e-c1b46c718a2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:47.199836 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a83d55-6f95-40fa-800e-c1b46c718a2b None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:47.216993 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-a5a83d55-6f95-40fa-800e-c1b46c718a2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 07:02:47.222900 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 271/559] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:02:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:02:47.223028 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89be504a-e19c-4107-a942-3b13b2e78b03 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:47.223123 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b610d-2c81-4070-98ef-1d5225346a5d None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:47.223123 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b610d-2c81-4070-98ef-1d5225346a5d None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:47.223123 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b610d-2c81-4070-98ef-1d5225346a5d None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:47.223123 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 272/560] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:02:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:02:47.223123 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3b610d-2c81-4070-98ef-1d5225346a5d None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:47.257565 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef51529-24bc-4b8b-b4ab-954c670d171a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:47.258155 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef51529-24bc-4b8b-b4ab-954c670d171a None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:47.258428 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef51529-24bc-4b8b-b4ab-954c670d171a None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:47.258697 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef51529-24bc-4b8b-b4ab-954c670d171a None admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:47.259432 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef51529-24bc-4b8b-b4ab-954c670d171a None admin] RBAC: Adding query filter params (name=service) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:47.259971 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef51529-24bc-4b8b-b4ab-954c670d171a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:47.261207 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef51529-24bc-4b8b-b4ab-954c670d171a None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:47.269252 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 289/561] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Mar 30 07:02:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:47.270429 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef51529-24bc-4b8b-b4ab-954c670d171a None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:47.330284 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3b610d-2c81-4070-98ef-1d5225346a5d None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:47.363752 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2590f9-870d-45b4-b594-54f61828aee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:47.364440 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2590f9-870d-45b4-b594-54f61828aee8 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:47.364719 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2590f9-870d-45b4-b594-54f61828aee8 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:47.364991 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2590f9-870d-45b4-b594-54f61828aee8 None admin] PATH_INFO: `/v3/domains` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:47.365717 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2590f9-870d-45b4-b594-54f61828aee8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:47.366014 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2590f9-870d-45b4-b594-54f61828aee8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:47.367389 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2590f9-870d-45b4-b594-54f61828aee8 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:47.368109 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef51529-24bc-4b8b-b4ab-954c670d171a None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:47.379282 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 273/562] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Mar 30 07:02:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:47.380571 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8dd211-1ba6-408d-9c3f-df18006787e7 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:47.380858 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8dd211-1ba6-408d-9c3f-df18006787e7 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:47.381133 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8dd211-1ba6-408d-9c3f-df18006787e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:47.397809 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-1e8dd211-1ba6-408d-9c3f-df18006787e7 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:02:47.398986 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-1e8dd211-1ba6-408d-9c3f-df18006787e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:02:47.406537 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdf13fb-60ac-4711-9aab-872d874a40e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:47.407297 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf13fb-60ac-4711-9aab-872d874a40e9 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:47.407575 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf13fb-60ac-4711-9aab-872d874a40e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:47.407879 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf13fb-60ac-4711-9aab-872d874a40e9 None admin] PATH_INFO: `/v3/domains` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:47.408602 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdf13fb-60ac-4711-9aab-872d874a40e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:47.408906 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdf13fb-60ac-4711-9aab-872d874a40e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:47.410731 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdf13fb-60ac-4711-9aab-872d874a40e9 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:47.423079 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 290/563] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Mar 30 07:02:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:47.424258 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdf13fb-60ac-4711-9aab-872d874a40e9 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:47.475877 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 274/564] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:02:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 07:02:47.475877 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8dd211-1ba6-408d-9c3f-df18006787e7 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:47.532755 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdf13fb-60ac-4711-9aab-872d874a40e9 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:47.566702 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e394399-2f02-4dda-bc8d-472473cb60fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:47.567569 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e394399-2f02-4dda-bc8d-472473cb60fe None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:47.567853 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e394399-2f02-4dda-bc8d-472473cb60fe None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:47.568151 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e394399-2f02-4dda-bc8d-472473cb60fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:47.578309 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e394399-2f02-4dda-bc8d-472473cb60fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:47.578751 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8dd211-1ba6-408d-9c3f-df18006787e7 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:47.579781 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e394399-2f02-4dda-bc8d-472473cb60fe None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:47.597050 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-9e394399-2f02-4dda-bc8d-472473cb60fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 07:02:47.602698 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 291/565] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:02:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:02:47.602698 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e394399-2f02-4dda-bc8d-472473cb60fe None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:47.619387 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef16a25-aa1e-44d0-950a-1d2f2969a3af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:47.620440 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef16a25-aa1e-44d0-950a-1d2f2969a3af None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:47.620712 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef16a25-aa1e-44d0-950a-1d2f2969a3af None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:47.620973 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef16a25-aa1e-44d0-950a-1d2f2969a3af None admin] PATH_INFO: `/v3/users/nova` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:47.628135 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef16a25-aa1e-44d0-950a-1d2f2969a3af None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:47.629578 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef16a25-aa1e-44d0-950a-1d2f2969a3af None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:47.643768 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-cef16a25-aa1e-44d0-950a-1d2f2969a3af None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 30 07:02:47.644977 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 275/566] 10.222.0.20 () {56 vars in 1093 bytes} [Wed Mar 30 07:02:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:02:47.645732 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef16a25-aa1e-44d0-950a-1d2f2969a3af None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:47.703892 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e394399-2f02-4dda-bc8d-472473cb60fe None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:47.736481 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c9c456-5225-4fcd-98e5-975aa2762398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:47.737297 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c9c456-5225-4fcd-98e5-975aa2762398 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:47.737574 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c9c456-5225-4fcd-98e5-975aa2762398 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:47.737840 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c9c456-5225-4fcd-98e5-975aa2762398 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:47.741809 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef16a25-aa1e-44d0-950a-1d2f2969a3af None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:47.746185 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c9c456-5225-4fcd-98e5-975aa2762398 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:47.747698 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c9c456-5225-4fcd-98e5-975aa2762398 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:47.761691 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-63c9c456-5225-4fcd-98e5-975aa2762398 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 30 07:02:47.767992 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 292/567] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Mar 30 07:02:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:02:47.767992 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c9c456-5225-4fcd-98e5-975aa2762398 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:47.778290 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bbe2a1-6a47-4de0-aae9-a6702812a2a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:47.779093 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bbe2a1-6a47-4de0-aae9-a6702812a2a5 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:47.779364 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bbe2a1-6a47-4de0-aae9-a6702812a2a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:47.779660 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bbe2a1-6a47-4de0-aae9-a6702812a2a5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:47.789737 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bbe2a1-6a47-4de0-aae9-a6702812a2a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 07:02:47.796859 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-a9bbe2a1-6a47-4de0-aae9-a6702812a2a5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 30 07:02:47.802680 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 276/568] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Mar 30 07:02:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:02:47.802680 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bbe2a1-6a47-4de0-aae9-a6702812a2a5 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:47.868402 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c9c456-5225-4fcd-98e5-975aa2762398 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:47.894762 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bbe2a1-6a47-4de0-aae9-a6702812a2a5 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:47.901098 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78751f4-577a-43d8-94e1-0cb32b69ad70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:47.901758 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78751f4-577a-43d8-94e1-0cb32b69ad70 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:47.902035 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78751f4-577a-43d8-94e1-0cb32b69ad70 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:47.902304 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78751f4-577a-43d8-94e1-0cb32b69ad70 None admin] PATH_INFO: `/v3/domains` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:47.903010 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78751f4-577a-43d8-94e1-0cb32b69ad70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:47.903306 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78751f4-577a-43d8-94e1-0cb32b69ad70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:47.904701 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78751f4-577a-43d8-94e1-0cb32b69ad70 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:47.916417 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 293/569] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Mar 30 07:02:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:47.917215 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78751f4-577a-43d8-94e1-0cb32b69ad70 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:47.928361 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d9299a-54ef-406a-9767-8272f1fe519b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:47.929035 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d9299a-54ef-406a-9767-8272f1fe519b None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:47.929314 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d9299a-54ef-406a-9767-8272f1fe519b None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:47.929660 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d9299a-54ef-406a-9767-8272f1fe519b None admin] PATH_INFO: `/v3/users` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:47.930408 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d9299a-54ef-406a-9767-8272f1fe519b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:47.930710 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d9299a-54ef-406a-9767-8272f1fe519b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:47.933585 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d9299a-54ef-406a-9767-8272f1fe519b None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:47.950810 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 277/570] 10.222.0.20 () {56 vars in 1133 bytes} [Wed Mar 30 07:02:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:47.952128 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d9299a-54ef-406a-9767-8272f1fe519b None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:48.017976 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78751f4-577a-43d8-94e1-0cb32b69ad70 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:48.048857 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d9299a-54ef-406a-9767-8272f1fe519b None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:48.051618 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92df9a8-2145-4743-ab44-f3f28cd69634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:48.052313 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92df9a8-2145-4743-ab44-f3f28cd69634 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:48.052595 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92df9a8-2145-4743-ab44-f3f28cd69634 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:48.052864 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92df9a8-2145-4743-ab44-f3f28cd69634 None admin] PATH_INFO: `/v3/projects` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:48.053642 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92df9a8-2145-4743-ab44-f3f28cd69634 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:48.053944 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92df9a8-2145-4743-ab44-f3f28cd69634 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:48.055380 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92df9a8-2145-4743-ab44-f3f28cd69634 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:48.067499 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 294/571] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Mar 30 07:02:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:48.068497 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92df9a8-2145-4743-ab44-f3f28cd69634 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:48.083589 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64278f9-7eb0-4fe2-96b1-9b79f2cb41e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:48.084292 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64278f9-7eb0-4fe2-96b1-9b79f2cb41e2 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:48.084571 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64278f9-7eb0-4fe2-96b1-9b79f2cb41e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:48.084841 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64278f9-7eb0-4fe2-96b1-9b79f2cb41e2 None admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:48.085583 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64278f9-7eb0-4fe2-96b1-9b79f2cb41e2 None admin] RBAC: Adding query filter params (name=service) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:48.085890 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64278f9-7eb0-4fe2-96b1-9b79f2cb41e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:48.087254 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64278f9-7eb0-4fe2-96b1-9b79f2cb41e2 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:48.095229 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 278/572] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Mar 30 07:02:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:48.096006 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64278f9-7eb0-4fe2-96b1-9b79f2cb41e2 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:48.163661 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92df9a8-2145-4743-ab44-f3f28cd69634 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:48.191385 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64278f9-7eb0-4fe2-96b1-9b79f2cb41e2 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:48.196642 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736d4fbd-c7c7-4e9f-afb8-758b50796f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:48.197574 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d4fbd-c7c7-4e9f-afb8-758b50796f7a None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:48.197852 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d4fbd-c7c7-4e9f-afb8-758b50796f7a None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:48.198125 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d4fbd-c7c7-4e9f-afb8-758b50796f7a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:48.207066 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736d4fbd-c7c7-4e9f-afb8-758b50796f7a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:48.207066 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736d4fbd-c7c7-4e9f-afb8-758b50796f7a None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:48.221069 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-736d4fbd-c7c7-4e9f-afb8-758b50796f7a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Mar 30 07:02:48.222296 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 295/573] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Mar 30 07:02:48 2022] GET /identity/v3/users/cinder => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:02:48.223067 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736d4fbd-c7c7-4e9f-afb8-758b50796f7a None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:48.229670 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7b5e64-1e7e-4d5e-a9e8-dda8d3bc0ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:48.230472 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7b5e64-1e7e-4d5e-a9e8-dda8d3bc0ec3 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:48.230755 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7b5e64-1e7e-4d5e-a9e8-dda8d3bc0ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:48.231019 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7b5e64-1e7e-4d5e-a9e8-dda8d3bc0ec3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:48.241803 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7b5e64-1e7e-4d5e-a9e8-dda8d3bc0ec3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:48.243282 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7b5e64-1e7e-4d5e-a9e8-dda8d3bc0ec3 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:48.259545 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-aa7b5e64-1e7e-4d5e-a9e8-dda8d3bc0ec3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 07:02:48.260722 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 279/574] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:02:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:02:48.261493 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7b5e64-1e7e-4d5e-a9e8-dda8d3bc0ec3 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:48.323103 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736d4fbd-c7c7-4e9f-afb8-758b50796f7a None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:48.358341 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4edfe31-a17b-4eb3-a8a9-dfc2cf77c5f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:48.358992 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4edfe31-a17b-4eb3-a8a9-dfc2cf77c5f1 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:48.359275 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4edfe31-a17b-4eb3-a8a9-dfc2cf77c5f1 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:48.359549 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4edfe31-a17b-4eb3-a8a9-dfc2cf77c5f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:48.360411 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4edfe31-a17b-4eb3-a8a9-dfc2cf77c5f1 None admin] RBAC: Adding query filter params (role.id=4848e2a52e0b428997632ab8a8d36e91, scope.project.id=7e4eda4c5cd84307b36a5b48642e816f, user.id=c452249c502d4b0688e8dd068f8c4951) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:48.360722 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4edfe31-a17b-4eb3-a8a9-dfc2cf77c5f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:48.362531 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4edfe31-a17b-4eb3-a8a9-dfc2cf77c5f1 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:48.364245 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7b5e64-1e7e-4d5e-a9e8-dda8d3bc0ec3 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:48.367850 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 296/575] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Mar 30 07:02:48 2022] GET /identity/v3/role_assignments?user.id=c452249c502d4b0688e8dd068f8c4951&scope.project.id=7e4eda4c5cd84307b36a5b48642e816f&role.id=4848e2a52e0b428997632ab8a8d36e91 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:48.369046 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b84a9e-5254-436c-9359-9ead6afd7bc6 None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:48.369379 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b84a9e-5254-436c-9359-9ead6afd7bc6 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:48.369652 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b84a9e-5254-436c-9359-9ead6afd7bc6 None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:48.371301 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 297/576] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:02:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:02:48.373118 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b84a9e-5254-436c-9359-9ead6afd7bc6 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:48.402283 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4e52e4-af4b-4f35-bf05-4d1aa2732dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:48.403099 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4e52e4-af4b-4f35-bf05-4d1aa2732dee None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:48.403380 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4e52e4-af4b-4f35-bf05-4d1aa2732dee None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:48.403639 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4e52e4-af4b-4f35-bf05-4d1aa2732dee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:48.415340 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4e52e4-af4b-4f35-bf05-4d1aa2732dee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:48.417051 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4e52e4-af4b-4f35-bf05-4d1aa2732dee None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:48.434932 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-bb4e52e4-af4b-4f35-bf05-4d1aa2732dee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 07:02:48.436554 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 280/577] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:02:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:02:48.437402 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4e52e4-af4b-4f35-bf05-4d1aa2732dee None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:48.492555 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b84a9e-5254-436c-9359-9ead6afd7bc6 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:48.541171 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2c423e-4632-4a54-8964-2697c4c24d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:48.542183 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2c423e-4632-4a54-8964-2697c4c24d3d None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:48.542479 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2c423e-4632-4a54-8964-2697c4c24d3d None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:48.542750 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2c423e-4632-4a54-8964-2697c4c24d3d None admin] PATH_INFO: `/v3/users` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:48.543607 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2c423e-4632-4a54-8964-2697c4c24d3d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:48.543945 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2c423e-4632-4a54-8964-2697c4c24d3d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:48.545477 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2c423e-4632-4a54-8964-2697c4c24d3d None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:48.555359 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4e52e4-af4b-4f35-bf05-4d1aa2732dee None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:48.564213 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 298/578] 10.222.0.20 () {56 vars in 1137 bytes} [Wed Mar 30 07:02:48 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:48.565826 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed81f35-4e1e-4d52-b80f-56e811778ac4 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:48.566335 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed81f35-4e1e-4d52-b80f-56e811778ac4 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:48.566828 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed81f35-4e1e-4d52-b80f-56e811778ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:48.587837 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-0ed81f35-4e1e-4d52-b80f-56e811778ac4 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:02:48.589168 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-0ed81f35-4e1e-4d52-b80f-56e811778ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:02:48.591101 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfa7560-bf80-4539-bcc3-a46fda93a1fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:48.591683 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfa7560-bf80-4539-bcc3-a46fda93a1fe None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:48.592633 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfa7560-bf80-4539-bcc3-a46fda93a1fe None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:48.592633 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfa7560-bf80-4539-bcc3-a46fda93a1fe None admin] PATH_INFO: `/v3/domains` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:48.593019 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfa7560-bf80-4539-bcc3-a46fda93a1fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:48.593321 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfa7560-bf80-4539-bcc3-a46fda93a1fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:48.594693 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfa7560-bf80-4539-bcc3-a46fda93a1fe None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:48.606814 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 281/579] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Mar 30 07:02:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:48.608720 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfa7560-bf80-4539-bcc3-a46fda93a1fe None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:48.656041 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 299/580] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:02:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 07:02:48.657064 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed81f35-4e1e-4d52-b80f-56e811778ac4 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:48.725884 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfa7560-bf80-4539-bcc3-a46fda93a1fe None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:48.755034 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed81f35-4e1e-4d52-b80f-56e811778ac4 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:48.758613 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33ed2f0-5b92-4efd-8f72-4a6cae988f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:48.759325 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33ed2f0-5b92-4efd-8f72-4a6cae988f0b None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:48.759603 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33ed2f0-5b92-4efd-8f72-4a6cae988f0b None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:48.759977 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33ed2f0-5b92-4efd-8f72-4a6cae988f0b None admin] PATH_INFO: `/v3/domains` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:48.760694 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33ed2f0-5b92-4efd-8f72-4a6cae988f0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:48.760993 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33ed2f0-5b92-4efd-8f72-4a6cae988f0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:48.762372 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33ed2f0-5b92-4efd-8f72-4a6cae988f0b None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:48.778321 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 282/581] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Mar 30 07:02:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:48.778321 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33ed2f0-5b92-4efd-8f72-4a6cae988f0b None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:48.794026 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707be614-5f21-497b-90e5-0dae840fdd6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:48.795430 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707be614-5f21-497b-90e5-0dae840fdd6b None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:48.795710 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707be614-5f21-497b-90e5-0dae840fdd6b None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:48.796126 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707be614-5f21-497b-90e5-0dae840fdd6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:48.806130 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707be614-5f21-497b-90e5-0dae840fdd6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:48.807689 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707be614-5f21-497b-90e5-0dae840fdd6b None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:48.824376 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-707be614-5f21-497b-90e5-0dae840fdd6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 07:02:48.826293 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 300/582] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:02:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:02:48.826983 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707be614-5f21-497b-90e5-0dae840fdd6b None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:48.882649 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33ed2f0-5b92-4efd-8f72-4a6cae988f0b None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:48.915055 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3c0e18-88aa-4486-b877-495bfa3b4976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:48.915986 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3c0e18-88aa-4486-b877-495bfa3b4976 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:48.916460 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3c0e18-88aa-4486-b877-495bfa3b4976 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:48.916808 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3c0e18-88aa-4486-b877-495bfa3b4976 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:48.923184 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3c0e18-88aa-4486-b877-495bfa3b4976 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:48.924418 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707be614-5f21-497b-90e5-0dae840fdd6b None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:48.924698 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3c0e18-88aa-4486-b877-495bfa3b4976 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:48.939099 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-6c3c0e18-88aa-4486-b877-495bfa3b4976 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 30 07:02:48.945069 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 283/583] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Mar 30 07:02:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:02:48.945069 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3c0e18-88aa-4486-b877-495bfa3b4976 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:48.956488 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0ebf09-7dbc-4ea5-963e-65c824d7c123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:48.957294 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ebf09-7dbc-4ea5-963e-65c824d7c123 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:48.957574 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ebf09-7dbc-4ea5-963e-65c824d7c123 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:48.957853 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ebf09-7dbc-4ea5-963e-65c824d7c123 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:48.968034 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0ebf09-7dbc-4ea5-963e-65c824d7c123 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 07:02:48.975000 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-2b0ebf09-7dbc-4ea5-963e-65c824d7c123 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 30 07:02:48.981914 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 301/584] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Mar 30 07:02:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:02:48.981914 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0ebf09-7dbc-4ea5-963e-65c824d7c123 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:49.039800 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3c0e18-88aa-4486-b877-495bfa3b4976 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:49.072031 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ba7c41-59c8-4f84-a339-4cc7b976593c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:49.073146 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ba7c41-59c8-4f84-a339-4cc7b976593c None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:49.073424 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ba7c41-59c8-4f84-a339-4cc7b976593c None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:49.073773 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ba7c41-59c8-4f84-a339-4cc7b976593c None admin] PATH_INFO: `/v3/users/glance` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:49.077140 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0ebf09-7dbc-4ea5-963e-65c824d7c123 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:49.080849 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ba7c41-59c8-4f84-a339-4cc7b976593c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:49.083766 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ba7c41-59c8-4f84-a339-4cc7b976593c None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:49.097978 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-f6ba7c41-59c8-4f84-a339-4cc7b976593c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Mar 30 07:02:49.103852 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 284/585] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Mar 30 07:02:48 2022] GET /identity/v3/users/glance => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:02:49.103852 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ba7c41-59c8-4f84-a339-4cc7b976593c None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:49.110321 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58195614-5082-4b32-b17e-ba6869975220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:49.111350 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58195614-5082-4b32-b17e-ba6869975220 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:49.111627 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58195614-5082-4b32-b17e-ba6869975220 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:49.111924 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58195614-5082-4b32-b17e-ba6869975220 None admin] PATH_INFO: `/v3/domains` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:49.112640 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58195614-5082-4b32-b17e-ba6869975220 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:49.112937 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58195614-5082-4b32-b17e-ba6869975220 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:49.114302 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58195614-5082-4b32-b17e-ba6869975220 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:49.130616 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 302/586] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Mar 30 07:02:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:49.130616 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58195614-5082-4b32-b17e-ba6869975220 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:49.210036 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ba7c41-59c8-4f84-a339-4cc7b976593c None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:49.233637 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58195614-5082-4b32-b17e-ba6869975220 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:49.243426 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22700d0f-b0cb-4aa5-b6d1-72940a986d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:49.244186 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22700d0f-b0cb-4aa5-b6d1-72940a986d2a None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:49.244458 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22700d0f-b0cb-4aa5-b6d1-72940a986d2a None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:49.244751 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22700d0f-b0cb-4aa5-b6d1-72940a986d2a None admin] PATH_INFO: `/v3/projects` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:49.245725 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22700d0f-b0cb-4aa5-b6d1-72940a986d2a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:49.246026 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22700d0f-b0cb-4aa5-b6d1-72940a986d2a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:49.247452 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22700d0f-b0cb-4aa5-b6d1-72940a986d2a None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:49.268169 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 285/587] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Mar 30 07:02:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:49.269276 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22700d0f-b0cb-4aa5-b6d1-72940a986d2a None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:49.269468 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9043f8c7-a582-47ce-9167-711cc622b36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:49.270322 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9043f8c7-a582-47ce-9167-711cc622b36a None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:49.270606 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9043f8c7-a582-47ce-9167-711cc622b36a None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:49.270879 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9043f8c7-a582-47ce-9167-711cc622b36a None admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:49.271622 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9043f8c7-a582-47ce-9167-711cc622b36a None admin] RBAC: Adding query filter params (name=service) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:49.271954 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9043f8c7-a582-47ce-9167-711cc622b36a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:49.273341 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9043f8c7-a582-47ce-9167-711cc622b36a None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:49.285975 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 303/588] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Mar 30 07:02:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:49.285975 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9043f8c7-a582-47ce-9167-711cc622b36a None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:49.370929 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22700d0f-b0cb-4aa5-b6d1-72940a986d2a None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:49.377156 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9043f8c7-a582-47ce-9167-711cc622b36a None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:49.406360 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d4c0fe-8eeb-4ba5-8e98-8ce1ca85c68c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:49.407367 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d4c0fe-8eeb-4ba5-8e98-8ce1ca85c68c None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:49.407656 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d4c0fe-8eeb-4ba5-8e98-8ce1ca85c68c None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:49.407966 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d4c0fe-8eeb-4ba5-8e98-8ce1ca85c68c None admin] PATH_INFO: `/v3/users` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:49.408799 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d4c0fe-8eeb-4ba5-8e98-8ce1ca85c68c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:49.409103 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d4c0fe-8eeb-4ba5-8e98-8ce1ca85c68c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:49.410558 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d4c0fe-8eeb-4ba5-8e98-8ce1ca85c68c None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:49.411187 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba25459-8579-4035-a800-5d8d91a9f83b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:49.412082 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba25459-8579-4035-a800-5d8d91a9f83b None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:49.412300 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba25459-8579-4035-a800-5d8d91a9f83b None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:49.412576 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba25459-8579-4035-a800-5d8d91a9f83b None admin] PATH_INFO: `/v3/projects/service` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:49.420056 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba25459-8579-4035-a800-5d8d91a9f83b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:49.421538 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba25459-8579-4035-a800-5d8d91a9f83b None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:49.432210 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 286/589] 10.222.0.20 () {56 vars in 1137 bytes} [Wed Mar 30 07:02:49 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:49.432210 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d4c0fe-8eeb-4ba5-8e98-8ce1ca85c68c None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:49.439948 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-7ba25459-8579-4035-a800-5d8d91a9f83b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 30 07:02:49.445780 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 304/590] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Mar 30 07:02:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:02:49.445780 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba25459-8579-4035-a800-5d8d91a9f83b None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:49.537396 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d4c0fe-8eeb-4ba5-8e98-8ce1ca85c68c None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:49.542520 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba25459-8579-4035-a800-5d8d91a9f83b None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:49.574759 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a460df0-47b3-42b6-9bc3-76b0221e1195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:49.575658 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a460df0-47b3-42b6-9bc3-76b0221e1195 None admin] REQUEST_METHOD: `PUT` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:49.575979 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a460df0-47b3-42b6-9bc3-76b0221e1195 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:49.576254 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a460df0-47b3-42b6-9bc3-76b0221e1195 None admin] PATH_INFO: `/v3/projects/7e4eda4c5cd84307b36a5b48642e816f/users/72b398c5ed14484d8b7a51fee900597b/roles/4848e2a52e0b428997632ab8a8d36e91` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:49.577164 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31a762b-e917-4c1e-b5f0-95491c1e3f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:49.578026 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a762b-e917-4c1e-b5f0-95491c1e3f73 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:49.578372 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a762b-e917-4c1e-b5f0-95491c1e3f73 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:49.578736 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a762b-e917-4c1e-b5f0-95491c1e3f73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:49.588600 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31a762b-e917-4c1e-b5f0-95491c1e3f73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:49.590211 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31a762b-e917-4c1e-b5f0-95491c1e3f73 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:49.591011 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a460df0-47b3-42b6-9bc3-76b0221e1195 None admin] RBAC: Authorizing `identity:create_grant(project_id=7e4eda4c5cd84307b36a5b48642e816f, user_id=72b398c5ed14484d8b7a51fee900597b, role_id=4848e2a52e0b428997632ab8a8d36e91)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:49.592517 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a460df0-47b3-42b6-9bc3-76b0221e1195 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:49.612179 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 287/591] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Mar 30 07:02:49 2022] PUT /identity/v3/projects/7e4eda4c5cd84307b36a5b48642e816f/users/72b398c5ed14484d8b7a51fee900597b/roles/4848e2a52e0b428997632ab8a8d36e91 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:02:49.612179 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a460df0-47b3-42b6-9bc3-76b0221e1195 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:49.612451 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-d31a762b-e917-4c1e-b5f0-95491c1e3f73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 07:02:49.612451 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 305/592] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:02:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:02:49.612451 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31a762b-e917-4c1e-b5f0-95491c1e3f73 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:49.720845 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a460df0-47b3-42b6-9bc3-76b0221e1195 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:49.723773 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31a762b-e917-4c1e-b5f0-95491c1e3f73 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:49.757966 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2050c3ba-1ce9-4b07-b2a9-d902bfa13e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:49.758913 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2050c3ba-1ce9-4b07-b2a9-d902bfa13e22 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:49.759478 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2050c3ba-1ce9-4b07-b2a9-d902bfa13e22 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:49.759650 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2050c3ba-1ce9-4b07-b2a9-d902bfa13e22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:49.760532 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9beb366-10da-4ddc-b54d-c011548af622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:49.761452 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9beb366-10da-4ddc-b54d-c011548af622 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:49.761876 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9beb366-10da-4ddc-b54d-c011548af622 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:49.762297 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9beb366-10da-4ddc-b54d-c011548af622 None admin] PATH_INFO: `/v3/projects` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:49.763276 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9beb366-10da-4ddc-b54d-c011548af622 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:49.763779 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9beb366-10da-4ddc-b54d-c011548af622 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:49.765480 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9beb366-10da-4ddc-b54d-c011548af622 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:49.771402 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2050c3ba-1ce9-4b07-b2a9-d902bfa13e22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:49.772960 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2050c3ba-1ce9-4b07-b2a9-d902bfa13e22 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:49.779256 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 306/593] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Mar 30 07:02:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:49.780488 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9beb366-10da-4ddc-b54d-c011548af622 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:49.791801 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-2050c3ba-1ce9-4b07-b2a9-d902bfa13e22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 07:02:49.793316 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 288/594] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:02:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:02:49.794116 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2050c3ba-1ce9-4b07-b2a9-d902bfa13e22 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:49.887760 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9beb366-10da-4ddc-b54d-c011548af622 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:49.897620 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2050c3ba-1ce9-4b07-b2a9-d902bfa13e22 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:49.922467 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72049edd-4b3a-4711-8298-90664512dffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:49.923605 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72049edd-4b3a-4711-8298-90664512dffa None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:49.924128 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72049edd-4b3a-4711-8298-90664512dffa None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:49.924617 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72049edd-4b3a-4711-8298-90664512dffa None admin] PATH_INFO: `/v3/domains` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:49.925544 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72049edd-4b3a-4711-8298-90664512dffa None admin] RBAC: Adding query filter params (name=Default) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:49.926082 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72049edd-4b3a-4711-8298-90664512dffa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:49.927646 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72049edd-4b3a-4711-8298-90664512dffa None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:49.932127 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6045addb-6c1c-499d-8099-9df0ca283218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:49.933265 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6045addb-6c1c-499d-8099-9df0ca283218 None admin] REQUEST_METHOD: `PUT` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:49.933544 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6045addb-6c1c-499d-8099-9df0ca283218 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:49.933816 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6045addb-6c1c-499d-8099-9df0ca283218 None admin] PATH_INFO: `/v3/projects/7e4eda4c5cd84307b36a5b48642e816f/users/5e2fda180e8d448d895c40cdad34bc4c/roles/4848e2a52e0b428997632ab8a8d36e91` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:49.942249 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 307/595] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Mar 30 07:02:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:49.943376 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72049edd-4b3a-4711-8298-90664512dffa None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:49.951134 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6045addb-6c1c-499d-8099-9df0ca283218 None admin] RBAC: Authorizing `identity:create_grant(project_id=7e4eda4c5cd84307b36a5b48642e816f, user_id=5e2fda180e8d448d895c40cdad34bc4c, role_id=4848e2a52e0b428997632ab8a8d36e91)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:49.953593 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6045addb-6c1c-499d-8099-9df0ca283218 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:49.976049 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 289/596] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Mar 30 07:02:49 2022] PUT /identity/v3/projects/7e4eda4c5cd84307b36a5b48642e816f/users/5e2fda180e8d448d895c40cdad34bc4c/roles/4848e2a52e0b428997632ab8a8d36e91 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:02:49.977048 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6045addb-6c1c-499d-8099-9df0ca283218 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:50.053640 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72049edd-4b3a-4711-8298-90664512dffa None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:50.091122 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feae2167-2d2f-4a13-834f-ab36cd46df2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:50.092221 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae2167-2d2f-4a13-834f-ab36cd46df2e None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:50.092731 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae2167-2d2f-4a13-834f-ab36cd46df2e None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:50.093204 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae2167-2d2f-4a13-834f-ab36cd46df2e None admin] PATH_INFO: `/v3/domains` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:50.094189 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feae2167-2d2f-4a13-834f-ab36cd46df2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:50.094703 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feae2167-2d2f-4a13-834f-ab36cd46df2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:50.096423 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feae2167-2d2f-4a13-834f-ab36cd46df2e None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:50.110209 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 308/597] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Mar 30 07:02:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:50.115759 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feae2167-2d2f-4a13-834f-ab36cd46df2e None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:50.234065 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6045addb-6c1c-499d-8099-9df0ca283218 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:50.235008 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feae2167-2d2f-4a13-834f-ab36cd46df2e None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:50.273748 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c757f3c-f489-4e41-8303-c0b5fdd6cfe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:50.274556 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c757f3c-f489-4e41-8303-c0b5fdd6cfe4 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:50.274831 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c757f3c-f489-4e41-8303-c0b5fdd6cfe4 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:50.275102 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c757f3c-f489-4e41-8303-c0b5fdd6cfe4 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:50.279415 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b635fce1-1fa6-4533-961f-e60e57482ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:50.280247 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b635fce1-1fa6-4533-961f-e60e57482ac7 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:50.280523 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b635fce1-1fa6-4533-961f-e60e57482ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:50.280790 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b635fce1-1fa6-4533-961f-e60e57482ac7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:50.283382 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c757f3c-f489-4e41-8303-c0b5fdd6cfe4 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:50.284916 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c757f3c-f489-4e41-8303-c0b5fdd6cfe4 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:50.288554 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b635fce1-1fa6-4533-961f-e60e57482ac7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:50.290034 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b635fce1-1fa6-4533-961f-e60e57482ac7 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:50.301672 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-6c757f3c-f489-4e41-8303-c0b5fdd6cfe4 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Mar 30 07:02:50.303205 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 290/598] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Mar 30 07:02:49 2022] GET /identity/v3/users/neutron => generated 85 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:02:50.305263 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-b635fce1-1fa6-4533-961f-e60e57482ac7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 30 07:02:50.306429 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 309/599] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Mar 30 07:02:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 07:02:50.312195 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b635fce1-1fa6-4533-961f-e60e57482ac7 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:50.312318 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c757f3c-f489-4e41-8303-c0b5fdd6cfe4 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:50.419561 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c757f3c-f489-4e41-8303-c0b5fdd6cfe4 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:50.442733 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b635fce1-1fa6-4533-961f-e60e57482ac7 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:50.454898 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67922b0b-5369-4d43-991d-ff03d49f3fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:50.455569 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67922b0b-5369-4d43-991d-ff03d49f3fc8 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:50.455864 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67922b0b-5369-4d43-991d-ff03d49f3fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:50.456137 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67922b0b-5369-4d43-991d-ff03d49f3fc8 None admin] PATH_INFO: `/v3/users` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:50.456961 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67922b0b-5369-4d43-991d-ff03d49f3fc8 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:50.457260 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67922b0b-5369-4d43-991d-ff03d49f3fc8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:50.458705 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67922b0b-5369-4d43-991d-ff03d49f3fc8 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:50.488855 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 291/600] 10.222.0.20 () {56 vars in 1139 bytes} [Wed Mar 30 07:02:50 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:50.491430 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38552a4e-452a-4092-81e0-e34516bd0ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:50.492128 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38552a4e-452a-4092-81e0-e34516bd0ddc None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:50.492401 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38552a4e-452a-4092-81e0-e34516bd0ddc None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:50.492665 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38552a4e-452a-4092-81e0-e34516bd0ddc None admin] PATH_INFO: `/v3/projects` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:50.493452 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38552a4e-452a-4092-81e0-e34516bd0ddc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:50.493750 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38552a4e-452a-4092-81e0-e34516bd0ddc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:50.496120 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67922b0b-5369-4d43-991d-ff03d49f3fc8 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:50.496693 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38552a4e-452a-4092-81e0-e34516bd0ddc None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:50.518273 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 310/601] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Mar 30 07:02:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:50.527581 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38552a4e-452a-4092-81e0-e34516bd0ddc None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:50.669384 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67922b0b-5369-4d43-991d-ff03d49f3fc8 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:50.685605 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38552a4e-452a-4092-81e0-e34516bd0ddc None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:50.722745 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b0da5e-ba50-4abd-860c-5865606b77b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:50.723548 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b0da5e-ba50-4abd-860c-5865606b77b0 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:50.723880 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b0da5e-ba50-4abd-860c-5865606b77b0 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:50.724114 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b0da5e-ba50-4abd-860c-5865606b77b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:50.744367 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b0da5e-ba50-4abd-860c-5865606b77b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:50.744580 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9736b3e-a9d4-4585-a548-61adaa6049ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:50.745358 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9736b3e-a9d4-4585-a548-61adaa6049ea None admin] REQUEST_METHOD: `PUT` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:50.745633 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9736b3e-a9d4-4585-a548-61adaa6049ea None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:50.745952 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9736b3e-a9d4-4585-a548-61adaa6049ea None admin] PATH_INFO: `/v3/projects/7e4eda4c5cd84307b36a5b48642e816f/users/e880ade912f3412abf44ba73939d6e50/roles/4848e2a52e0b428997632ab8a8d36e91` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:50.746062 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b0da5e-ba50-4abd-860c-5865606b77b0 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:50.760894 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9736b3e-a9d4-4585-a548-61adaa6049ea None admin] RBAC: Authorizing `identity:create_grant(project_id=7e4eda4c5cd84307b36a5b48642e816f, user_id=e880ade912f3412abf44ba73939d6e50, role_id=4848e2a52e0b428997632ab8a8d36e91)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:50.762425 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9736b3e-a9d4-4585-a548-61adaa6049ea None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:50.763266 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-e3b0da5e-ba50-4abd-860c-5865606b77b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 07:02:50.764805 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 292/602] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:02:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 07:02:50.766215 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e900e-f493-4f59-ac06-304563e4d44e None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:50.766505 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e900e-f493-4f59-ac06-304563e4d44e None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:50.766780 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e900e-f493-4f59-ac06-304563e4d44e None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:50.772701 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 293/603] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:02:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:02:50.773515 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127e900e-f493-4f59-ac06-304563e4d44e None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:50.783740 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 311/604] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Mar 30 07:02:50 2022] PUT /identity/v3/projects/7e4eda4c5cd84307b36a5b48642e816f/users/e880ade912f3412abf44ba73939d6e50/roles/4848e2a52e0b428997632ab8a8d36e91 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:02:50.785579 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dbd1ec-0c13-4460-97c7-dae49948790d None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:50.786101 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dbd1ec-0c13-4460-97c7-dae49948790d None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:50.786573 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dbd1ec-0c13-4460-97c7-dae49948790d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:50.805128 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-d9dbd1ec-0c13-4460-97c7-dae49948790d None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:02:50.806941 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-d9dbd1ec-0c13-4460-97c7-dae49948790d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:02:50.879030 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127e900e-f493-4f59-ac06-304563e4d44e None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:50.882311 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 312/605] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:02:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 07:02:50.923624 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6520fe-80a9-49e4-971c-35cd04196580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:50.924327 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6520fe-80a9-49e4-971c-35cd04196580 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:50.924689 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6520fe-80a9-49e4-971c-35cd04196580 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:50.925023 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6520fe-80a9-49e4-971c-35cd04196580 None admin] PATH_INFO: `/v3/domains` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:50.925816 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6520fe-80a9-49e4-971c-35cd04196580 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:50.926185 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6520fe-80a9-49e4-971c-35cd04196580 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:50.927742 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6520fe-80a9-49e4-971c-35cd04196580 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:50.933542 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dbd1ec-0c13-4460-97c7-dae49948790d None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:50.945427 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 294/606] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Mar 30 07:02:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:50.949719 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6520fe-80a9-49e4-971c-35cd04196580 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:51.049978 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dbd1ec-0c13-4460-97c7-dae49948790d None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:51.089710 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a1127a-a52c-4722-83d6-24f4f8a0044f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:51.090952 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a1127a-a52c-4722-83d6-24f4f8a0044f None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:51.091443 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a1127a-a52c-4722-83d6-24f4f8a0044f None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:51.091984 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a1127a-a52c-4722-83d6-24f4f8a0044f None admin] PATH_INFO: `/v3/roles/service` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:51.103047 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a1127a-a52c-4722-83d6-24f4f8a0044f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 07:02:51.112159 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-92a1127a-a52c-4722-83d6-24f4f8a0044f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 30 07:02:51.113359 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6520fe-80a9-49e4-971c-35cd04196580 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:51.114164 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 313/607] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Mar 30 07:02:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 07:02:51.121317 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a1127a-a52c-4722-83d6-24f4f8a0044f None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:51.155764 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a162b06b-c260-4d58-baea-5b7b0ac4a5c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:51.157010 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a162b06b-c260-4d58-baea-5b7b0ac4a5c0 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:51.157530 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a162b06b-c260-4d58-baea-5b7b0ac4a5c0 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:51.158041 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a162b06b-c260-4d58-baea-5b7b0ac4a5c0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:51.166695 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a162b06b-c260-4d58-baea-5b7b0ac4a5c0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:51.168558 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a162b06b-c260-4d58-baea-5b7b0ac4a5c0 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:51.182911 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-a162b06b-c260-4d58-baea-5b7b0ac4a5c0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 30 07:02:51.184808 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 295/608] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Mar 30 07:02:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:02:51.190533 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a162b06b-c260-4d58-baea-5b7b0ac4a5c0 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:51.236173 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a1127a-a52c-4722-83d6-24f4f8a0044f None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:51.276790 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedea155-715f-4b44-8323-c3340fa942d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:51.277753 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedea155-715f-4b44-8323-c3340fa942d9 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:51.278028 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedea155-715f-4b44-8323-c3340fa942d9 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:51.278291 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedea155-715f-4b44-8323-c3340fa942d9 None admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:51.279028 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedea155-715f-4b44-8323-c3340fa942d9 None admin] RBAC: Adding query filter params (name=service) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:51.279332 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedea155-715f-4b44-8323-c3340fa942d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:51.280789 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedea155-715f-4b44-8323-c3340fa942d9 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:51.293973 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 314/609] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Mar 30 07:02:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:02:51.295225 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedea155-715f-4b44-8323-c3340fa942d9 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:51.302728 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a162b06b-c260-4d58-baea-5b7b0ac4a5c0 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:51.336849 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997c444c-3680-42a8-8a24-3237018efcde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:51.338020 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997c444c-3680-42a8-8a24-3237018efcde None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:51.338522 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997c444c-3680-42a8-8a24-3237018efcde None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:51.339006 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997c444c-3680-42a8-8a24-3237018efcde None admin] PATH_INFO: `/v3/projects` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:51.340012 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997c444c-3680-42a8-8a24-3237018efcde None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:51.340520 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997c444c-3680-42a8-8a24-3237018efcde None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:51.342176 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997c444c-3680-42a8-8a24-3237018efcde None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:51.362828 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 296/610] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Mar 30 07:02:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:02:51.368529 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997c444c-3680-42a8-8a24-3237018efcde None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:51.395831 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedea155-715f-4b44-8323-c3340fa942d9 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:51.429740 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6ff91a-1c73-4d2d-b495-e39b3ea7de72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:51.430540 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ff91a-1c73-4d2d-b495-e39b3ea7de72 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:51.430816 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ff91a-1c73-4d2d-b495-e39b3ea7de72 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:51.431084 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ff91a-1c73-4d2d-b495-e39b3ea7de72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:51.443610 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6ff91a-1c73-4d2d-b495-e39b3ea7de72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:51.445559 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6ff91a-1c73-4d2d-b495-e39b3ea7de72 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:51.463676 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-7e6ff91a-1c73-4d2d-b495-e39b3ea7de72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 07:02:51.469526 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 315/611] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:02:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:02:51.471772 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6ff91a-1c73-4d2d-b495-e39b3ea7de72 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:51.581401 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6ff91a-1c73-4d2d-b495-e39b3ea7de72 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:51.617608 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a16e13e-5ca0-491b-be7b-e13f41a8b3c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:51.618429 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a16e13e-5ca0-491b-be7b-e13f41a8b3c5 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:51.618711 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a16e13e-5ca0-491b-be7b-e13f41a8b3c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:51.619011 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a16e13e-5ca0-491b-be7b-e13f41a8b3c5 None admin] PATH_INFO: `/v3/domains` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:51.619737 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a16e13e-5ca0-491b-be7b-e13f41a8b3c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:51.620063 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a16e13e-5ca0-491b-be7b-e13f41a8b3c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:51.621447 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a16e13e-5ca0-491b-be7b-e13f41a8b3c5 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:51.639432 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 316/612] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Mar 30 07:02:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:02:51.640830 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a16e13e-5ca0-491b-be7b-e13f41a8b3c5 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:51.662290 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997c444c-3680-42a8-8a24-3237018efcde None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:51.748420 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a16e13e-5ca0-491b-be7b-e13f41a8b3c5 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:51.768534 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeed4314-f068-4429-8a91-cd1b52b21340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:51.769441 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed4314-f068-4429-8a91-cd1b52b21340 None admin] REQUEST_METHOD: `PUT` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:51.769716 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed4314-f068-4429-8a91-cd1b52b21340 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:51.769983 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed4314-f068-4429-8a91-cd1b52b21340 None admin] PATH_INFO: `/v3/projects/7e4eda4c5cd84307b36a5b48642e816f/users/54f3802cb341445f994b9204744060ae/roles/4848e2a52e0b428997632ab8a8d36e91` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:51.783702 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc68edd-6015-4781-95c3-dc084b50da5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:51.784530 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc68edd-6015-4781-95c3-dc084b50da5d None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:51.784865 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc68edd-6015-4781-95c3-dc084b50da5d None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:51.785150 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc68edd-6015-4781-95c3-dc084b50da5d None admin] PATH_INFO: `/v3/users/swift` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:51.793490 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc68edd-6015-4781-95c3-dc084b50da5d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:51.794988 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc68edd-6015-4781-95c3-dc084b50da5d None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:51.809163 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeed4314-f068-4429-8a91-cd1b52b21340 None admin] RBAC: Authorizing `identity:create_grant(project_id=7e4eda4c5cd84307b36a5b48642e816f, user_id=54f3802cb341445f994b9204744060ae, role_id=4848e2a52e0b428997632ab8a8d36e91)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:51.809753 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-dfc68edd-6015-4781-95c3-dc084b50da5d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Mar 30 07:02:51.810608 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeed4314-f068-4429-8a91-cd1b52b21340 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:51.815843 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 317/613] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Mar 30 07:02:51 2022] GET /identity/v3/users/swift => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:02:51.817075 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc68edd-6015-4781-95c3-dc084b50da5d None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:51.858390 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 297/614] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Mar 30 07:02:51 2022] PUT /identity/v3/projects/7e4eda4c5cd84307b36a5b48642e816f/users/54f3802cb341445f994b9204744060ae/roles/4848e2a52e0b428997632ab8a8d36e91 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 07:02:51.926024 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc68edd-6015-4781-95c3-dc084b50da5d None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:51.961783 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3d508c-0a79-4b25-bf23-44c4710abd41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:51.962565 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3d508c-0a79-4b25-bf23-44c4710abd41 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:51.962915 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3d508c-0a79-4b25-bf23-44c4710abd41 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:51.963361 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3d508c-0a79-4b25-bf23-44c4710abd41 None admin] PATH_INFO: `/v3/users` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:51.964959 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3d508c-0a79-4b25-bf23-44c4710abd41 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:51.965408 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3d508c-0a79-4b25-bf23-44c4710abd41 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:51.967835 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3d508c-0a79-4b25-bf23-44c4710abd41 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:51.994334 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 318/615] 10.222.0.20 () {56 vars in 1135 bytes} [Wed Mar 30 07:02:51 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:02:51.995934 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeed4314-f068-4429-8a91-cd1b52b21340 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:52.166181 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeed4314-f068-4429-8a91-cd1b52b21340 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:52.202169 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1644d5df-9c1d-44ae-b0f0-f33c167ac2f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:52.203359 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1644d5df-9c1d-44ae-b0f0-f33c167ac2f5 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:52.204315 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1644d5df-9c1d-44ae-b0f0-f33c167ac2f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:52.204829 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1644d5df-9c1d-44ae-b0f0-f33c167ac2f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:52.219847 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1644d5df-9c1d-44ae-b0f0-f33c167ac2f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:52.219847 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1644d5df-9c1d-44ae-b0f0-f33c167ac2f5 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:52.235093 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-1644d5df-9c1d-44ae-b0f0-f33c167ac2f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 07:02:52.237011 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 298/616] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:02:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:02:52.242588 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3d508c-0a79-4b25-bf23-44c4710abd41 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:52.346101 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3d508c-0a79-4b25-bf23-44c4710abd41 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:52.380535 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c417213c-c66f-434c-8c43-bd01d00cb126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:52.381253 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c417213c-c66f-434c-8c43-bd01d00cb126 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:52.381532 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c417213c-c66f-434c-8c43-bd01d00cb126 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:52.381800 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c417213c-c66f-434c-8c43-bd01d00cb126 None admin] PATH_INFO: `/v3/domains` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:52.382516 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c417213c-c66f-434c-8c43-bd01d00cb126 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:52.382811 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c417213c-c66f-434c-8c43-bd01d00cb126 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:52.384207 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c417213c-c66f-434c-8c43-bd01d00cb126 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:52.397074 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 319/617] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Mar 30 07:02:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:52.405019 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1644d5df-9c1d-44ae-b0f0-f33c167ac2f5 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:52.623477 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1644d5df-9c1d-44ae-b0f0-f33c167ac2f5 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:52.685430 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08f2b62-d587-4a94-a492-e0debaad4389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:52.686495 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08f2b62-d587-4a94-a492-e0debaad4389 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:52.686951 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08f2b62-d587-4a94-a492-e0debaad4389 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:52.687373 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08f2b62-d587-4a94-a492-e0debaad4389 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:52.700851 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08f2b62-d587-4a94-a492-e0debaad4389 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:52.702480 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08f2b62-d587-4a94-a492-e0debaad4389 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:52.720037 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd050cd-96da-44c4-9e88-13cf7cedd4ad None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:52.720594 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd050cd-96da-44c4-9e88-13cf7cedd4ad None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:52.720965 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd050cd-96da-44c4-9e88-13cf7cedd4ad None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:52.723979 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 320/618] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:02:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:02:52.728160 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-e08f2b62-d587-4a94-a492-e0debaad4389 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 30 07:02:52.728888 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c8c96b-00c1-480e-9103-e35484177f49 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:52.729317 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c8c96b-00c1-480e-9103-e35484177f49 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:52.729683 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c8c96b-00c1-480e-9103-e35484177f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:52.730665 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 299/619] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Mar 30 07:02:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:02:52.737696 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08f2b62-d587-4a94-a492-e0debaad4389 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:52.762877 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-c7c8c96b-00c1-480e-9103-e35484177f49 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:02:52.764113 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-c7c8c96b-00c1-480e-9103-e35484177f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:02:52.910453 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 321/620] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:02:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 07:02:52.933973 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c8c96b-00c1-480e-9103-e35484177f49 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:52.951485 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08f2b62-d587-4a94-a492-e0debaad4389 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:53.005460 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf63327-a481-4fcf-a65d-373a5ffc4e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:53.006560 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf63327-a481-4fcf-a65d-373a5ffc4e6e None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:53.007768 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf63327-a481-4fcf-a65d-373a5ffc4e6e None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:53.008206 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf63327-a481-4fcf-a65d-373a5ffc4e6e None admin] PATH_INFO: `/v3/projects` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:53.009175 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf63327-a481-4fcf-a65d-373a5ffc4e6e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:53.009790 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf63327-a481-4fcf-a65d-373a5ffc4e6e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:53.011503 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf63327-a481-4fcf-a65d-373a5ffc4e6e None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:53.026680 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 300/621] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Mar 30 07:02:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:02:53.028324 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61160391-5539-457b-a038-3e25dde12aa5 None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:53.028743 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61160391-5539-457b-a038-3e25dde12aa5 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:53.029202 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61160391-5539-457b-a038-3e25dde12aa5 None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:53.031581 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 301/622] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:02:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:02:53.032834 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61160391-5539-457b-a038-3e25dde12aa5 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:53.042888 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c8c96b-00c1-480e-9103-e35484177f49 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:53.082069 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1291022e-91dd-4dd7-8e2c-dc36854b869a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:53.083375 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1291022e-91dd-4dd7-8e2c-dc36854b869a None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:53.083903 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1291022e-91dd-4dd7-8e2c-dc36854b869a None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:53.084352 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1291022e-91dd-4dd7-8e2c-dc36854b869a None admin] PATH_INFO: `/v3/roles/service` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:53.095337 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1291022e-91dd-4dd7-8e2c-dc36854b869a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 07:02:53.102643 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-1291022e-91dd-4dd7-8e2c-dc36854b869a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 30 07:02:53.104547 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 322/623] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Mar 30 07:02:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 07:02:53.106047 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3df417-1f9a-4652-bb21-3eb223f41b4d None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:53.106544 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3df417-1f9a-4652-bb21-3eb223f41b4d None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:53.107039 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3df417-1f9a-4652-bb21-3eb223f41b4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:53.125203 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-1f3df417-1f9a-4652-bb21-3eb223f41b4d None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:02:53.126755 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-1f3df417-1f9a-4652-bb21-3eb223f41b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:02:53.161549 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61160391-5539-457b-a038-3e25dde12aa5 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:53.196467 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b78884-d8b6-40aa-95d9-00a202453d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:53.197819 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b78884-d8b6-40aa-95d9-00a202453d1b None admin] REQUEST_METHOD: `PUT` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:53.198275 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b78884-d8b6-40aa-95d9-00a202453d1b None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:53.198825 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b78884-d8b6-40aa-95d9-00a202453d1b None admin] PATH_INFO: `/v3/projects/7e4eda4c5cd84307b36a5b48642e816f/users/c452249c502d4b0688e8dd068f8c4951/roles/4848e2a52e0b428997632ab8a8d36e91` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:53.211038 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 323/624] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:02:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 07:02:53.212506 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3df417-1f9a-4652-bb21-3eb223f41b4d None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:53.215311 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b78884-d8b6-40aa-95d9-00a202453d1b None admin] RBAC: Authorizing `identity:create_grant(project_id=7e4eda4c5cd84307b36a5b48642e816f, user_id=c452249c502d4b0688e8dd068f8c4951, role_id=4848e2a52e0b428997632ab8a8d36e91)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:53.217131 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b78884-d8b6-40aa-95d9-00a202453d1b None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:53.244610 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 302/625] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Mar 30 07:02:53 2022] PUT /identity/v3/projects/7e4eda4c5cd84307b36a5b48642e816f/users/c452249c502d4b0688e8dd068f8c4951/roles/4848e2a52e0b428997632ab8a8d36e91 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:02:53.245536 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b78884-d8b6-40aa-95d9-00a202453d1b None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:53.335052 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3df417-1f9a-4652-bb21-3eb223f41b4d None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:53.348993 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b78884-d8b6-40aa-95d9-00a202453d1b None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:53.371844 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e38766f-4c0d-4e93-9614-3c351f6175f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:53.372529 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e38766f-4c0d-4e93-9614-3c351f6175f8 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:53.372805 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e38766f-4c0d-4e93-9614-3c351f6175f8 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:53.373075 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e38766f-4c0d-4e93-9614-3c351f6175f8 None admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:53.373825 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e38766f-4c0d-4e93-9614-3c351f6175f8 None admin] RBAC: Adding query filter params (name=service) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:53.374125 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e38766f-4c0d-4e93-9614-3c351f6175f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:53.375554 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e38766f-4c0d-4e93-9614-3c351f6175f8 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:53.389763 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 324/626] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Mar 30 07:02:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:53.391222 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e38766f-4c0d-4e93-9614-3c351f6175f8 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:53.392157 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d442672-2631-402d-aaca-4f26109bddbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:53.392984 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d442672-2631-402d-aaca-4f26109bddbd None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:53.393265 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d442672-2631-402d-aaca-4f26109bddbd None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:53.393537 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d442672-2631-402d-aaca-4f26109bddbd None admin] PATH_INFO: `/v3/roles/service` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:53.412626 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d442672-2631-402d-aaca-4f26109bddbd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 07:02:53.423060 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-7d442672-2631-402d-aaca-4f26109bddbd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 30 07:02:53.429241 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 303/627] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Mar 30 07:02:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:02:53.441072 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d442672-2631-402d-aaca-4f26109bddbd None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:53.536780 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e38766f-4c0d-4e93-9614-3c351f6175f8 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:53.586671 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc078277-ad63-4ab3-8bc6-1cc019513155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:53.588889 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc078277-ad63-4ab3-8bc6-1cc019513155 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:53.589542 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc078277-ad63-4ab3-8bc6-1cc019513155 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:53.590384 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc078277-ad63-4ab3-8bc6-1cc019513155 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:53.595736 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d442672-2631-402d-aaca-4f26109bddbd None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:53.604692 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc078277-ad63-4ab3-8bc6-1cc019513155 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:53.607291 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc078277-ad63-4ab3-8bc6-1cc019513155 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:53.629026 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-bc078277-ad63-4ab3-8bc6-1cc019513155 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 07:02:53.629659 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d10cfe-0f61-4412-b508-f8d9006a9bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:53.630427 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d10cfe-0f61-4412-b508-f8d9006a9bff None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:53.630931 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d10cfe-0f61-4412-b508-f8d9006a9bff None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:53.631272 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d10cfe-0f61-4412-b508-f8d9006a9bff None admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:53.631422 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 325/628] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:02:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:02:53.635838 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d10cfe-0f61-4412-b508-f8d9006a9bff None admin] RBAC: Adding query filter params (name=service) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:53.635838 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d10cfe-0f61-4412-b508-f8d9006a9bff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:53.635838 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d10cfe-0f61-4412-b508-f8d9006a9bff None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:53.637347 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc078277-ad63-4ab3-8bc6-1cc019513155 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:53.644442 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 304/629] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Mar 30 07:02:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:53.649217 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d10cfe-0f61-4412-b508-f8d9006a9bff None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:53.760382 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d10cfe-0f61-4412-b508-f8d9006a9bff None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:53.796403 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198527a4-795c-4d7c-932d-8181cf7c1c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:53.797210 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198527a4-795c-4d7c-932d-8181cf7c1c29 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:53.797487 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198527a4-795c-4d7c-932d-8181cf7c1c29 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:53.797760 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198527a4-795c-4d7c-932d-8181cf7c1c29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:53.810157 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198527a4-795c-4d7c-932d-8181cf7c1c29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:53.811621 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198527a4-795c-4d7c-932d-8181cf7c1c29 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:53.830518 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-198527a4-795c-4d7c-932d-8181cf7c1c29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 07:02:53.832059 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 305/630] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:02:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 07:02:53.837836 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198527a4-795c-4d7c-932d-8181cf7c1c29 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:53.878869 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc078277-ad63-4ab3-8bc6-1cc019513155 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:53.923839 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105f11c1-aa24-4f39-be5b-c4fbd28f58c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:53.923839 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105f11c1-aa24-4f39-be5b-c4fbd28f58c1 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:53.923839 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105f11c1-aa24-4f39-be5b-c4fbd28f58c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:53.923839 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105f11c1-aa24-4f39-be5b-c4fbd28f58c1 None admin] PATH_INFO: `/v3/domains` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:53.924257 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105f11c1-aa24-4f39-be5b-c4fbd28f58c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:53.924257 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105f11c1-aa24-4f39-be5b-c4fbd28f58c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:53.924257 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105f11c1-aa24-4f39-be5b-c4fbd28f58c1 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:53.932133 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 326/631] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Mar 30 07:02:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:53.942354 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105f11c1-aa24-4f39-be5b-c4fbd28f58c1 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:53.965439 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198527a4-795c-4d7c-932d-8181cf7c1c29 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:54.002571 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f4a2d1-62ce-403a-a473-8cb13417a4b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:54.003609 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4a2d1-62ce-403a-a473-8cb13417a4b4 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:54.004117 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4a2d1-62ce-403a-a473-8cb13417a4b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:54.004615 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4a2d1-62ce-403a-a473-8cb13417a4b4 None admin] PATH_INFO: `/v3/domains` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:54.005557 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f4a2d1-62ce-403a-a473-8cb13417a4b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:54.006057 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f4a2d1-62ce-403a-a473-8cb13417a4b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:54.007632 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f4a2d1-62ce-403a-a473-8cb13417a4b4 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:54.027831 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 306/632] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Mar 30 07:02:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:02:54.032753 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f4a2d1-62ce-403a-a473-8cb13417a4b4 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:54.082161 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105f11c1-aa24-4f39-be5b-c4fbd28f58c1 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:54.123964 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06c8671-089e-43e3-9ee4-3d90f4cba5a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:54.125021 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06c8671-089e-43e3-9ee4-3d90f4cba5a1 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:54.125021 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06c8671-089e-43e3-9ee4-3d90f4cba5a1 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:54.125293 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06c8671-089e-43e3-9ee4-3d90f4cba5a1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:54.132907 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06c8671-089e-43e3-9ee4-3d90f4cba5a1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:54.134420 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06c8671-089e-43e3-9ee4-3d90f4cba5a1 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:54.148201 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f4a2d1-62ce-403a-a473-8cb13417a4b4 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:54.148449 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-f06c8671-089e-43e3-9ee4-3d90f4cba5a1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 30 07:02:54.149964 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 327/633] 10.222.0.20 () {56 vars in 1093 bytes} [Wed Mar 30 07:02:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:02:54.151725 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1791aac9-548f-43ef-b6cb-4d96c422f596 None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:54.151725 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1791aac9-548f-43ef-b6cb-4d96c422f596 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:54.151948 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1791aac9-548f-43ef-b6cb-4d96c422f596 None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:54.153600 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 328/634] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:02:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:02:54.158119 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1791aac9-548f-43ef-b6cb-4d96c422f596 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:54.185895 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c7809d-3d2a-4e10-b939-361c82c85c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:54.187403 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c7809d-3d2a-4e10-b939-361c82c85c02 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:54.188118 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c7809d-3d2a-4e10-b939-361c82c85c02 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:54.189009 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c7809d-3d2a-4e10-b939-361c82c85c02 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:54.200080 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c7809d-3d2a-4e10-b939-361c82c85c02 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:54.201935 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c7809d-3d2a-4e10-b939-361c82c85c02 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:54.219626 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-47c7809d-3d2a-4e10-b939-361c82c85c02 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Mar 30 07:02:54.221256 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 307/635] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Mar 30 07:02:54 2022] GET /identity/v3/users/cinder => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 07:02:54.222572 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b09a57-3fc6-433f-8a38-8895e978793a None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:54.222854 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b09a57-3fc6-433f-8a38-8895e978793a None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:54.223125 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b09a57-3fc6-433f-8a38-8895e978793a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:54.240551 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-d2b09a57-3fc6-433f-8a38-8895e978793a None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:02:54.241717 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-d2b09a57-3fc6-433f-8a38-8895e978793a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:02:54.288553 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1791aac9-548f-43ef-b6cb-4d96c422f596 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:54.312081 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 308/636] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:02:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 07:02:54.313053 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b09a57-3fc6-433f-8a38-8895e978793a None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:54.329893 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead39a64-d482-4bbf-8882-013280139767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:54.331251 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead39a64-d482-4bbf-8882-013280139767 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:54.331787 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead39a64-d482-4bbf-8882-013280139767 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:54.332310 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead39a64-d482-4bbf-8882-013280139767 None admin] PATH_INFO: `/v3/users` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:54.333653 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead39a64-d482-4bbf-8882-013280139767 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:54.334358 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead39a64-d482-4bbf-8882-013280139767 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:54.336047 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead39a64-d482-4bbf-8882-013280139767 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:54.359916 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 329/637] 10.222.0.20 () {56 vars in 1133 bytes} [Wed Mar 30 07:02:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:54.362367 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead39a64-d482-4bbf-8882-013280139767 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:54.427596 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b09a57-3fc6-433f-8a38-8895e978793a None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:54.461246 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f21598-7dd0-420f-8f37-22b9fc526983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:54.461916 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f21598-7dd0-420f-8f37-22b9fc526983 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:54.462190 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f21598-7dd0-420f-8f37-22b9fc526983 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:54.462459 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f21598-7dd0-420f-8f37-22b9fc526983 None admin] PATH_INFO: `/v3/users` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:54.463351 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f21598-7dd0-420f-8f37-22b9fc526983 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:54.463908 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f21598-7dd0-420f-8f37-22b9fc526983 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:54.465184 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f21598-7dd0-420f-8f37-22b9fc526983 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:54.483561 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 309/638] 10.222.0.20 () {56 vars in 1137 bytes} [Wed Mar 30 07:02:54 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:54.484516 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f21598-7dd0-420f-8f37-22b9fc526983 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:54.490025 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead39a64-d482-4bbf-8882-013280139767 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:54.533551 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a604ccc-e3f0-4341-a7c4-0e429ba67916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:54.534754 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a604ccc-e3f0-4341-a7c4-0e429ba67916 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:54.535265 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a604ccc-e3f0-4341-a7c4-0e429ba67916 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:54.535753 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a604ccc-e3f0-4341-a7c4-0e429ba67916 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:54.550022 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a604ccc-e3f0-4341-a7c4-0e429ba67916 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 07:02:54.560284 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-7a604ccc-e3f0-4341-a7c4-0e429ba67916 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 30 07:02:54.562766 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 330/639] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Mar 30 07:02:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:02:54.563575 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a604ccc-e3f0-4341-a7c4-0e429ba67916 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:54.591833 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f21598-7dd0-420f-8f37-22b9fc526983 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:54.626916 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972c4140-513a-4fca-915a-39b4e625e16b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:54.628490 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972c4140-513a-4fca-915a-39b4e625e16b None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:54.628955 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972c4140-513a-4fca-915a-39b4e625e16b None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:54.629405 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972c4140-513a-4fca-915a-39b4e625e16b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:54.664336 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a604ccc-e3f0-4341-a7c4-0e429ba67916 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:54.697844 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972c4140-513a-4fca-915a-39b4e625e16b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:54.699280 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09fc303-df10-4e1a-aeca-5bf42eaa812c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:54.699626 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972c4140-513a-4fca-915a-39b4e625e16b None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:54.700082 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09fc303-df10-4e1a-aeca-5bf42eaa812c None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:54.700443 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09fc303-df10-4e1a-aeca-5bf42eaa812c None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:54.700776 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09fc303-df10-4e1a-aeca-5bf42eaa812c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:54.765759 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09fc303-df10-4e1a-aeca-5bf42eaa812c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:54.767315 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09fc303-df10-4e1a-aeca-5bf42eaa812c None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:54.799601 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 310/640] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Mar 30 07:02:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 30 07:02:54.800936 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacba610-e2e7-470b-8c28-96f241b5f317 None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:54.801243 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacba610-e2e7-470b-8c28-96f241b5f317 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:54.801583 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacba610-e2e7-470b-8c28-96f241b5f317 None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:54.807559 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 311/641] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:02:54 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:02:54.808277 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacba610-e2e7-470b-8c28-96f241b5f317 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:54.860489 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 331/642] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Mar 30 07:02:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 30 07:02:54.862566 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09fc303-df10-4e1a-aeca-5bf42eaa812c None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:54.909702 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacba610-e2e7-470b-8c28-96f241b5f317 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:54.943358 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd601317-155c-4d95-9971-a30a55c45f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:54.944209 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd601317-155c-4d95-9971-a30a55c45f08 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:54.944770 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd601317-155c-4d95-9971-a30a55c45f08 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:54.945049 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd601317-155c-4d95-9971-a30a55c45f08 None admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:54.945795 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd601317-155c-4d95-9971-a30a55c45f08 None admin] RBAC: Adding query filter params (name=service) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:54.946097 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd601317-155c-4d95-9971-a30a55c45f08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:54.947964 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd601317-155c-4d95-9971-a30a55c45f08 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:54.962876 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 312/643] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Mar 30 07:02:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:54.963062 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09fc303-df10-4e1a-aeca-5bf42eaa812c None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:54.963165 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b647aa9-d4e8-42a1-9af2-572a3a6f2714 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:54.963165 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b647aa9-d4e8-42a1-9af2-572a3a6f2714 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:54.963165 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b647aa9-d4e8-42a1-9af2-572a3a6f2714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:54.981428 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-5b647aa9-d4e8-42a1-9af2-572a3a6f2714 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:02:54.982943 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-5b647aa9-d4e8-42a1-9af2-572a3a6f2714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:02:54.995418 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7cfc18-bfb8-4fc1-b56a-5c2390337a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:54.996264 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7cfc18-bfb8-4fc1-b56a-5c2390337a69 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:54.996542 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7cfc18-bfb8-4fc1-b56a-5c2390337a69 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:54.996813 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7cfc18-bfb8-4fc1-b56a-5c2390337a69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:55.007301 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7cfc18-bfb8-4fc1-b56a-5c2390337a69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:55.008833 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7cfc18-bfb8-4fc1-b56a-5c2390337a69 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:55.026618 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-0f7cfc18-bfb8-4fc1-b56a-5c2390337a69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 07:02:55.029904 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 332/644] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:02:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:02:55.029904 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7cfc18-bfb8-4fc1-b56a-5c2390337a69 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:55.058534 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 313/645] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:02:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 07:02:55.058534 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b647aa9-d4e8-42a1-9af2-572a3a6f2714 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:55.139048 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7cfc18-bfb8-4fc1-b56a-5c2390337a69 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:55.154959 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b647aa9-d4e8-42a1-9af2-572a3a6f2714 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:55.173426 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd7689c-31fd-42bf-a1d5-609538467534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:55.174230 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd7689c-31fd-42bf-a1d5-609538467534 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:55.174512 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd7689c-31fd-42bf-a1d5-609538467534 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:55.174782 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd7689c-31fd-42bf-a1d5-609538467534 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:55.185138 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd7689c-31fd-42bf-a1d5-609538467534 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:55.187140 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd7689c-31fd-42bf-a1d5-609538467534 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:55.187915 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba287e02-9f5d-4eb1-ae31-31b5f2171707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:55.188724 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba287e02-9f5d-4eb1-ae31-31b5f2171707 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:55.189003 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba287e02-9f5d-4eb1-ae31-31b5f2171707 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:55.189275 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba287e02-9f5d-4eb1-ae31-31b5f2171707 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:55.199335 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba287e02-9f5d-4eb1-ae31-31b5f2171707 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:55.200811 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba287e02-9f5d-4eb1-ae31-31b5f2171707 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:55.206392 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-fcd7689c-31fd-42bf-a1d5-609538467534 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 07:02:55.212595 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 333/646] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:02:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:02:55.213783 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd7689c-31fd-42bf-a1d5-609538467534 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:55.224836 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-ba287e02-9f5d-4eb1-ae31-31b5f2171707 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 07:02:55.226811 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 314/647] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:02:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:02:55.227418 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba287e02-9f5d-4eb1-ae31-31b5f2171707 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:55.310430 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd7689c-31fd-42bf-a1d5-609538467534 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:55.329363 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba287e02-9f5d-4eb1-ae31-31b5f2171707 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:55.344379 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0faeef0-acc8-47cb-a477-0cfb95269586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:55.345051 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0faeef0-acc8-47cb-a477-0cfb95269586 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:55.345331 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0faeef0-acc8-47cb-a477-0cfb95269586 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:55.345599 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0faeef0-acc8-47cb-a477-0cfb95269586 None admin] PATH_INFO: `/v3/domains` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:55.346369 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0faeef0-acc8-47cb-a477-0cfb95269586 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:55.346918 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0faeef0-acc8-47cb-a477-0cfb95269586 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:55.349262 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0faeef0-acc8-47cb-a477-0cfb95269586 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:55.362720 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21a2958-1d31-4a0a-86e8-7340f4f40e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:55.363523 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a2958-1d31-4a0a-86e8-7340f4f40e61 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:55.363822 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a2958-1d31-4a0a-86e8-7340f4f40e61 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:55.364127 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a2958-1d31-4a0a-86e8-7340f4f40e61 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:55.372624 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 334/648] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Mar 30 07:02:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:55.372624 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0faeef0-acc8-47cb-a477-0cfb95269586 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:55.379300 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21a2958-1d31-4a0a-86e8-7340f4f40e61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 07:02:55.387015 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-b21a2958-1d31-4a0a-86e8-7340f4f40e61 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 30 07:02:55.393310 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 315/649] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Mar 30 07:02:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:02:55.393310 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21a2958-1d31-4a0a-86e8-7340f4f40e61 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:55.473926 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0faeef0-acc8-47cb-a477-0cfb95269586 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:55.490346 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21a2958-1d31-4a0a-86e8-7340f4f40e61 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:55.508474 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72257e9e-5593-4a2b-ad53-20f37eec0183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:55.509136 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72257e9e-5593-4a2b-ad53-20f37eec0183 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:55.509410 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72257e9e-5593-4a2b-ad53-20f37eec0183 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:55.509755 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72257e9e-5593-4a2b-ad53-20f37eec0183 None admin] PATH_INFO: `/v3/domains` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:55.510620 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72257e9e-5593-4a2b-ad53-20f37eec0183 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:55.510934 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72257e9e-5593-4a2b-ad53-20f37eec0183 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:55.512405 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72257e9e-5593-4a2b-ad53-20f37eec0183 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:55.528714 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 335/650] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Mar 30 07:02:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:55.528879 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87f437c-7e74-482b-ae80-9929870551eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:55.528879 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f437c-7e74-482b-ae80-9929870551eb None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:55.529029 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72257e9e-5593-4a2b-ad53-20f37eec0183 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:55.529124 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f437c-7e74-482b-ae80-9929870551eb None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:55.529124 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f437c-7e74-482b-ae80-9929870551eb None admin] PATH_INFO: `/v3/domains` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:55.529124 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87f437c-7e74-482b-ae80-9929870551eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:55.529124 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87f437c-7e74-482b-ae80-9929870551eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:55.529124 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87f437c-7e74-482b-ae80-9929870551eb None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:55.545946 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 316/651] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Mar 30 07:02:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:55.545946 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87f437c-7e74-482b-ae80-9929870551eb None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:55.633169 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72257e9e-5593-4a2b-ad53-20f37eec0183 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:55.640811 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87f437c-7e74-482b-ae80-9929870551eb None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:55.672600 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2b320d-2f9d-44a3-ac65-ddb2c93f6271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:55.673401 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2b320d-2f9d-44a3-ac65-ddb2c93f6271 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:55.673826 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2b320d-2f9d-44a3-ac65-ddb2c93f6271 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:55.674088 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2b320d-2f9d-44a3-ac65-ddb2c93f6271 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:55.678695 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aa700f-e81b-4f78-87eb-fc439f2d79c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:55.679360 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aa700f-e81b-4f78-87eb-fc439f2d79c5 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:55.679634 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aa700f-e81b-4f78-87eb-fc439f2d79c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:55.679933 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aa700f-e81b-4f78-87eb-fc439f2d79c5 None admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:55.680727 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aa700f-e81b-4f78-87eb-fc439f2d79c5 None admin] RBAC: Adding query filter params (name=service) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:55.681029 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aa700f-e81b-4f78-87eb-fc439f2d79c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:55.681228 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2b320d-2f9d-44a3-ac65-ddb2c93f6271 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:55.682597 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aa700f-e81b-4f78-87eb-fc439f2d79c5 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:55.683050 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2b320d-2f9d-44a3-ac65-ddb2c93f6271 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:55.694980 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 317/652] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Mar 30 07:02:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:55.694980 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aa700f-e81b-4f78-87eb-fc439f2d79c5 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:55.696035 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-9b2b320d-2f9d-44a3-ac65-ddb2c93f6271 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 30 07:02:55.697317 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 336/653] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Mar 30 07:02:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:02:55.702894 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2b320d-2f9d-44a3-ac65-ddb2c93f6271 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:55.788989 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aa700f-e81b-4f78-87eb-fc439f2d79c5 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:55.799113 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2b320d-2f9d-44a3-ac65-ddb2c93f6271 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:55.819964 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9364b195-4d9b-409d-9b51-669e9d73d5dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:55.820807 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9364b195-4d9b-409d-9b51-669e9d73d5dc None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:55.821097 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9364b195-4d9b-409d-9b51-669e9d73d5dc None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:55.821370 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9364b195-4d9b-409d-9b51-669e9d73d5dc None admin] PATH_INFO: `/v3/projects/service` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:55.827911 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9364b195-4d9b-409d-9b51-669e9d73d5dc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:55.829355 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9364b195-4d9b-409d-9b51-669e9d73d5dc None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:55.833598 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1880c5-b6c2-4480-8ce0-903e05329bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:55.834402 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1880c5-b6c2-4480-8ce0-903e05329bce None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:55.834680 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1880c5-b6c2-4480-8ce0-903e05329bce None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:55.834973 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1880c5-b6c2-4480-8ce0-903e05329bce None admin] PATH_INFO: `/v3/users/glance` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:55.842575 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-9364b195-4d9b-409d-9b51-669e9d73d5dc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 30 07:02:55.842884 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1880c5-b6c2-4480-8ce0-903e05329bce None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:55.843747 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 318/654] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Mar 30 07:02:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:02:55.844347 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1880c5-b6c2-4480-8ce0-903e05329bce None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:55.844524 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9364b195-4d9b-409d-9b51-669e9d73d5dc None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:55.858202 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-cc1880c5-b6c2-4480-8ce0-903e05329bce None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Mar 30 07:02:55.859390 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 337/655] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Mar 30 07:02:55 2022] GET /identity/v3/users/glance => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:02:55.860180 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1880c5-b6c2-4480-8ce0-903e05329bce None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:55.939796 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9364b195-4d9b-409d-9b51-669e9d73d5dc None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:55.956784 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1880c5-b6c2-4480-8ce0-903e05329bce None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:55.974186 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83237fa6-9bbb-4059-80a5-c6b24379d498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:55.974988 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83237fa6-9bbb-4059-80a5-c6b24379d498 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:55.975268 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83237fa6-9bbb-4059-80a5-c6b24379d498 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:55.975540 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83237fa6-9bbb-4059-80a5-c6b24379d498 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:55.986338 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83237fa6-9bbb-4059-80a5-c6b24379d498 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:55.987801 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83237fa6-9bbb-4059-80a5-c6b24379d498 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:55.992046 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d37286-164e-455d-94c2-89a5c3c53378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:55.992711 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d37286-164e-455d-94c2-89a5c3c53378 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:55.992992 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d37286-164e-455d-94c2-89a5c3c53378 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:55.993262 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d37286-164e-455d-94c2-89a5c3c53378 None admin] PATH_INFO: `/v3/projects` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:55.994179 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d37286-164e-455d-94c2-89a5c3c53378 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:55.994827 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d37286-164e-455d-94c2-89a5c3c53378 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:55.996241 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d37286-164e-455d-94c2-89a5c3c53378 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:56.005409 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-83237fa6-9bbb-4059-80a5-c6b24379d498 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 07:02:56.006620 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 319/656] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:02:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:02:56.007956 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf4d0c3-df65-4f4c-ada8-e7542dd8df6b None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:56.008135 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf4d0c3-df65-4f4c-ada8-e7542dd8df6b None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:56.008414 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf4d0c3-df65-4f4c-ada8-e7542dd8df6b None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:56.013230 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 338/657] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Mar 30 07:02:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:56.013446 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 320/658] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:02:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:02:56.013596 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d37286-164e-455d-94c2-89a5c3c53378 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:56.013733 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf4d0c3-df65-4f4c-ada8-e7542dd8df6b None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:56.119163 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf4d0c3-df65-4f4c-ada8-e7542dd8df6b None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:56.119524 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d37286-164e-455d-94c2-89a5c3c53378 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:56.152667 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61b80a1-d60d-4047-b686-021c9b4a91dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:56.153282 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14052736-6acd-473f-b40f-53a21df1b824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:56.153385 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61b80a1-d60d-4047-b686-021c9b4a91dd None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:56.153494 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14052736-6acd-473f-b40f-53a21df1b824 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:56.153577 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61b80a1-d60d-4047-b686-021c9b4a91dd None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:56.153655 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14052736-6acd-473f-b40f-53a21df1b824 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:56.153839 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61b80a1-d60d-4047-b686-021c9b4a91dd None admin] PATH_INFO: `/v3/projects` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:56.153935 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14052736-6acd-473f-b40f-53a21df1b824 None admin] PATH_INFO: `/v3/users` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:56.154603 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61b80a1-d60d-4047-b686-021c9b4a91dd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:56.154697 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14052736-6acd-473f-b40f-53a21df1b824 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:56.154899 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61b80a1-d60d-4047-b686-021c9b4a91dd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:56.154987 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14052736-6acd-473f-b40f-53a21df1b824 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:56.156357 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61b80a1-d60d-4047-b686-021c9b4a91dd None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:56.156468 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14052736-6acd-473f-b40f-53a21df1b824 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:56.167919 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 339/659] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Mar 30 07:02:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:56.168708 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61b80a1-d60d-4047-b686-021c9b4a91dd None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:56.173163 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 321/660] 10.222.0.20 () {56 vars in 1137 bytes} [Wed Mar 30 07:02:56 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:56.173978 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14052736-6acd-473f-b40f-53a21df1b824 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:56.266299 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61b80a1-d60d-4047-b686-021c9b4a91dd None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:56.267877 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14052736-6acd-473f-b40f-53a21df1b824 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:56.299333 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38deb1c-0dca-4941-a986-71dad0fd8aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:56.299505 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd677e0-3726-4ccd-8fc0-01ab0a161f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:56.300005 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38deb1c-0dca-4941-a986-71dad0fd8aa7 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:56.300114 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd677e0-3726-4ccd-8fc0-01ab0a161f52 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:56.300291 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38deb1c-0dca-4941-a986-71dad0fd8aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:56.300402 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd677e0-3726-4ccd-8fc0-01ab0a161f52 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:56.300546 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38deb1c-0dca-4941-a986-71dad0fd8aa7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:56.300694 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd677e0-3726-4ccd-8fc0-01ab0a161f52 None admin] PATH_INFO: `/v3/domains` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:56.301358 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd677e0-3726-4ccd-8fc0-01ab0a161f52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:56.301452 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38deb1c-0dca-4941-a986-71dad0fd8aa7 None admin] RBAC: Adding query filter params (role.id=4848e2a52e0b428997632ab8a8d36e91, scope.project.id=7e4eda4c5cd84307b36a5b48642e816f, user.id=72b398c5ed14484d8b7a51fee900597b) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:56.301643 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38deb1c-0dca-4941-a986-71dad0fd8aa7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:56.301738 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd677e0-3726-4ccd-8fc0-01ab0a161f52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:56.303017 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd677e0-3726-4ccd-8fc0-01ab0a161f52 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:56.303105 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38deb1c-0dca-4941-a986-71dad0fd8aa7 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:56.308941 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 322/661] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Mar 30 07:02:56 2022] GET /identity/v3/role_assignments?user.id=72b398c5ed14484d8b7a51fee900597b&scope.project.id=7e4eda4c5cd84307b36a5b48642e816f&role.id=4848e2a52e0b428997632ab8a8d36e91 => generated 608 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:56.310089 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633312f2-1eec-46e1-82de-58f27ccd3c50 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:56.310386 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633312f2-1eec-46e1-82de-58f27ccd3c50 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:56.310653 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633312f2-1eec-46e1-82de-58f27ccd3c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:56.315348 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 340/662] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Mar 30 07:02:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:56.316589 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd677e0-3726-4ccd-8fc0-01ab0a161f52 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:56.327991 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-633312f2-1eec-46e1-82de-58f27ccd3c50 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:02:56.329354 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-633312f2-1eec-46e1-82de-58f27ccd3c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:02:56.404002 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 323/663] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:02:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 07:02:56.404002 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633312f2-1eec-46e1-82de-58f27ccd3c50 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:56.425858 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd677e0-3726-4ccd-8fc0-01ab0a161f52 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:56.461072 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ea1f61-9226-484b-88c4-b02261489fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:56.461760 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ea1f61-9226-484b-88c4-b02261489fa8 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:56.461950 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ea1f61-9226-484b-88c4-b02261489fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:56.462189 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ea1f61-9226-484b-88c4-b02261489fa8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:56.463107 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ea1f61-9226-484b-88c4-b02261489fa8 None admin] RBAC: Adding query filter params (role.id=4848e2a52e0b428997632ab8a8d36e91, scope.project.id=7e4eda4c5cd84307b36a5b48642e816f, user.id=5e2fda180e8d448d895c40cdad34bc4c) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:56.463414 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ea1f61-9226-484b-88c4-b02261489fa8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:56.465012 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ea1f61-9226-484b-88c4-b02261489fa8 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:56.479998 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 341/664] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Mar 30 07:02:56 2022] GET /identity/v3/role_assignments?user.id=5e2fda180e8d448d895c40cdad34bc4c&scope.project.id=7e4eda4c5cd84307b36a5b48642e816f&role.id=4848e2a52e0b428997632ab8a8d36e91 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:56.479998 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ea1f61-9226-484b-88c4-b02261489fa8 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:56.507893 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633312f2-1eec-46e1-82de-58f27ccd3c50 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:56.551673 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a500a7a-fcbc-4474-a76d-a3f8f50d37f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:56.552389 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a500a7a-fcbc-4474-a76d-a3f8f50d37f0 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:56.552666 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a500a7a-fcbc-4474-a76d-a3f8f50d37f0 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:56.552941 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a500a7a-fcbc-4474-a76d-a3f8f50d37f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:56.628499 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ea1f61-9226-484b-88c4-b02261489fa8 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:56.635328 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a500a7a-fcbc-4474-a76d-a3f8f50d37f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:56.636946 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a500a7a-fcbc-4474-a76d-a3f8f50d37f0 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:56.673470 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e044e73-c8b5-44d1-afe2-41036ab4ce25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:56.675071 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e044e73-c8b5-44d1-afe2-41036ab4ce25 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:56.675631 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e044e73-c8b5-44d1-afe2-41036ab4ce25 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:56.676106 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e044e73-c8b5-44d1-afe2-41036ab4ce25 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:56.687748 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e044e73-c8b5-44d1-afe2-41036ab4ce25 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:56.689751 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e044e73-c8b5-44d1-afe2-41036ab4ce25 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:56.706798 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-9e044e73-c8b5-44d1-afe2-41036ab4ce25 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Mar 30 07:02:56.708591 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 342/665] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Mar 30 07:02:56 2022] GET /identity/v3/users/neutron => generated 85 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:02:56.709509 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e044e73-c8b5-44d1-afe2-41036ab4ce25 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:56.755254 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 324/666] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Mar 30 07:02:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 30 07:02:56.756245 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a500a7a-fcbc-4474-a76d-a3f8f50d37f0 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:56.817856 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e044e73-c8b5-44d1-afe2-41036ab4ce25 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:56.851970 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0902eb79-ee8e-4bb2-ad28-7d1fc6c4e0a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:56.853226 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0902eb79-ee8e-4bb2-ad28-7d1fc6c4e0a2 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:56.853722 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0902eb79-ee8e-4bb2-ad28-7d1fc6c4e0a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:56.854144 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a500a7a-fcbc-4474-a76d-a3f8f50d37f0 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:56.854381 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0902eb79-ee8e-4bb2-ad28-7d1fc6c4e0a2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:56.865232 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0902eb79-ee8e-4bb2-ad28-7d1fc6c4e0a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 07:02:56.872479 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-0902eb79-ee8e-4bb2-ad28-7d1fc6c4e0a2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 30 07:02:56.873910 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 343/667] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Mar 30 07:02:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:02:56.874857 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0902eb79-ee8e-4bb2-ad28-7d1fc6c4e0a2 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:56.888486 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2697969e-c7e2-427e-a7fa-43c3ad5ddb5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:56.889157 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2697969e-c7e2-427e-a7fa-43c3ad5ddb5b None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:56.889444 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2697969e-c7e2-427e-a7fa-43c3ad5ddb5b None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:56.889719 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2697969e-c7e2-427e-a7fa-43c3ad5ddb5b None admin] PATH_INFO: `/v3/users` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:56.890562 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2697969e-c7e2-427e-a7fa-43c3ad5ddb5b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:56.890868 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2697969e-c7e2-427e-a7fa-43c3ad5ddb5b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:56.892399 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2697969e-c7e2-427e-a7fa-43c3ad5ddb5b None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:56.910993 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 325/668] 10.222.0.20 () {56 vars in 1139 bytes} [Wed Mar 30 07:02:56 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:56.911200 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2697969e-c7e2-427e-a7fa-43c3ad5ddb5b None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:56.973408 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0902eb79-ee8e-4bb2-ad28-7d1fc6c4e0a2 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:57.008570 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a60a9-d019-4fd9-9a71-a9b0eaac90e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:57.009749 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a60a9-d019-4fd9-9a71-a9b0eaac90e8 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:57.010241 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a60a9-d019-4fd9-9a71-a9b0eaac90e8 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:57.010711 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a60a9-d019-4fd9-9a71-a9b0eaac90e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:57.013820 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2697969e-c7e2-427e-a7fa-43c3ad5ddb5b None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:57.021922 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074a60a9-d019-4fd9-9a71-a9b0eaac90e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:57.023615 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074a60a9-d019-4fd9-9a71-a9b0eaac90e8 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:57.040134 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-074a60a9-d019-4fd9-9a71-a9b0eaac90e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 07:02:57.042097 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 344/669] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:02:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:02:57.043061 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a60a9-d019-4fd9-9a71-a9b0eaac90e8 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:57.049616 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8d7a5d-7aac-494d-9b69-fef5b4f431b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:57.049616 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8d7a5d-7aac-494d-9b69-fef5b4f431b4 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:57.049846 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8d7a5d-7aac-494d-9b69-fef5b4f431b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:57.050086 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8d7a5d-7aac-494d-9b69-fef5b4f431b4 None admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:57.050840 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8d7a5d-7aac-494d-9b69-fef5b4f431b4 None admin] RBAC: Adding query filter params (name=service) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:57.051146 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8d7a5d-7aac-494d-9b69-fef5b4f431b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:57.052613 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8d7a5d-7aac-494d-9b69-fef5b4f431b4 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:57.061450 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 326/670] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Mar 30 07:02:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:57.062272 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8d7a5d-7aac-494d-9b69-fef5b4f431b4 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:57.147943 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a60a9-d019-4fd9-9a71-a9b0eaac90e8 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:57.160538 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8d7a5d-7aac-494d-9b69-fef5b4f431b4 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:57.184190 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7931697-3013-46aa-8d40-2dc4c447e76d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:57.185535 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7931697-3013-46aa-8d40-2dc4c447e76d None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:57.186038 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7931697-3013-46aa-8d40-2dc4c447e76d None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:57.186505 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7931697-3013-46aa-8d40-2dc4c447e76d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:57.193688 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b934f680-58ea-403d-8d75-370fab80a3cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:57.194356 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b934f680-58ea-403d-8d75-370fab80a3cf None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:57.194682 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b934f680-58ea-403d-8d75-370fab80a3cf None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:57.194963 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b934f680-58ea-403d-8d75-370fab80a3cf None admin] PATH_INFO: `/v3/domains` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:57.195689 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b934f680-58ea-403d-8d75-370fab80a3cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:57.196023 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b934f680-58ea-403d-8d75-370fab80a3cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:57.197645 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b934f680-58ea-403d-8d75-370fab80a3cf None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:57.210011 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 327/671] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Mar 30 07:02:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:57.210862 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b934f680-58ea-403d-8d75-370fab80a3cf None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:57.264615 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7931697-3013-46aa-8d40-2dc4c447e76d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:57.266441 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7931697-3013-46aa-8d40-2dc4c447e76d None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:57.312942 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b934f680-58ea-403d-8d75-370fab80a3cf None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:57.348958 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8e66bb-79f7-4896-9121-bda72561c939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:57.349767 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8e66bb-79f7-4896-9121-bda72561c939 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:57.350046 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8e66bb-79f7-4896-9121-bda72561c939 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:57.350316 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8e66bb-79f7-4896-9121-bda72561c939 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:57.364457 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8e66bb-79f7-4896-9121-bda72561c939 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:57.366922 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8e66bb-79f7-4896-9121-bda72561c939 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:57.373759 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 345/672] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Mar 30 07:02:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 30 07:02:57.373759 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7931697-3013-46aa-8d40-2dc4c447e76d None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:57.393086 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-bd8e66bb-79f7-4896-9121-bda72561c939 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 07:02:57.395528 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 328/673] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:02:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:02:57.396695 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8e66bb-79f7-4896-9121-bda72561c939 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:57.486498 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7931697-3013-46aa-8d40-2dc4c447e76d None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:57.514939 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8e66bb-79f7-4896-9121-bda72561c939 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:57.530299 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ed6f08-f02d-4105-88c1-1ebb48e55ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:57.531484 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ed6f08-f02d-4105-88c1-1ebb48e55ebb None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:57.532232 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ed6f08-f02d-4105-88c1-1ebb48e55ebb None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:57.532724 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ed6f08-f02d-4105-88c1-1ebb48e55ebb None admin] PATH_INFO: `/v3/projects/service` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:57.541817 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ed6f08-f02d-4105-88c1-1ebb48e55ebb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:57.543842 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ed6f08-f02d-4105-88c1-1ebb48e55ebb None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:57.548972 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cea127-c579-4b50-b7fa-b3bd7aaa9b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:57.549887 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cea127-c579-4b50-b7fa-b3bd7aaa9b30 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:57.550261 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cea127-c579-4b50-b7fa-b3bd7aaa9b30 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:57.550626 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cea127-c579-4b50-b7fa-b3bd7aaa9b30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:57.561081 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-82ed6f08-f02d-4105-88c1-1ebb48e55ebb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 30 07:02:57.563252 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cea127-c579-4b50-b7fa-b3bd7aaa9b30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:57.563446 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 346/674] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Mar 30 07:02:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:02:57.564492 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ed6f08-f02d-4105-88c1-1ebb48e55ebb None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:57.565247 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cea127-c579-4b50-b7fa-b3bd7aaa9b30 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:57.584102 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-77cea127-c579-4b50-b7fa-b3bd7aaa9b30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 07:02:57.590135 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 329/675] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:02:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:02:57.590135 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cea127-c579-4b50-b7fa-b3bd7aaa9b30 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:57.677849 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ed6f08-f02d-4105-88c1-1ebb48e55ebb None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:57.701715 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cea127-c579-4b50-b7fa-b3bd7aaa9b30 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:57.713204 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882443fb-1147-47c4-9e8e-0580756d6975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:57.714127 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882443fb-1147-47c4-9e8e-0580756d6975 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:57.714411 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882443fb-1147-47c4-9e8e-0580756d6975 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:57.714688 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882443fb-1147-47c4-9e8e-0580756d6975 None admin] PATH_INFO: `/v3/domains` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:57.715692 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882443fb-1147-47c4-9e8e-0580756d6975 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:57.715832 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882443fb-1147-47c4-9e8e-0580756d6975 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:57.717169 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882443fb-1147-47c4-9e8e-0580756d6975 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:57.730614 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 347/676] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Mar 30 07:02:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:57.731557 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882443fb-1147-47c4-9e8e-0580756d6975 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:57.740501 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b126709-1665-42fc-9207-f4899e1093d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:57.741478 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b126709-1665-42fc-9207-f4899e1093d8 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:57.741956 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b126709-1665-42fc-9207-f4899e1093d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:57.742448 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b126709-1665-42fc-9207-f4899e1093d8 None admin] PATH_INFO: `/v3/projects` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:57.743423 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b126709-1665-42fc-9207-f4899e1093d8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:57.744137 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b126709-1665-42fc-9207-f4899e1093d8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:57.745802 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b126709-1665-42fc-9207-f4899e1093d8 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:57.758348 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 330/677] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Mar 30 07:02:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:57.759685 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b126709-1665-42fc-9207-f4899e1093d8 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:57.832544 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882443fb-1147-47c4-9e8e-0580756d6975 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:57.857333 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b126709-1665-42fc-9207-f4899e1093d8 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:57.866624 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acebe2de-4fb5-43b8-9aff-a52f0ffcd34f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:57.867345 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acebe2de-4fb5-43b8-9aff-a52f0ffcd34f None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:57.867625 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acebe2de-4fb5-43b8-9aff-a52f0ffcd34f None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:57.867965 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acebe2de-4fb5-43b8-9aff-a52f0ffcd34f None admin] PATH_INFO: `/v3/domains` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:57.868719 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acebe2de-4fb5-43b8-9aff-a52f0ffcd34f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:57.869234 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acebe2de-4fb5-43b8-9aff-a52f0ffcd34f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:57.870822 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acebe2de-4fb5-43b8-9aff-a52f0ffcd34f None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:57.887213 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 348/678] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Mar 30 07:02:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:57.888160 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acebe2de-4fb5-43b8-9aff-a52f0ffcd34f None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:57.893517 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcc39ee-729b-4ef3-ab2b-0a4d9b398f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:57.894568 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcc39ee-729b-4ef3-ab2b-0a4d9b398f42 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:57.895062 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcc39ee-729b-4ef3-ab2b-0a4d9b398f42 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:57.895550 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcc39ee-729b-4ef3-ab2b-0a4d9b398f42 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:57.903635 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcc39ee-729b-4ef3-ab2b-0a4d9b398f42 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:57.905355 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcc39ee-729b-4ef3-ab2b-0a4d9b398f42 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:57.918893 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-abcc39ee-729b-4ef3-ab2b-0a4d9b398f42 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Mar 30 07:02:57.920673 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 331/679] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Mar 30 07:02:57 2022] GET /identity/v3/users/swift => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:02:57.921650 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcc39ee-729b-4ef3-ab2b-0a4d9b398f42 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:57.987321 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acebe2de-4fb5-43b8-9aff-a52f0ffcd34f None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:58.020544 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdfe041-edcf-4fab-9466-632fba0d2124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:58.021208 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdfe041-edcf-4fab-9466-632fba0d2124 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:58.021488 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdfe041-edcf-4fab-9466-632fba0d2124 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:58.021761 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdfe041-edcf-4fab-9466-632fba0d2124 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:58.022588 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdfe041-edcf-4fab-9466-632fba0d2124 None admin] RBAC: Adding query filter params (role.id=4848e2a52e0b428997632ab8a8d36e91, scope.project.id=7e4eda4c5cd84307b36a5b48642e816f, user.id=e880ade912f3412abf44ba73939d6e50) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:58.022894 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdfe041-edcf-4fab-9466-632fba0d2124 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:58.024366 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdfe041-edcf-4fab-9466-632fba0d2124 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:58.027655 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcc39ee-729b-4ef3-ab2b-0a4d9b398f42 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:58.033698 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 349/680] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Mar 30 07:02:57 2022] GET /identity/v3/role_assignments?user.id=e880ade912f3412abf44ba73939d6e50&scope.project.id=7e4eda4c5cd84307b36a5b48642e816f&role.id=4848e2a52e0b428997632ab8a8d36e91 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:58.034827 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdfe041-edcf-4fab-9466-632fba0d2124 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:58.101929 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f86b8c-e030-43b5-9c9f-318da55f7bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:58.102752 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f86b8c-e030-43b5-9c9f-318da55f7bb7 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:58.103039 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f86b8c-e030-43b5-9c9f-318da55f7bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:58.103344 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f86b8c-e030-43b5-9c9f-318da55f7bb7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:58.120010 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f86b8c-e030-43b5-9c9f-318da55f7bb7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:58.121566 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f86b8c-e030-43b5-9c9f-318da55f7bb7 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:58.137995 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-d4f86b8c-e030-43b5-9c9f-318da55f7bb7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 30 07:02:58.139278 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 332/681] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Mar 30 07:02:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:02:58.144903 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f86b8c-e030-43b5-9c9f-318da55f7bb7 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:58.185302 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdfe041-edcf-4fab-9466-632fba0d2124 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:58.230818 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc3f075-9004-4523-942e-70cc43618d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:58.231907 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc3f075-9004-4523-942e-70cc43618d3d None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:58.232447 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc3f075-9004-4523-942e-70cc43618d3d None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:58.232891 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc3f075-9004-4523-942e-70cc43618d3d None admin] PATH_INFO: `/v3/users` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:58.233916 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc3f075-9004-4523-942e-70cc43618d3d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:58.234394 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc3f075-9004-4523-942e-70cc43618d3d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:58.236407 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc3f075-9004-4523-942e-70cc43618d3d None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:58.248943 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f86b8c-e030-43b5-9c9f-318da55f7bb7 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:58.277400 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 350/682] 10.222.0.20 () {56 vars in 1135 bytes} [Wed Mar 30 07:02:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:58.283090 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc3f075-9004-4523-942e-70cc43618d3d None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:58.292751 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0004631-c53e-4384-8fe6-fe0742bc3c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:58.293684 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0004631-c53e-4384-8fe6-fe0742bc3c1a None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:58.293795 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0004631-c53e-4384-8fe6-fe0742bc3c1a None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:58.294021 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0004631-c53e-4384-8fe6-fe0742bc3c1a None admin] PATH_INFO: `/v3/projects` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:58.294830 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0004631-c53e-4384-8fe6-fe0742bc3c1a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:58.295137 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0004631-c53e-4384-8fe6-fe0742bc3c1a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:58.296689 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0004631-c53e-4384-8fe6-fe0742bc3c1a None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:58.316117 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 333/683] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Mar 30 07:02:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:58.322458 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0004631-c53e-4384-8fe6-fe0742bc3c1a None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:58.395507 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc3f075-9004-4523-942e-70cc43618d3d None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:58.441782 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2820cd49-8890-4358-98d3-8729feaa7dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:58.443751 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2820cd49-8890-4358-98d3-8729feaa7dcc None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:58.444239 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2820cd49-8890-4358-98d3-8729feaa7dcc None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:58.444689 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2820cd49-8890-4358-98d3-8729feaa7dcc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:58.475125 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0004631-c53e-4384-8fe6-fe0742bc3c1a None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:58.512209 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a68df8f-17b1-4f83-bac2-badab6e45f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:58.512932 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a68df8f-17b1-4f83-bac2-badab6e45f1c None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:58.513217 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a68df8f-17b1-4f83-bac2-badab6e45f1c None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:58.513493 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a68df8f-17b1-4f83-bac2-badab6e45f1c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:58.514497 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a68df8f-17b1-4f83-bac2-badab6e45f1c None admin] RBAC: Adding query filter params (role.id=4848e2a52e0b428997632ab8a8d36e91, scope.project.id=7e4eda4c5cd84307b36a5b48642e816f, user.id=54f3802cb341445f994b9204744060ae) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:58.514684 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a68df8f-17b1-4f83-bac2-badab6e45f1c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:58.516914 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a68df8f-17b1-4f83-bac2-badab6e45f1c None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:58.525200 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 334/684] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Mar 30 07:02:58 2022] GET /identity/v3/role_assignments?user.id=54f3802cb341445f994b9204744060ae&scope.project.id=7e4eda4c5cd84307b36a5b48642e816f&role.id=4848e2a52e0b428997632ab8a8d36e91 => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:58.533368 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2820cd49-8890-4358-98d3-8729feaa7dcc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:58.535240 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2820cd49-8890-4358-98d3-8729feaa7dcc None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:58.650452 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 351/685] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Mar 30 07:02:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 30 07:02:58.656244 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a68df8f-17b1-4f83-bac2-badab6e45f1c None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:58.773575 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a68df8f-17b1-4f83-bac2-badab6e45f1c None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:58.808360 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd23005-ff58-4d13-9a6a-e2c89c831284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:58.809178 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd23005-ff58-4d13-9a6a-e2c89c831284 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:58.809459 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd23005-ff58-4d13-9a6a-e2c89c831284 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:58.809730 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd23005-ff58-4d13-9a6a-e2c89c831284 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:58.812394 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e882c1-7584-488b-a9c5-f65e7476868d None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:58.812886 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e882c1-7584-488b-a9c5-f65e7476868d None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:58.813347 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e882c1-7584-488b-a9c5-f65e7476868d None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:58.816055 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 352/686] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:02:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:02:58.821729 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c311ae-c552-4f9b-91e8-c8f3ef2e32fe None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:58.822294 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c311ae-c552-4f9b-91e8-c8f3ef2e32fe None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:58.822775 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c311ae-c552-4f9b-91e8-c8f3ef2e32fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:58.823206 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd23005-ff58-4d13-9a6a-e2c89c831284 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:58.824724 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd23005-ff58-4d13-9a6a-e2c89c831284 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:58.843005 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-3cd23005-ff58-4d13-9a6a-e2c89c831284 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 07:02:58.845028 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 335/687] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:02:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:02:58.849522 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-d2c311ae-c552-4f9b-91e8-c8f3ef2e32fe None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:02:58.851417 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd23005-ff58-4d13-9a6a-e2c89c831284 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:58.852463 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-d2c311ae-c552-4f9b-91e8-c8f3ef2e32fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:02:58.945298 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 353/688] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:02:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 07:02:58.962466 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd23005-ff58-4d13-9a6a-e2c89c831284 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:58.980620 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c311ae-c552-4f9b-91e8-c8f3ef2e32fe None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:59.002958 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d385a3-658b-4d4c-b311-99f11f7f50f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:59.003927 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d385a3-658b-4d4c-b311-99f11f7f50f7 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:59.004418 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d385a3-658b-4d4c-b311-99f11f7f50f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:59.004826 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d385a3-658b-4d4c-b311-99f11f7f50f7 None admin] PATH_INFO: `/v3/domains` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:59.005682 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d385a3-658b-4d4c-b311-99f11f7f50f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:59.006119 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d385a3-658b-4d4c-b311-99f11f7f50f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:59.007715 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d385a3-658b-4d4c-b311-99f11f7f50f7 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:59.029536 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 336/689] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Mar 30 07:02:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:02:59.031188 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d385a3-658b-4d4c-b311-99f11f7f50f7 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:59.105537 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c311ae-c552-4f9b-91e8-c8f3ef2e32fe None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:59.149394 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099d90a1-09ea-478e-b870-97522f372f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:59.150469 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099d90a1-09ea-478e-b870-97522f372f3f None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:59.150783 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099d90a1-09ea-478e-b870-97522f372f3f None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:59.151155 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099d90a1-09ea-478e-b870-97522f372f3f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:59.161785 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099d90a1-09ea-478e-b870-97522f372f3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 07:02:59.166861 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d385a3-658b-4d4c-b311-99f11f7f50f7 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:59.169775 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-099d90a1-09ea-478e-b870-97522f372f3f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 30 07:02:59.170867 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 354/690] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Mar 30 07:02:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 07:02:59.172236 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e2255-61b5-4feb-a5b6-0d316af3006a None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:59.172620 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e2255-61b5-4feb-a5b6-0d316af3006a None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:59.172991 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e2255-61b5-4feb-a5b6-0d316af3006a None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:59.178815 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 355/691] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:02:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:02:59.179692 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950e2255-61b5-4feb-a5b6-0d316af3006a None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:59.201443 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7f8e3e-38bf-4eae-a293-32ac972d4cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:59.212832 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f8e3e-38bf-4eae-a293-32ac972d4cf8 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:59.213268 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f8e3e-38bf-4eae-a293-32ac972d4cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:59.213746 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f8e3e-38bf-4eae-a293-32ac972d4cf8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:59.221358 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7f8e3e-38bf-4eae-a293-32ac972d4cf8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:59.223088 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7f8e3e-38bf-4eae-a293-32ac972d4cf8 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:59.237151 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-2b7f8e3e-38bf-4eae-a293-32ac972d4cf8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 30 07:02:59.238940 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 337/692] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Mar 30 07:02:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:02:59.240403 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3258d8-2c88-4484-92fd-996d024a2e30 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:59.240901 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3258d8-2c88-4484-92fd-996d024a2e30 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:59.241384 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3258d8-2c88-4484-92fd-996d024a2e30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:59.258684 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-9a3258d8-2c88-4484-92fd-996d024a2e30 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:02:59.260597 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-9a3258d8-2c88-4484-92fd-996d024a2e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:02:59.281885 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950e2255-61b5-4feb-a5b6-0d316af3006a None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:59.315996 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eba205b-ba5a-483a-b100-8aeb75b02d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:59.316674 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba205b-ba5a-483a-b100-8aeb75b02d62 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:59.316998 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba205b-ba5a-483a-b100-8aeb75b02d62 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:59.317282 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba205b-ba5a-483a-b100-8aeb75b02d62 None admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:59.318186 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eba205b-ba5a-483a-b100-8aeb75b02d62 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:59.318378 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eba205b-ba5a-483a-b100-8aeb75b02d62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:59.319754 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eba205b-ba5a-483a-b100-8aeb75b02d62 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:59.329026 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 356/693] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Mar 30 07:02:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:59.329847 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eba205b-ba5a-483a-b100-8aeb75b02d62 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:59.334566 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 338/694] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:02:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 07:02:59.335705 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3258d8-2c88-4484-92fd-996d024a2e30 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:59.446614 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3258d8-2c88-4484-92fd-996d024a2e30 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:59.452461 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eba205b-ba5a-483a-b100-8aeb75b02d62 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:59.481112 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434447eb-8895-4d21-8d3e-a2275fa56935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:59.482293 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434447eb-8895-4d21-8d3e-a2275fa56935 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:59.482785 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434447eb-8895-4d21-8d3e-a2275fa56935 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:59.483242 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434447eb-8895-4d21-8d3e-a2275fa56935 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:59.486929 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a3f531-4081-4a91-bb33-3eb0a89b29e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:59.487657 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a3f531-4081-4a91-bb33-3eb0a89b29e7 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:59.488032 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a3f531-4081-4a91-bb33-3eb0a89b29e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:59.488313 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a3f531-4081-4a91-bb33-3eb0a89b29e7 None admin] PATH_INFO: `/v3/projects` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:59.489108 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a3f531-4081-4a91-bb33-3eb0a89b29e7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:59.489467 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a3f531-4081-4a91-bb33-3eb0a89b29e7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:59.490928 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a3f531-4081-4a91-bb33-3eb0a89b29e7 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:59.496209 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434447eb-8895-4d21-8d3e-a2275fa56935 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:59.497900 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434447eb-8895-4d21-8d3e-a2275fa56935 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:59.504715 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 357/695] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Mar 30 07:02:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:59.505684 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a3f531-4081-4a91-bb33-3eb0a89b29e7 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:59.516952 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-434447eb-8895-4d21-8d3e-a2275fa56935 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 07:02:59.518729 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 339/696] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:02:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:02:59.519759 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434447eb-8895-4d21-8d3e-a2275fa56935 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:59.606456 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a3f531-4081-4a91-bb33-3eb0a89b29e7 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:59.618062 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434447eb-8895-4d21-8d3e-a2275fa56935 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:59.641290 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a588402-3981-4258-ad20-eaa87dc62fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:59.642208 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a588402-3981-4258-ad20-eaa87dc62fd4 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:59.642560 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a588402-3981-4258-ad20-eaa87dc62fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:59.642906 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a588402-3981-4258-ad20-eaa87dc62fd4 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:59.643864 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a588402-3981-4258-ad20-eaa87dc62fd4 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:59.645405 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a588402-3981-4258-ad20-eaa87dc62fd4 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:59.653094 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce55cdf-417f-4696-bc3c-9a93d4b94cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:59.653925 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce55cdf-417f-4696-bc3c-9a93d4b94cc4 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:59.654366 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce55cdf-417f-4696-bc3c-9a93d4b94cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:59.654771 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce55cdf-417f-4696-bc3c-9a93d4b94cc4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:59.655724 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce55cdf-417f-4696-bc3c-9a93d4b94cc4 None admin] RBAC: Adding query filter params (role.id=4848e2a52e0b428997632ab8a8d36e91, scope.project.id=7e4eda4c5cd84307b36a5b48642e816f, user.id=c452249c502d4b0688e8dd068f8c4951) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:59.656208 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce55cdf-417f-4696-bc3c-9a93d4b94cc4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:59.657882 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce55cdf-417f-4696-bc3c-9a93d4b94cc4 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:59.659463 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-6a588402-3981-4258-ad20-eaa87dc62fd4 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Mar 30 07:02:59.664400 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 340/698] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Mar 30 07:02:59 2022] GET /identity/v3/role_assignments?user.id=c452249c502d4b0688e8dd068f8c4951&scope.project.id=7e4eda4c5cd84307b36a5b48642e816f&role.id=4848e2a52e0b428997632ab8a8d36e91 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:59.665902 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 358/698] 10.222.0.20 () {56 vars in 1129 bytes} [Wed Mar 30 07:02:59 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:02:59.666135 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce55cdf-417f-4696-bc3c-9a93d4b94cc4 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:59.666807 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a588402-3981-4258-ad20-eaa87dc62fd4 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:59.768931 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce55cdf-417f-4696-bc3c-9a93d4b94cc4 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:59.773154 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a588402-3981-4258-ad20-eaa87dc62fd4 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:59.805498 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791722ad-7aa7-4143-ab5f-3ac96138416b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:59.806721 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791722ad-7aa7-4143-ab5f-3ac96138416b None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:59.807321 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791722ad-7aa7-4143-ab5f-3ac96138416b None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:59.807764 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791722ad-7aa7-4143-ab5f-3ac96138416b None admin] PATH_INFO: `/v3/domains` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:59.808783 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791722ad-7aa7-4143-ab5f-3ac96138416b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:59.809253 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791722ad-7aa7-4143-ab5f-3ac96138416b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:59.809372 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ca3a8a-d12b-4e47-a781-a0c3f62fd132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:02:59.810138 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ca3a8a-d12b-4e47-a781-a0c3f62fd132 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:02:59.810490 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ca3a8a-d12b-4e47-a781-a0c3f62fd132 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:02:59.810836 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ca3a8a-d12b-4e47-a781-a0c3f62fd132 None admin] PATH_INFO: `/v3/services` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:02:59.811526 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791722ad-7aa7-4143-ab5f-3ac96138416b None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:59.811647 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ca3a8a-d12b-4e47-a781-a0c3f62fd132 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:02:59.812035 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ca3a8a-d12b-4e47-a781-a0c3f62fd132 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:02:59.813712 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ca3a8a-d12b-4e47-a781-a0c3f62fd132 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:02:59.819098 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 359/699] 10.222.0.20 () {56 vars in 1124 bytes} [Wed Mar 30 07:02:59 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:02:59.825044 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ca3a8a-d12b-4e47-a781-a0c3f62fd132 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:59.826350 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 341/700] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Mar 30 07:02:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:02:59.831258 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791722ad-7aa7-4143-ab5f-3ac96138416b None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:02:59.935844 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ca3a8a-d12b-4e47-a781-a0c3f62fd132 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:02:59.962103 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791722ad-7aa7-4143-ab5f-3ac96138416b None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:00.002820 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b77870-2e8d-404e-ac74-45aa77223075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:00.003070 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc2518e-bc9f-43fe-982a-b458a129b4e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:00.003754 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc2518e-bc9f-43fe-982a-b458a129b4e1 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:00.004161 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc2518e-bc9f-43fe-982a-b458a129b4e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:00.004442 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc2518e-bc9f-43fe-982a-b458a129b4e1 None admin] PATH_INFO: `/v3/services` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:00.004802 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b77870-2e8d-404e-ac74-45aa77223075 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:00.005230 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc2518e-bc9f-43fe-982a-b458a129b4e1 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:00.005466 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b77870-2e8d-404e-ac74-45aa77223075 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:00.005562 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc2518e-bc9f-43fe-982a-b458a129b4e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:00.006015 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b77870-2e8d-404e-ac74-45aa77223075 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:00.006934 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc2518e-bc9f-43fe-982a-b458a129b4e1 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:00.015817 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 360/701] 10.222.0.20 () {56 vars in 1124 bytes} [Wed Mar 30 07:02:59 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:00.016698 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b77870-2e8d-404e-ac74-45aa77223075 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:00.018390 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b77870-2e8d-404e-ac74-45aa77223075 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:00.036906 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-52b77870-2e8d-404e-ac74-45aa77223075 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 30 07:03:00.039463 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 342/702] 10.222.0.20 () {56 vars in 1093 bytes} [Wed Mar 30 07:02:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 07:03:00.045078 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc2518e-bc9f-43fe-982a-b458a129b4e1 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:00.159310 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc2518e-bc9f-43fe-982a-b458a129b4e1 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:00.194499 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f177cce3-3f87-4055-99e2-0e3e664763e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:00.195185 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f177cce3-3f87-4055-99e2-0e3e664763e0 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:00.195467 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f177cce3-3f87-4055-99e2-0e3e664763e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:00.195737 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f177cce3-3f87-4055-99e2-0e3e664763e0 None admin] PATH_INFO: `/v3/users` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:00.196638 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f177cce3-3f87-4055-99e2-0e3e664763e0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:00.197192 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f177cce3-3f87-4055-99e2-0e3e664763e0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:00.198457 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f177cce3-3f87-4055-99e2-0e3e664763e0 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:00.231305 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 361/703] 10.222.0.20 () {56 vars in 1133 bytes} [Wed Mar 30 07:03:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:03:00.236962 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b77870-2e8d-404e-ac74-45aa77223075 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:00.349952 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b77870-2e8d-404e-ac74-45aa77223075 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:00.393880 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b63981-b0df-4434-a0c2-8ca4407bf38c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:00.394543 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b63981-b0df-4434-a0c2-8ca4407bf38c None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:00.394818 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b63981-b0df-4434-a0c2-8ca4407bf38c None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:00.395089 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b63981-b0df-4434-a0c2-8ca4407bf38c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:00.473963 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b63981-b0df-4434-a0c2-8ca4407bf38c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:00.475430 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b63981-b0df-4434-a0c2-8ca4407bf38c None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:00.611597 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 343/704] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Mar 30 07:03:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 30 07:03:00.616808 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f177cce3-3f87-4055-99e2-0e3e664763e0 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:00.766440 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f177cce3-3f87-4055-99e2-0e3e664763e0 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:00.815506 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06925ec3-e70c-4a44-a417-ed1671b868c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:00.816334 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06925ec3-e70c-4a44-a417-ed1671b868c9 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:00.816618 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06925ec3-e70c-4a44-a417-ed1671b868c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:00.816893 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06925ec3-e70c-4a44-a417-ed1671b868c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:00.830717 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06925ec3-e70c-4a44-a417-ed1671b868c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:00.832256 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06925ec3-e70c-4a44-a417-ed1671b868c9 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:00.861025 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-06925ec3-e70c-4a44-a417-ed1671b868c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 07:03:00.863028 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 362/705] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:03:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:03:00.868294 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b63981-b0df-4434-a0c2-8ca4407bf38c None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:00.977065 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b63981-b0df-4434-a0c2-8ca4407bf38c None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:01.011697 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53a0fdc-cb6e-4ce7-8723-a0a967cc4dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:01.012737 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a0fdc-cb6e-4ce7-8723-a0a967cc4dd1 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:01.013226 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a0fdc-cb6e-4ce7-8723-a0a967cc4dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:01.013701 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a0fdc-cb6e-4ce7-8723-a0a967cc4dd1 None admin] PATH_INFO: `/v3/domains` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:01.014601 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53a0fdc-cb6e-4ce7-8723-a0a967cc4dd1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:01.015091 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53a0fdc-cb6e-4ce7-8723-a0a967cc4dd1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:01.016679 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53a0fdc-cb6e-4ce7-8723-a0a967cc4dd1 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:01.028830 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 344/706] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Mar 30 07:03:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:01.033950 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06925ec3-e70c-4a44-a417-ed1671b868c9 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:01.192699 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06925ec3-e70c-4a44-a417-ed1671b868c9 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:01.232356 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8cc300-ed9b-4e51-a94a-a92180aed859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:01.233931 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8cc300-ed9b-4e51-a94a-a92180aed859 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:01.234382 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8cc300-ed9b-4e51-a94a-a92180aed859 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:01.234798 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8cc300-ed9b-4e51-a94a-a92180aed859 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:01.243129 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8cc300-ed9b-4e51-a94a-a92180aed859 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:01.245180 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8cc300-ed9b-4e51-a94a-a92180aed859 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:01.253775 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe24af-b74d-47b4-b1eb-c747ccdefd5b None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:01.254638 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe24af-b74d-47b4-b1eb-c747ccdefd5b None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:01.255051 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe24af-b74d-47b4-b1eb-c747ccdefd5b None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:01.256997 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 345/707] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:03:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 30 07:03:01.262383 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0fad58-adfc-4a10-82aa-9f0cd17227df None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:01.262833 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0fad58-adfc-4a10-82aa-9f0cd17227df None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:01.263264 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0fad58-adfc-4a10-82aa-9f0cd17227df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:01.284481 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-fd8cc300-ed9b-4e51-a94a-a92180aed859 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 30 07:03:01.287762 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 363/708] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Mar 30 07:03:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:03:01.292646 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8cc300-ed9b-4e51-a94a-a92180aed859 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:01.294470 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-2e0fad58-adfc-4a10-82aa-9f0cd17227df None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:03:01.305550 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-2e0fad58-adfc-4a10-82aa-9f0cd17227df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:03:01.418924 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 346/709] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:03:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 30 07:03:01.421035 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5413b806-1179-42b5-96eb-80bae348065d None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:01.421460 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5413b806-1179-42b5-96eb-80bae348065d None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:01.422727 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5413b806-1179-42b5-96eb-80bae348065d None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:01.429537 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 347/710] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:03:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:03:01.431716 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc89f401-b48b-4d49-9fb5-d41ae9c20efc None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:01.433349 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc89f401-b48b-4d49-9fb5-d41ae9c20efc None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:01.433349 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc89f401-b48b-4d49-9fb5-d41ae9c20efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:01.451212 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-cc89f401-b48b-4d49-9fb5-d41ae9c20efc None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:03:01.452630 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-cc89f401-b48b-4d49-9fb5-d41ae9c20efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:03:01.460585 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8cc300-ed9b-4e51-a94a-a92180aed859 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:01.497868 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08e43b4-0df6-45d9-a873-650b68e247a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:01.499070 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e43b4-0df6-45d9-a873-650b68e247a6 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:01.499918 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e43b4-0df6-45d9-a873-650b68e247a6 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:01.500723 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e43b4-0df6-45d9-a873-650b68e247a6 None admin] PATH_INFO: `/v3/projects` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:01.502041 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08e43b4-0df6-45d9-a873-650b68e247a6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:01.502580 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08e43b4-0df6-45d9-a873-650b68e247a6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:01.504293 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08e43b4-0df6-45d9-a873-650b68e247a6 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:01.518632 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 364/711] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Mar 30 07:03:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:03:01.520644 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08e43b4-0df6-45d9-a873-650b68e247a6 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:01.525549 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 348/712] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:03:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 07:03:01.526614 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc89f401-b48b-4d49-9fb5-d41ae9c20efc None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:01.630119 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc89f401-b48b-4d49-9fb5-d41ae9c20efc None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:01.656430 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08e43b4-0df6-45d9-a873-650b68e247a6 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:01.666038 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b09b41-c6ef-4a91-b42d-5ee6d7dfca91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:01.667122 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b09b41-c6ef-4a91-b42d-5ee6d7dfca91 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:01.667554 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b09b41-c6ef-4a91-b42d-5ee6d7dfca91 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:01.667989 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b09b41-c6ef-4a91-b42d-5ee6d7dfca91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:01.669211 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b09b41-c6ef-4a91-b42d-5ee6d7dfca91 None admin] RBAC: Adding query filter params (role.id=1c39b9ab8cfd4c0ea71845831920a845, scope.project.id=7e4eda4c5cd84307b36a5b48642e816f, user.id=72b398c5ed14484d8b7a51fee900597b) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:01.669740 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b09b41-c6ef-4a91-b42d-5ee6d7dfca91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:01.671470 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b09b41-c6ef-4a91-b42d-5ee6d7dfca91 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:01.677933 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 349/713] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Mar 30 07:03:01 2022] GET /identity/v3/role_assignments?user.id=72b398c5ed14484d8b7a51fee900597b&scope.project.id=7e4eda4c5cd84307b36a5b48642e816f&role.id=1c39b9ab8cfd4c0ea71845831920a845 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:01.679054 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b09b41-c6ef-4a91-b42d-5ee6d7dfca91 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:01.694400 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a734d112-69d4-4bca-ba8f-14a0b604a177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:01.695390 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a734d112-69d4-4bca-ba8f-14a0b604a177 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:01.695673 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a734d112-69d4-4bca-ba8f-14a0b604a177 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:01.695984 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a734d112-69d4-4bca-ba8f-14a0b604a177 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:01.708107 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a734d112-69d4-4bca-ba8f-14a0b604a177 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:01.709487 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a734d112-69d4-4bca-ba8f-14a0b604a177 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:01.730595 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-a734d112-69d4-4bca-ba8f-14a0b604a177 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 07:03:01.732249 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 365/714] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:03:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:03:01.739084 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a734d112-69d4-4bca-ba8f-14a0b604a177 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:01.794805 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b09b41-c6ef-4a91-b42d-5ee6d7dfca91 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:01.833268 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b3214c-c709-4b36-b720-3ed08a7c6e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:01.834534 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b3214c-c709-4b36-b720-3ed08a7c6e3b None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:01.835222 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b3214c-c709-4b36-b720-3ed08a7c6e3b None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:01.836967 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b3214c-c709-4b36-b720-3ed08a7c6e3b None admin] PATH_INFO: `/v3/services/network` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:01.837946 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b3214c-c709-4b36-b720-3ed08a7c6e3b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:01.841125 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b3214c-c709-4b36-b720-3ed08a7c6e3b None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:01.866771 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-69b3214c-c709-4b36-b720-3ed08a7c6e3b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Mar 30 07:03:01.868932 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 350/715] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Mar 30 07:03:01 2022] GET /identity/v3/services/network => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:03:01.879112 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b3214c-c709-4b36-b720-3ed08a7c6e3b None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:01.988409 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a734d112-69d4-4bca-ba8f-14a0b604a177 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:02.002747 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b3214c-c709-4b36-b720-3ed08a7c6e3b None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:02.034378 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf325b9-4e07-47b9-afaa-17d072184e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:02.035066 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf325b9-4e07-47b9-afaa-17d072184e0e None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:02.035342 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf325b9-4e07-47b9-afaa-17d072184e0e None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:02.035778 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf325b9-4e07-47b9-afaa-17d072184e0e None admin] PATH_INFO: `/v3/domains` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:02.036670 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf325b9-4e07-47b9-afaa-17d072184e0e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:02.037140 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf325b9-4e07-47b9-afaa-17d072184e0e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:02.038670 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf325b9-4e07-47b9-afaa-17d072184e0e None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:02.048981 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872cab1e-96c8-41e2-9b36-9ece58c3db56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:02.054326 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872cab1e-96c8-41e2-9b36-9ece58c3db56 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:02.054827 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872cab1e-96c8-41e2-9b36-9ece58c3db56 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:02.057500 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872cab1e-96c8-41e2-9b36-9ece58c3db56 None admin] PATH_INFO: `/v3/services` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:02.059061 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872cab1e-96c8-41e2-9b36-9ece58c3db56 None admin] RBAC: Adding query filter params (name=network) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:02.059641 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872cab1e-96c8-41e2-9b36-9ece58c3db56 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:02.061551 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872cab1e-96c8-41e2-9b36-9ece58c3db56 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:02.068420 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 366/716] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Mar 30 07:03:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:02.075243 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf325b9-4e07-47b9-afaa-17d072184e0e None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:02.083937 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 351/717] 10.222.0.20 () {56 vars in 1112 bytes} [Wed Mar 30 07:03:01 2022] GET /identity/v3/services?name=network => generated 124 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:02.087243 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872cab1e-96c8-41e2-9b36-9ece58c3db56 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:02.270765 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf325b9-4e07-47b9-afaa-17d072184e0e None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:02.283422 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872cab1e-96c8-41e2-9b36-9ece58c3db56 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:02.329212 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125af74c-629f-45e5-81fb-08955269674b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:02.329891 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125af74c-629f-45e5-81fb-08955269674b None admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:02.330168 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125af74c-629f-45e5-81fb-08955269674b None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:02.330438 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125af74c-629f-45e5-81fb-08955269674b None admin] PATH_INFO: `/v3/users` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:02.331146 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125af74c-629f-45e5-81fb-08955269674b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:02.332616 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125af74c-629f-45e5-81fb-08955269674b None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:02.348075 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92716ee-d585-4398-99e4-96c7ea712c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:02.348740 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92716ee-d585-4398-99e4-96c7ea712c2e None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:02.349016 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92716ee-d585-4398-99e4-96c7ea712c2e None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:02.349280 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92716ee-d585-4398-99e4-96c7ea712c2e None admin] PATH_INFO: `/v3/services` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:02.349978 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92716ee-d585-4398-99e4-96c7ea712c2e None admin] RBAC: Adding query filter params (type=network) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:02.350275 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92716ee-d585-4398-99e4-96c7ea712c2e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:02.351634 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92716ee-d585-4398-99e4-96c7ea712c2e None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:02.361721 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 352/718] 10.222.0.20 () {56 vars in 1112 bytes} [Wed Mar 30 07:03:02 2022] GET /identity/v3/services?type=network => generated 124 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:03:02.374913 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 367/719] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Mar 30 07:03:02 2022] POST /identity/v3/users => generated 254 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 07:03:02.904491 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3a71ca-ce62-424d-a1a2-ee4917fcbfbc None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:02.904883 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3a71ca-ce62-424d-a1a2-ee4917fcbfbc None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:02.905059 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3a71ca-ce62-424d-a1a2-ee4917fcbfbc None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:02.907074 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 353/720] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:03:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:03:02.912389 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d93676-0ae9-4770-8e95-a5d97afc0d51 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:02.912871 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d93676-0ae9-4770-8e95-a5d97afc0d51 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:02.912959 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d93676-0ae9-4770-8e95-a5d97afc0d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:02.936890 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-c4d93676-0ae9-4770-8e95-a5d97afc0d51 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:03:02.938089 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-c4d93676-0ae9-4770-8e95-a5d97afc0d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:03:02.982098 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cdfe15-2ed7-437f-ba1a-a33519a600fb None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:02.982574 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cdfe15-2ed7-437f-ba1a-a33519a600fb None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:02.982855 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cdfe15-2ed7-437f-ba1a-a33519a600fb None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:02.986082 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 354/721] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:03:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:03:02.990022 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b394bfa-b386-493c-9c3b-3b8f182f5d58 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:02.990308 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b394bfa-b386-493c-9c3b-3b8f182f5d58 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:02.990575 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b394bfa-b386-493c-9c3b-3b8f182f5d58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:03.015145 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-1b394bfa-b386-493c-9c3b-3b8f182f5d58 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:03:03.016371 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-1b394bfa-b386-493c-9c3b-3b8f182f5d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:03:03.020252 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 368/722] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:03:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 07:03:03.055758 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d93676-0ae9-4770-8e95-a5d97afc0d51 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:03.091096 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 355/723] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:03:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 30 07:03:03.121652 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b394bfa-b386-493c-9c3b-3b8f182f5d58 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:03.196592 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d93676-0ae9-4770-8e95-a5d97afc0d51 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:03.239510 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b394bfa-b386-493c-9c3b-3b8f182f5d58 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:03.248529 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349eca85-e0ec-4a5f-84d2-d8b8d14f3ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:03.249364 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349eca85-e0ec-4a5f-84d2-d8b8d14f3ae5 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:03.249643 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349eca85-e0ec-4a5f-84d2-d8b8d14f3ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:03.249909 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349eca85-e0ec-4a5f-84d2-d8b8d14f3ae5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:03.268912 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349eca85-e0ec-4a5f-84d2-d8b8d14f3ae5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 07:03:03.276020 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-349eca85-e0ec-4a5f-84d2-d8b8d14f3ae5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 30 07:03:03.277851 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 369/724] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Mar 30 07:03:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 07:03:03.283179 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349eca85-e0ec-4a5f-84d2-d8b8d14f3ae5 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:03.283295 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448d8842-1c0d-4cd5-8b45-085116627027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:03.284007 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d8842-1c0d-4cd5-8b45-085116627027 None admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:03.284974 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d8842-1c0d-4cd5-8b45-085116627027 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:03.285390 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d8842-1c0d-4cd5-8b45-085116627027 None admin] PATH_INFO: `/v3/services` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:03.286259 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448d8842-1c0d-4cd5-8b45-085116627027 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:03.287833 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448d8842-1c0d-4cd5-8b45-085116627027 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:03.323551 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 356/725] 10.222.0.20 () {60 vars in 1141 bytes} [Wed Mar 30 07:03:03 2022] POST /identity/v3/services => generated 251 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 07:03:03.395024 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349eca85-e0ec-4a5f-84d2-d8b8d14f3ae5 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:03.445166 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127c1b4f-9352-4c08-9545-563cbff531b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:03.445849 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127c1b4f-9352-4c08-9545-563cbff531b5 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:03.446124 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127c1b4f-9352-4c08-9545-563cbff531b5 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:03.446389 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127c1b4f-9352-4c08-9545-563cbff531b5 None admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:03.447239 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127c1b4f-9352-4c08-9545-563cbff531b5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:03.447478 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127c1b4f-9352-4c08-9545-563cbff531b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:03.448928 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127c1b4f-9352-4c08-9545-563cbff531b5 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:03.458894 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 370/726] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Mar 30 07:03:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:03.464571 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448d8842-1c0d-4cd5-8b45-085116627027 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:03.629429 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448d8842-1c0d-4cd5-8b45-085116627027 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:03.662494 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f808c7-b18b-41a3-b91e-8ad2f30ff6ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:03.663297 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f808c7-b18b-41a3-b91e-8ad2f30ff6ee None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:03.663622 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f808c7-b18b-41a3-b91e-8ad2f30ff6ee None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:03.663924 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f808c7-b18b-41a3-b91e-8ad2f30ff6ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:03.674700 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f808c7-b18b-41a3-b91e-8ad2f30ff6ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:03.676240 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f808c7-b18b-41a3-b91e-8ad2f30ff6ee None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:03.693190 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-c3f808c7-b18b-41a3-b91e-8ad2f30ff6ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 07:03:03.694756 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 357/727] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:03:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:03:03.700325 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127c1b4f-9352-4c08-9545-563cbff531b5 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:03.811438 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127c1b4f-9352-4c08-9545-563cbff531b5 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:03.846130 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dbf7ab-bc23-4746-82c0-a7acc83c287d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:03.847239 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dbf7ab-bc23-4746-82c0-a7acc83c287d None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:03.847716 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dbf7ab-bc23-4746-82c0-a7acc83c287d None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:03.848207 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dbf7ab-bc23-4746-82c0-a7acc83c287d None admin] PATH_INFO: `/v3/domains` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:03.849155 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dbf7ab-bc23-4746-82c0-a7acc83c287d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:03.849650 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dbf7ab-bc23-4746-82c0-a7acc83c287d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:03.851230 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dbf7ab-bc23-4746-82c0-a7acc83c287d None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:03.865902 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 371/728] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Mar 30 07:03:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:03:03.871486 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f808c7-b18b-41a3-b91e-8ad2f30ff6ee None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:04.025101 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f808c7-b18b-41a3-b91e-8ad2f30ff6ee None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:04.074299 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399979ec-ee24-43b4-9c93-6ec53fc6d4fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:04.075111 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399979ec-ee24-43b4-9c93-6ec53fc6d4fa None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:04.075394 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399979ec-ee24-43b4-9c93-6ec53fc6d4fa None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:04.075669 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399979ec-ee24-43b4-9c93-6ec53fc6d4fa None admin] PATH_INFO: `/v3/users/swift` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:04.089302 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399979ec-ee24-43b4-9c93-6ec53fc6d4fa None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:04.090787 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399979ec-ee24-43b4-9c93-6ec53fc6d4fa None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:04.112314 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-399979ec-ee24-43b4-9c93-6ec53fc6d4fa None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Mar 30 07:03:04.113930 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 358/729] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Mar 30 07:03:03 2022] GET /identity/v3/users/swift => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:03:04.119978 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dbf7ab-bc23-4746-82c0-a7acc83c287d None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:04.242794 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dbf7ab-bc23-4746-82c0-a7acc83c287d None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:04.279905 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12d32e9-0f38-43bc-a7cf-2ce324286167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:04.280545 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d32e9-0f38-43bc-a7cf-2ce324286167 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:04.280826 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d32e9-0f38-43bc-a7cf-2ce324286167 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:04.281097 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d32e9-0f38-43bc-a7cf-2ce324286167 None admin] PATH_INFO: `/v3/users` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:04.281935 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12d32e9-0f38-43bc-a7cf-2ce324286167 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:04.282238 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12d32e9-0f38-43bc-a7cf-2ce324286167 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:04.283684 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12d32e9-0f38-43bc-a7cf-2ce324286167 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:04.305389 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 372/730] 10.222.0.20 () {56 vars in 1135 bytes} [Wed Mar 30 07:03:04 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:03:04.311035 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399979ec-ee24-43b4-9c93-6ec53fc6d4fa None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:04.458343 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399979ec-ee24-43b4-9c93-6ec53fc6d4fa None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:04.501834 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b27a0ca-2a8d-4612-a093-30994b8ed1f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:04.502493 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b27a0ca-2a8d-4612-a093-30994b8ed1f4 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:04.502774 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b27a0ca-2a8d-4612-a093-30994b8ed1f4 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:04.503046 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b27a0ca-2a8d-4612-a093-30994b8ed1f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:04.524846 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05178ac1-63c0-46db-9c0c-48b1f16170f3 None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:04.525577 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05178ac1-63c0-46db-9c0c-48b1f16170f3 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:04.526080 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05178ac1-63c0-46db-9c0c-48b1f16170f3 None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:04.528308 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 373/731] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:03:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:03:04.533437 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df13d54f-ea25-46a2-b8dc-5d732742c5dc None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:04.533968 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df13d54f-ea25-46a2-b8dc-5d732742c5dc None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:04.534437 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df13d54f-ea25-46a2-b8dc-5d732742c5dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:04.576954 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-df13d54f-ea25-46a2-b8dc-5d732742c5dc None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:03:04.577427 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b27a0ca-2a8d-4612-a093-30994b8ed1f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:04.578618 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-df13d54f-ea25-46a2-b8dc-5d732742c5dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:03:04.579255 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b27a0ca-2a8d-4612-a093-30994b8ed1f4 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:04.703063 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 359/732] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Mar 30 07:03:04 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 30 07:03:04.708622 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b27a0ca-2a8d-4612-a093-30994b8ed1f4 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:04.714486 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 374/733] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:03:04 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 07:03:04.753047 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df13d54f-ea25-46a2-b8dc-5d732742c5dc None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:04.845872 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b27a0ca-2a8d-4612-a093-30994b8ed1f4 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:04.885913 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612507e2-6129-4c48-b49d-bb0fdd7c322b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:04.886724 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612507e2-6129-4c48-b49d-bb0fdd7c322b None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:04.887003 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612507e2-6129-4c48-b49d-bb0fdd7c322b None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:04.887275 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612507e2-6129-4c48-b49d-bb0fdd7c322b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:04.898524 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612507e2-6129-4c48-b49d-bb0fdd7c322b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:04.900099 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612507e2-6129-4c48-b49d-bb0fdd7c322b None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:04.918844 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-612507e2-6129-4c48-b49d-bb0fdd7c322b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 07:03:04.920607 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 360/734] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:03:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 07:03:04.925835 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612507e2-6129-4c48-b49d-bb0fdd7c322b None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:04.952726 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df13d54f-ea25-46a2-b8dc-5d732742c5dc None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:05.019673 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ea2933-319b-4013-9e8b-1646f7417357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:05.020928 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ea2933-319b-4013-9e8b-1646f7417357 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:05.021434 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ea2933-319b-4013-9e8b-1646f7417357 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:05.021943 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ea2933-319b-4013-9e8b-1646f7417357 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:05.032922 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ea2933-319b-4013-9e8b-1646f7417357 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 07:03:05.040277 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-d1ea2933-319b-4013-9e8b-1646f7417357 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 30 07:03:05.042339 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 375/735] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Mar 30 07:03:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 07:03:05.048052 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ea2933-319b-4013-9e8b-1646f7417357 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:05.141996 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612507e2-6129-4c48-b49d-bb0fdd7c322b None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:05.182185 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ea2933-319b-4013-9e8b-1646f7417357 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:05.217164 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbb8716-5f6c-4c98-8f62-48afcd62648f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:05.218134 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb8716-5f6c-4c98-8f62-48afcd62648f None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:05.218631 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb8716-5f6c-4c98-8f62-48afcd62648f None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:05.219105 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb8716-5f6c-4c98-8f62-48afcd62648f None admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:05.220074 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbb8716-5f6c-4c98-8f62-48afcd62648f None admin] RBAC: Adding query filter params (name=admin) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:05.220470 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0289969-5763-488b-b176-3c3f101824e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:05.220611 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbb8716-5f6c-4c98-8f62-48afcd62648f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:05.221484 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0289969-5763-488b-b176-3c3f101824e4 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:05.221953 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0289969-5763-488b-b176-3c3f101824e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:05.222142 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbb8716-5f6c-4c98-8f62-48afcd62648f None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:05.222586 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0289969-5763-488b-b176-3c3f101824e4 None admin] PATH_INFO: `/v3/domains` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:05.223488 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0289969-5763-488b-b176-3c3f101824e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:05.224007 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0289969-5763-488b-b176-3c3f101824e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:05.225546 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0289969-5763-488b-b176-3c3f101824e4 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:05.230950 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 376/736] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Mar 30 07:03:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:03:05.232479 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3601a1-7f14-4298-9072-c81c2879b2e0 None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:05.232892 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3601a1-7f14-4298-9072-c81c2879b2e0 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:05.233313 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3601a1-7f14-4298-9072-c81c2879b2e0 None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:05.235441 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 377/737] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:03:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:03:05.236643 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3601a1-7f14-4298-9072-c81c2879b2e0 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:05.247590 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 361/738] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Mar 30 07:03:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:05.249306 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9ad9db-5ebb-4832-81b3-e1c41b9e35f5 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:05.249783 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9ad9db-5ebb-4832-81b3-e1c41b9e35f5 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:05.250268 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9ad9db-5ebb-4832-81b3-e1c41b9e35f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:05.266540 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-6f9ad9db-5ebb-4832-81b3-e1c41b9e35f5 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:03:05.268061 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-6f9ad9db-5ebb-4832-81b3-e1c41b9e35f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:03:05.335786 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3601a1-7f14-4298-9072-c81c2879b2e0 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:05.352015 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 362/739] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:03:05 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 30 07:03:05.352015 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9ad9db-5ebb-4832-81b3-e1c41b9e35f5 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:05.391774 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1829dee0-76cf-4934-8ba2-15e3f98bb891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:05.393270 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1829dee0-76cf-4934-8ba2-15e3f98bb891 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:05.393500 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1829dee0-76cf-4934-8ba2-15e3f98bb891 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:05.393820 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1829dee0-76cf-4934-8ba2-15e3f98bb891 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:05.407056 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1829dee0-76cf-4934-8ba2-15e3f98bb891 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:05.408551 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1829dee0-76cf-4934-8ba2-15e3f98bb891 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:05.429848 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-1829dee0-76cf-4934-8ba2-15e3f98bb891 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 07:03:05.431353 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 378/740] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:03:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:03:05.432241 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1829dee0-76cf-4934-8ba2-15e3f98bb891 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:05.468733 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9ad9db-5ebb-4832-81b3-e1c41b9e35f5 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:05.505309 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae158d0-894e-47c1-bdc0-51246ea827ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:05.506222 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae158d0-894e-47c1-bdc0-51246ea827ea None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:05.506570 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae158d0-894e-47c1-bdc0-51246ea827ea None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:05.506912 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae158d0-894e-47c1-bdc0-51246ea827ea None admin] PATH_INFO: `/v3/projects/service` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:05.515515 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae158d0-894e-47c1-bdc0-51246ea827ea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:05.517642 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae158d0-894e-47c1-bdc0-51246ea827ea None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:05.533214 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1829dee0-76cf-4934-8ba2-15e3f98bb891 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:05.534079 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-4ae158d0-894e-47c1-bdc0-51246ea827ea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 30 07:03:05.536147 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 363/741] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Mar 30 07:03:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:03:05.537603 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d37c51-1237-456f-93a7-d73b35ea228a None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:05.538074 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d37c51-1237-456f-93a7-d73b35ea228a None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:05.538578 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d37c51-1237-456f-93a7-d73b35ea228a None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:05.540527 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 364/742] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:03:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:03:05.541409 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d37c51-1237-456f-93a7-d73b35ea228a None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:05.572178 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060d9ace-59bb-4629-96aa-226668f1a52b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:05.572856 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060d9ace-59bb-4629-96aa-226668f1a52b None admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:05.573139 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060d9ace-59bb-4629-96aa-226668f1a52b None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:05.573413 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060d9ace-59bb-4629-96aa-226668f1a52b None admin] PATH_INFO: `/v3/services` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:05.574134 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060d9ace-59bb-4629-96aa-226668f1a52b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:05.575553 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060d9ace-59bb-4629-96aa-226668f1a52b None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:05.590569 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 379/743] 10.222.0.20 () {60 vars in 1141 bytes} [Wed Mar 30 07:03:05 2022] POST /identity/v3/services => generated 240 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:03:05.600916 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060d9ace-59bb-4629-96aa-226668f1a52b None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:05.678472 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d37c51-1237-456f-93a7-d73b35ea228a None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:05.715852 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5c0668-cb10-4347-99e4-673002fd2dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:05.716920 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5c0668-cb10-4347-99e4-673002fd2dad None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:05.717390 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5c0668-cb10-4347-99e4-673002fd2dad None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:05.717911 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5c0668-cb10-4347-99e4-673002fd2dad None admin] PATH_INFO: `/v3/domains` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:05.718880 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5c0668-cb10-4347-99e4-673002fd2dad None admin] RBAC: Adding query filter params (name=Default) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:05.719378 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5c0668-cb10-4347-99e4-673002fd2dad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:05.721129 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5c0668-cb10-4347-99e4-673002fd2dad None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:05.729990 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060d9ace-59bb-4629-96aa-226668f1a52b None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:05.739677 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 365/744] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Mar 30 07:03:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:05.741564 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d92767-e86b-48cd-baec-65e598306c38 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:05.742067 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d92767-e86b-48cd-baec-65e598306c38 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:05.742604 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d92767-e86b-48cd-baec-65e598306c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:05.761380 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-19d92767-e86b-48cd-baec-65e598306c38 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:03:05.762957 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-19d92767-e86b-48cd-baec-65e598306c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:03:05.771282 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995ec4d3-3755-4205-bc61-e0e9a4392d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:05.772028 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ec4d3-3755-4205-bc61-e0e9a4392d8d None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:05.772322 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ec4d3-3755-4205-bc61-e0e9a4392d8d None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:05.772622 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ec4d3-3755-4205-bc61-e0e9a4392d8d None admin] PATH_INFO: `/v3/projects` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:05.774124 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995ec4d3-3755-4205-bc61-e0e9a4392d8d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:05.774434 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995ec4d3-3755-4205-bc61-e0e9a4392d8d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:05.776437 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995ec4d3-3755-4205-bc61-e0e9a4392d8d None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:05.791004 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 380/745] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Mar 30 07:03:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:05.792319 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995ec4d3-3755-4205-bc61-e0e9a4392d8d None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:05.855899 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 366/746] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:03:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 30 07:03:05.857178 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d92767-e86b-48cd-baec-65e598306c38 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:05.906781 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995ec4d3-3755-4205-bc61-e0e9a4392d8d None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:05.944229 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c315ec-03b2-4c0e-9af6-3aa1151615a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:05.945390 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c315ec-03b2-4c0e-9af6-3aa1151615a5 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:05.945917 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c315ec-03b2-4c0e-9af6-3aa1151615a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:05.946417 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c315ec-03b2-4c0e-9af6-3aa1151615a5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:05.954396 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c315ec-03b2-4c0e-9af6-3aa1151615a5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:05.956226 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c315ec-03b2-4c0e-9af6-3aa1151615a5 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:05.964580 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d92767-e86b-48cd-baec-65e598306c38 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:05.980157 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-d2c315ec-03b2-4c0e-9af6-3aa1151615a5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 30 07:03:05.981998 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 381/747] 10.222.0.20 () {56 vars in 1093 bytes} [Wed Mar 30 07:03:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:03:05.982976 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c315ec-03b2-4c0e-9af6-3aa1151615a5 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:06.003245 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e1354b-91ff-497c-a42e-734cd2b201bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:06.003932 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e1354b-91ff-497c-a42e-734cd2b201bb None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:06.004218 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e1354b-91ff-497c-a42e-734cd2b201bb None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:06.004648 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e1354b-91ff-497c-a42e-734cd2b201bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:06.005294 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e1354b-91ff-497c-a42e-734cd2b201bb None admin] RBAC: Adding query filter params (role.id=1c39b9ab8cfd4c0ea71845831920a845, scope.project.id=7e4eda4c5cd84307b36a5b48642e816f, user.id=c452249c502d4b0688e8dd068f8c4951) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:06.005594 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e1354b-91ff-497c-a42e-734cd2b201bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:06.007025 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e1354b-91ff-497c-a42e-734cd2b201bb None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:06.013002 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 367/748] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Mar 30 07:03:05 2022] GET /identity/v3/role_assignments?user.id=c452249c502d4b0688e8dd068f8c4951&scope.project.id=7e4eda4c5cd84307b36a5b48642e816f&role.id=1c39b9ab8cfd4c0ea71845831920a845 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:06.013828 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e1354b-91ff-497c-a42e-734cd2b201bb None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:06.095408 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c315ec-03b2-4c0e-9af6-3aa1151615a5 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:06.116971 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e1354b-91ff-497c-a42e-734cd2b201bb None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:06.133833 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578654ef-a54f-435d-9452-17c9ba7b9e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:06.135527 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578654ef-a54f-435d-9452-17c9ba7b9e91 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:06.136052 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578654ef-a54f-435d-9452-17c9ba7b9e91 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:06.136550 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578654ef-a54f-435d-9452-17c9ba7b9e91 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:06.147887 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578654ef-a54f-435d-9452-17c9ba7b9e91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 07:03:06.153537 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8e5537-dfbb-4629-b26b-83353a26c827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:06.154221 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8e5537-dfbb-4629-b26b-83353a26c827 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:06.154497 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8e5537-dfbb-4629-b26b-83353a26c827 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:06.154765 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8e5537-dfbb-4629-b26b-83353a26c827 None admin] PATH_INFO: `/v3/users` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:06.155609 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8e5537-dfbb-4629-b26b-83353a26c827 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:06.155938 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8e5537-dfbb-4629-b26b-83353a26c827 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:06.157386 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8e5537-dfbb-4629-b26b-83353a26c827 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:06.157667 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-578654ef-a54f-435d-9452-17c9ba7b9e91 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 30 07:03:06.159485 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 382/749] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Mar 30 07:03:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:03:06.168926 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578654ef-a54f-435d-9452-17c9ba7b9e91 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:06.177469 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 368/750] 10.222.0.20 () {56 vars in 1133 bytes} [Wed Mar 30 07:03:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:06.188200 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8e5537-dfbb-4629-b26b-83353a26c827 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:06.306348 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8e5537-dfbb-4629-b26b-83353a26c827 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:06.315834 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578654ef-a54f-435d-9452-17c9ba7b9e91 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:06.350625 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b450b8-f675-47fc-bc3a-d7fa19fa1d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:06.351441 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b450b8-f675-47fc-bc3a-d7fa19fa1d05 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:06.351829 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b450b8-f675-47fc-bc3a-d7fa19fa1d05 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:06.352198 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b450b8-f675-47fc-bc3a-d7fa19fa1d05 None admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:06.353067 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b450b8-f675-47fc-bc3a-d7fa19fa1d05 None admin] RBAC: Adding query filter params (name=service) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:06.353461 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b450b8-f675-47fc-bc3a-d7fa19fa1d05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:06.353769 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5930905c-f594-48ba-afc5-2256349f0f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:06.354789 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5930905c-f594-48ba-afc5-2256349f0f51 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:06.355168 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b450b8-f675-47fc-bc3a-d7fa19fa1d05 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:06.355279 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5930905c-f594-48ba-afc5-2256349f0f51 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:06.355597 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5930905c-f594-48ba-afc5-2256349f0f51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:06.365389 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 383/751] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Mar 30 07:03:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:06.367407 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da572b0-dba2-491e-9c5b-f5b3ee3ab5a1 None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:06.367609 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5930905c-f594-48ba-afc5-2256349f0f51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:06.367719 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da572b0-dba2-491e-9c5b-f5b3ee3ab5a1 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:06.367976 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da572b0-dba2-491e-9c5b-f5b3ee3ab5a1 None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:06.369167 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5930905c-f594-48ba-afc5-2256349f0f51 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:06.369900 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 384/752] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:03:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:03:06.372634 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da572b0-dba2-491e-9c5b-f5b3ee3ab5a1 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:06.391092 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-5930905c-f594-48ba-afc5-2256349f0f51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 07:03:06.392891 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 369/753] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:03:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 07:03:06.394098 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373dd8e2-daf6-4625-bd8c-933ef8af5883 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:06.394376 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373dd8e2-daf6-4625-bd8c-933ef8af5883 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:06.394642 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373dd8e2-daf6-4625-bd8c-933ef8af5883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:06.415878 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-373dd8e2-daf6-4625-bd8c-933ef8af5883 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:03:06.417268 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-373dd8e2-daf6-4625-bd8c-933ef8af5883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:03:06.481066 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da572b0-dba2-491e-9c5b-f5b3ee3ab5a1 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:06.493048 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 370/754] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:03:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 30 07:03:06.494026 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373dd8e2-daf6-4625-bd8c-933ef8af5883 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:06.536533 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355dfeb5-857c-4332-ac01-826cd6448544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:06.537365 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355dfeb5-857c-4332-ac01-826cd6448544 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:06.537649 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355dfeb5-857c-4332-ac01-826cd6448544 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:06.537917 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355dfeb5-857c-4332-ac01-826cd6448544 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:06.548993 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355dfeb5-857c-4332-ac01-826cd6448544 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:06.550545 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355dfeb5-857c-4332-ac01-826cd6448544 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:06.567413 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-355dfeb5-857c-4332-ac01-826cd6448544 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 07:03:06.569104 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 385/755] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:03:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:03:06.569959 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355dfeb5-857c-4332-ac01-826cd6448544 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:06.618027 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373dd8e2-daf6-4625-bd8c-933ef8af5883 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:06.651458 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44720971-62b3-4a87-b4c9-850aa41e7ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:06.652150 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44720971-62b3-4a87-b4c9-850aa41e7ef3 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:06.652428 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44720971-62b3-4a87-b4c9-850aa41e7ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:06.652695 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44720971-62b3-4a87-b4c9-850aa41e7ef3 None admin] PATH_INFO: `/v3/domains` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:06.653417 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44720971-62b3-4a87-b4c9-850aa41e7ef3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:06.653707 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44720971-62b3-4a87-b4c9-850aa41e7ef3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:06.655092 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44720971-62b3-4a87-b4c9-850aa41e7ef3 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:06.670780 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 371/756] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Mar 30 07:03:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:06.671732 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44720971-62b3-4a87-b4c9-850aa41e7ef3 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:06.685811 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355dfeb5-857c-4332-ac01-826cd6448544 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:06.727147 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2395ed16-dc36-412d-8272-cab5ebdafe3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:06.728473 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2395ed16-dc36-412d-8272-cab5ebdafe3f None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:06.729385 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2395ed16-dc36-412d-8272-cab5ebdafe3f None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:06.730071 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2395ed16-dc36-412d-8272-cab5ebdafe3f None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:06.730923 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2395ed16-dc36-412d-8272-cab5ebdafe3f None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:06.732830 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2395ed16-dc36-412d-8272-cab5ebdafe3f None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:06.747686 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-2395ed16-dc36-412d-8272-cab5ebdafe3f None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Mar 30 07:03:06.749118 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 386/757] 10.222.0.20 () {56 vars in 1129 bytes} [Wed Mar 30 07:03:06 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:03:06.750107 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2395ed16-dc36-412d-8272-cab5ebdafe3f None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:06.779605 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44720971-62b3-4a87-b4c9-850aa41e7ef3 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:06.820353 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f3419e-e274-4d7e-b80b-d06329ad7ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:06.821949 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f3419e-e274-4d7e-b80b-d06329ad7ba4 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:06.822599 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f3419e-e274-4d7e-b80b-d06329ad7ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:06.823135 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f3419e-e274-4d7e-b80b-d06329ad7ba4 None admin] PATH_INFO: `/v3/domains` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:06.824082 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f3419e-e274-4d7e-b80b-d06329ad7ba4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:06.824554 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f3419e-e274-4d7e-b80b-d06329ad7ba4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:06.826855 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f3419e-e274-4d7e-b80b-d06329ad7ba4 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:06.841744 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 372/758] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Mar 30 07:03:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:06.842984 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f3419e-e274-4d7e-b80b-d06329ad7ba4 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:06.867206 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2395ed16-dc36-412d-8272-cab5ebdafe3f None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:06.905655 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56de435-af0f-4803-8fc0-1a137e2c2282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:06.906949 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56de435-af0f-4803-8fc0-1a137e2c2282 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:06.907417 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56de435-af0f-4803-8fc0-1a137e2c2282 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:06.907902 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56de435-af0f-4803-8fc0-1a137e2c2282 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:06.914954 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56de435-af0f-4803-8fc0-1a137e2c2282 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:06.917080 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56de435-af0f-4803-8fc0-1a137e2c2282 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:06.931134 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-c56de435-af0f-4803-8fc0-1a137e2c2282 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 30 07:03:06.933020 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 387/759] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Mar 30 07:03:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:03:06.933985 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56de435-af0f-4803-8fc0-1a137e2c2282 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:06.960650 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f3419e-e274-4d7e-b80b-d06329ad7ba4 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:06.996249 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed64737-de36-43b6-aaf9-bf6b479dbafe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:06.996880 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed64737-de36-43b6-aaf9-bf6b479dbafe None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:06.997167 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed64737-de36-43b6-aaf9-bf6b479dbafe None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:06.997442 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed64737-de36-43b6-aaf9-bf6b479dbafe None admin] PATH_INFO: `/v3/services` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:06.998148 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed64737-de36-43b6-aaf9-bf6b479dbafe None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:06.998449 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed64737-de36-43b6-aaf9-bf6b479dbafe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:06.999845 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed64737-de36-43b6-aaf9-bf6b479dbafe None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:07.004710 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 373/760] 10.222.0.20 () {56 vars in 1124 bytes} [Wed Mar 30 07:03:06 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:07.005498 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed64737-de36-43b6-aaf9-bf6b479dbafe None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:07.048687 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56de435-af0f-4803-8fc0-1a137e2c2282 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:07.084097 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1228cad9-2f45-4f36-8160-827076db71da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:07.084988 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1228cad9-2f45-4f36-8160-827076db71da None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:07.085272 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1228cad9-2f45-4f36-8160-827076db71da None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:07.085579 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1228cad9-2f45-4f36-8160-827076db71da None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:07.093798 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1228cad9-2f45-4f36-8160-827076db71da None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:07.095260 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1228cad9-2f45-4f36-8160-827076db71da None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:07.110100 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-1228cad9-2f45-4f36-8160-827076db71da None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Mar 30 07:03:07.111681 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed64737-de36-43b6-aaf9-bf6b479dbafe None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:07.111983 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 388/761] 10.222.0.20 () {56 vars in 1117 bytes} [Wed Mar 30 07:03:06 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:03:07.112836 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1228cad9-2f45-4f36-8160-827076db71da None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:07.145686 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ea5a5e-1fdb-4768-b182-9416499832bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:07.146351 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ea5a5e-1fdb-4768-b182-9416499832bb None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:07.146630 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ea5a5e-1fdb-4768-b182-9416499832bb None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:07.146901 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ea5a5e-1fdb-4768-b182-9416499832bb None admin] PATH_INFO: `/v3/projects` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:07.147686 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ea5a5e-1fdb-4768-b182-9416499832bb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:07.148057 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ea5a5e-1fdb-4768-b182-9416499832bb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:07.149484 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ea5a5e-1fdb-4768-b182-9416499832bb None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:07.161675 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 374/762] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Mar 30 07:03:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:07.162570 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ea5a5e-1fdb-4768-b182-9416499832bb None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:07.222594 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1228cad9-2f45-4f36-8160-827076db71da None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:07.262372 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc89d07-cd3f-4151-a6a4-8f62f6c9097d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:07.263107 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc89d07-cd3f-4151-a6a4-8f62f6c9097d None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:07.263226 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc89d07-cd3f-4151-a6a4-8f62f6c9097d None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:07.263496 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc89d07-cd3f-4151-a6a4-8f62f6c9097d None admin] PATH_INFO: `/v3/services` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:07.264320 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc89d07-cd3f-4151-a6a4-8f62f6c9097d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:07.264530 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc89d07-cd3f-4151-a6a4-8f62f6c9097d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:07.266004 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc89d07-cd3f-4151-a6a4-8f62f6c9097d None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:07.272670 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ea5a5e-1fdb-4768-b182-9416499832bb None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:07.277462 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 389/763] 10.222.0.20 () {56 vars in 1124 bytes} [Wed Mar 30 07:03:07 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:07.278476 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc89d07-cd3f-4151-a6a4-8f62f6c9097d None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:07.309029 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f36757-3fee-4ba7-a63c-4fb5d7d84bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:07.309964 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f36757-3fee-4ba7-a63c-4fb5d7d84bc6 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:07.310387 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f36757-3fee-4ba7-a63c-4fb5d7d84bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:07.310830 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f36757-3fee-4ba7-a63c-4fb5d7d84bc6 None admin] PATH_INFO: `/v3/users` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:07.311830 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f36757-3fee-4ba7-a63c-4fb5d7d84bc6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:07.312278 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f36757-3fee-4ba7-a63c-4fb5d7d84bc6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:07.313859 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f36757-3fee-4ba7-a63c-4fb5d7d84bc6 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:07.331569 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 375/764] 10.222.0.20 () {56 vars in 1149 bytes} [Wed Mar 30 07:03:07 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:07.332643 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f36757-3fee-4ba7-a63c-4fb5d7d84bc6 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:07.390108 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc89d07-cd3f-4151-a6a4-8f62f6c9097d None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:07.427386 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82946dfa-d245-45ca-8e7c-e66725e1b6f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:07.428382 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82946dfa-d245-45ca-8e7c-e66725e1b6f3 None admin] REQUEST_METHOD: `PUT` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:07.428660 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82946dfa-d245-45ca-8e7c-e66725e1b6f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:07.428931 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82946dfa-d245-45ca-8e7c-e66725e1b6f3 None admin] PATH_INFO: `/v3/projects/7e4eda4c5cd84307b36a5b48642e816f/users/72b398c5ed14484d8b7a51fee900597b/roles/1c39b9ab8cfd4c0ea71845831920a845` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:07.430957 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82946dfa-d245-45ca-8e7c-e66725e1b6f3 None admin] RBAC: Authorizing `identity:create_grant(project_id=7e4eda4c5cd84307b36a5b48642e816f, user_id=72b398c5ed14484d8b7a51fee900597b, role_id=1c39b9ab8cfd4c0ea71845831920a845)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:07.431441 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f36757-3fee-4ba7-a63c-4fb5d7d84bc6 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:07.432833 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82946dfa-d245-45ca-8e7c-e66725e1b6f3 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:07.455908 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 390/765] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Mar 30 07:03:07 2022] PUT /identity/v3/projects/7e4eda4c5cd84307b36a5b48642e816f/users/72b398c5ed14484d8b7a51fee900597b/roles/1c39b9ab8cfd4c0ea71845831920a845 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:03:07.457179 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82946dfa-d245-45ca-8e7c-e66725e1b6f3 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:07.497558 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43db3e0-b99e-4a92-81e7-80a5453cba2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:07.498494 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43db3e0-b99e-4a92-81e7-80a5453cba2a None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:07.498917 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43db3e0-b99e-4a92-81e7-80a5453cba2a None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:07.499353 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43db3e0-b99e-4a92-81e7-80a5453cba2a None admin] PATH_INFO: `/v3/endpoints` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:07.500357 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43db3e0-b99e-4a92-81e7-80a5453cba2a None admin] RBAC: Adding query filter params (interface=public, service_id=fe5735fb206e43e79e4dd736b0befaf7, region_id=RegionOne) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:07.500808 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43db3e0-b99e-4a92-81e7-80a5453cba2a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:07.502346 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43db3e0-b99e-4a92-81e7-80a5453cba2a None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:07.523403 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 376/766] 10.222.0.20 () {56 vars in 1251 bytes} [Wed Mar 30 07:03:07 2022] GET /identity/v3/endpoints?service_id=fe5735fb206e43e79e4dd736b0befaf7&interface=public®ion_id=RegionOne => generated 194 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:07.540881 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43db3e0-b99e-4a92-81e7-80a5453cba2a None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:07.591715 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82946dfa-d245-45ca-8e7c-e66725e1b6f3 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:07.633330 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c45ba5f-9a10-4ad2-9dc9-36f744a863ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:07.634170 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c45ba5f-9a10-4ad2-9dc9-36f744a863ab None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:07.634514 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c45ba5f-9a10-4ad2-9dc9-36f744a863ab None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:07.634979 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c45ba5f-9a10-4ad2-9dc9-36f744a863ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:07.714935 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c45ba5f-9a10-4ad2-9dc9-36f744a863ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:07.717104 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c45ba5f-9a10-4ad2-9dc9-36f744a863ab None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:07.782603 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43db3e0-b99e-4a92-81e7-80a5453cba2a None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:07.822790 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2531121e-11d5-4339-b847-3bb0352b5c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:07.823752 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2531121e-11d5-4339-b847-3bb0352b5c4b None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:07.824214 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2531121e-11d5-4339-b847-3bb0352b5c4b None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:07.824638 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2531121e-11d5-4339-b847-3bb0352b5c4b None admin] PATH_INFO: `/v3/services` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:07.825462 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2531121e-11d5-4339-b847-3bb0352b5c4b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:07.826997 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2531121e-11d5-4339-b847-3bb0352b5c4b None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:07.832802 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 377/767] 10.222.0.20 () {56 vars in 1087 bytes} [Wed Mar 30 07:03:07 2022] GET /identity/v3/services => generated 772 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:07.843380 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 391/768] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Mar 30 07:03:07 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 30 07:03:07.848884 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2531121e-11d5-4339-b847-3bb0352b5c4b None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:07.954955 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2531121e-11d5-4339-b847-3bb0352b5c4b None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:07.991853 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e71104-1196-442f-9daf-2050179b20b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:07.992952 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e71104-1196-442f-9daf-2050179b20b0 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:07.993846 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e71104-1196-442f-9daf-2050179b20b0 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:07.994298 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e71104-1196-442f-9daf-2050179b20b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:08.006272 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e71104-1196-442f-9daf-2050179b20b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:08.008122 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e71104-1196-442f-9daf-2050179b20b0 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:08.027425 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-16e71104-1196-442f-9daf-2050179b20b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 07:03:08.029432 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 378/769] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:03:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:03:08.035537 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c45ba5f-9a10-4ad2-9dc9-36f744a863ab None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:08.207738 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c45ba5f-9a10-4ad2-9dc9-36f744a863ab None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:08.246671 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0222582c-e3bb-4488-a47d-ea3d42a61e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:08.247343 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0222582c-e3bb-4488-a47d-ea3d42a61e98 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:08.247621 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0222582c-e3bb-4488-a47d-ea3d42a61e98 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:08.247924 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0222582c-e3bb-4488-a47d-ea3d42a61e98 None admin] PATH_INFO: `/v3/domains` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:08.248644 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0222582c-e3bb-4488-a47d-ea3d42a61e98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:08.248941 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0222582c-e3bb-4488-a47d-ea3d42a61e98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:08.250306 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0222582c-e3bb-4488-a47d-ea3d42a61e98 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:08.266420 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 392/770] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Mar 30 07:03:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:08.267783 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e71104-1196-442f-9daf-2050179b20b0 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:08.272882 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7136ad-a711-446b-89bb-830b87adac2b None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:08.273175 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7136ad-a711-446b-89bb-830b87adac2b None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:08.273448 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7136ad-a711-446b-89bb-830b87adac2b None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:08.277245 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 393/771] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:03:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:03:08.280919 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f07dc1a-8e0d-4edf-9c61-7b8da7e8266f None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:08.281204 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f07dc1a-8e0d-4edf-9c61-7b8da7e8266f None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:08.281483 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f07dc1a-8e0d-4edf-9c61-7b8da7e8266f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:08.302883 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-4f07dc1a-8e0d-4edf-9c61-7b8da7e8266f None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:03:08.304035 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-4f07dc1a-8e0d-4edf-9c61-7b8da7e8266f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:03:08.381549 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 394/772] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:03:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 30 07:03:08.382084 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e71104-1196-442f-9daf-2050179b20b0 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:08.422375 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f07dc1a-8e0d-4edf-9c61-7b8da7e8266f None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:08.423942 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4a2753-bb38-4391-85a8-0c09646bd515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:08.424928 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a2753-bb38-4391-85a8-0c09646bd515 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:08.425349 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a2753-bb38-4391-85a8-0c09646bd515 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:08.425765 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a2753-bb38-4391-85a8-0c09646bd515 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:08.438823 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4a2753-bb38-4391-85a8-0c09646bd515 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:08.441015 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4a2753-bb38-4391-85a8-0c09646bd515 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:08.461816 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-bd4a2753-bb38-4391-85a8-0c09646bd515 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 30 07:03:08.463639 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 379/773] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Mar 30 07:03:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:03:08.469134 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4a2753-bb38-4391-85a8-0c09646bd515 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:08.539576 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f07dc1a-8e0d-4edf-9c61-7b8da7e8266f None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:08.574788 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a54b36-4b94-4dbb-965e-7a5b55cd8704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:08.575608 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a54b36-4b94-4dbb-965e-7a5b55cd8704 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:08.575919 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a54b36-4b94-4dbb-965e-7a5b55cd8704 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:08.576199 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a54b36-4b94-4dbb-965e-7a5b55cd8704 None admin] PATH_INFO: `/v3/services/network` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:08.576856 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a54b36-4b94-4dbb-965e-7a5b55cd8704 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:08.578247 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a54b36-4b94-4dbb-965e-7a5b55cd8704 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:08.591671 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-c3a54b36-4b94-4dbb-965e-7a5b55cd8704 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Mar 30 07:03:08.591671 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 395/774] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Mar 30 07:03:08 2022] GET /identity/v3/services/network => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 07:03:08.597239 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a54b36-4b94-4dbb-965e-7a5b55cd8704 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:08.602392 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4a2753-bb38-4391-85a8-0c09646bd515 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:08.652757 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6bdd64-710e-42d5-ac58-c9d6a16380b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:08.653801 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6bdd64-710e-42d5-ac58-c9d6a16380b7 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:08.654278 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6bdd64-710e-42d5-ac58-c9d6a16380b7 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:08.654764 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6bdd64-710e-42d5-ac58-c9d6a16380b7 None admin] PATH_INFO: `/v3/projects` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:08.655765 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6bdd64-710e-42d5-ac58-c9d6a16380b7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:08.656293 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6bdd64-710e-42d5-ac58-c9d6a16380b7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:08.657937 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6bdd64-710e-42d5-ac58-c9d6a16380b7 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:08.678692 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 380/775] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Mar 30 07:03:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:03:08.684506 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6bdd64-710e-42d5-ac58-c9d6a16380b7 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:08.700711 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a54b36-4b94-4dbb-965e-7a5b55cd8704 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:08.738492 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46677a23-cd9a-4de3-aebf-4b07a110ef25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:08.739202 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46677a23-cd9a-4de3-aebf-4b07a110ef25 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:08.739484 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46677a23-cd9a-4de3-aebf-4b07a110ef25 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:08.739765 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46677a23-cd9a-4de3-aebf-4b07a110ef25 None admin] PATH_INFO: `/v3/services` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:08.740504 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46677a23-cd9a-4de3-aebf-4b07a110ef25 None admin] RBAC: Adding query filter params (name=network) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:08.740804 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46677a23-cd9a-4de3-aebf-4b07a110ef25 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:08.742269 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46677a23-cd9a-4de3-aebf-4b07a110ef25 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:08.747652 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 396/776] 10.222.0.20 () {56 vars in 1112 bytes} [Wed Mar 30 07:03:08 2022] GET /identity/v3/services?name=network => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:03:08.748882 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2bcf53-70f9-4eea-8348-647135a50100 None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:08.749157 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2bcf53-70f9-4eea-8348-647135a50100 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:08.749428 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2bcf53-70f9-4eea-8348-647135a50100 None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:08.755792 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 397/777] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:03:08 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:03:08.755792 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2bcf53-70f9-4eea-8348-647135a50100 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:08.795352 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6bdd64-710e-42d5-ac58-c9d6a16380b7 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:08.833548 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c23a0bd-830a-444b-96f6-2c86a9e83c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:08.834279 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c23a0bd-830a-444b-96f6-2c86a9e83c48 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:08.834555 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c23a0bd-830a-444b-96f6-2c86a9e83c48 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:08.835299 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c23a0bd-830a-444b-96f6-2c86a9e83c48 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:08.836413 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c23a0bd-830a-444b-96f6-2c86a9e83c48 None admin] RBAC: Adding query filter params (role.id=4848e2a52e0b428997632ab8a8d36e91, scope.project.id=7e4eda4c5cd84307b36a5b48642e816f, user.id=67102c1adcf0491e9ecdef970ab2d5ec) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:08.836724 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c23a0bd-830a-444b-96f6-2c86a9e83c48 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:08.838408 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c23a0bd-830a-444b-96f6-2c86a9e83c48 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:08.845431 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 381/778] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Mar 30 07:03:08 2022] GET /identity/v3/role_assignments?user.id=67102c1adcf0491e9ecdef970ab2d5ec&scope.project.id=7e4eda4c5cd84307b36a5b48642e816f&role.id=4848e2a52e0b428997632ab8a8d36e91 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:03:08.846678 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576093af-3a7d-4867-9642-a05efa8060c8 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:08.846958 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576093af-3a7d-4867-9642-a05efa8060c8 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:08.847589 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576093af-3a7d-4867-9642-a05efa8060c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:08.868774 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-576093af-3a7d-4867-9642-a05efa8060c8 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:03:08.870065 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-576093af-3a7d-4867-9642-a05efa8060c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:03:08.881674 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2bcf53-70f9-4eea-8348-647135a50100 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:08.925275 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3c7c72-b5c1-4050-8f8f-f28fc20b900b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:08.925972 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3c7c72-b5c1-4050-8f8f-f28fc20b900b None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:08.926250 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3c7c72-b5c1-4050-8f8f-f28fc20b900b None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:08.926520 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3c7c72-b5c1-4050-8f8f-f28fc20b900b None admin] PATH_INFO: `/v3/services` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:08.927258 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3c7c72-b5c1-4050-8f8f-f28fc20b900b None admin] RBAC: Adding query filter params (type=network) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:08.927562 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3c7c72-b5c1-4050-8f8f-f28fc20b900b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:08.929014 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3c7c72-b5c1-4050-8f8f-f28fc20b900b None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:08.934582 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 398/779] 10.222.0.20 () {56 vars in 1112 bytes} [Wed Mar 30 07:03:08 2022] GET /identity/v3/services?type=network => generated 350 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:08.940398 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3c7c72-b5c1-4050-8f8f-f28fc20b900b None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:08.940817 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 382/780] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:03:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 30 07:03:08.975234 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576093af-3a7d-4867-9642-a05efa8060c8 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:09.101994 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576093af-3a7d-4867-9642-a05efa8060c8 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:09.116381 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3c7c72-b5c1-4050-8f8f-f28fc20b900b None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:09.148545 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76969dad-8811-426e-8321-57288b8b272c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:09.149355 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76969dad-8811-426e-8321-57288b8b272c None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:09.149724 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76969dad-8811-426e-8321-57288b8b272c None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:09.149992 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76969dad-8811-426e-8321-57288b8b272c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:09.159334 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c35509-9a08-491c-a95c-e00a29c9a7e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:09.160377 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c35509-9a08-491c-a95c-e00a29c9a7e8 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:09.160850 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c35509-9a08-491c-a95c-e00a29c9a7e8 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:09.161307 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c35509-9a08-491c-a95c-e00a29c9a7e8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:09.162290 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c35509-9a08-491c-a95c-e00a29c9a7e8 None admin] RBAC: Adding query filter params (interface=public, service_id=ee7d6269f7ee477890f630bfe380906a, region_id=RegionOne) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:09.162793 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c35509-9a08-491c-a95c-e00a29c9a7e8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:09.163914 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76969dad-8811-426e-8321-57288b8b272c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 07:03:09.164607 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c35509-9a08-491c-a95c-e00a29c9a7e8 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:09.172072 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-76969dad-8811-426e-8321-57288b8b272c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 30 07:03:09.179479 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 383/782] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Mar 30 07:03:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:03:09.179479 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76969dad-8811-426e-8321-57288b8b272c None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:09.181213 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 399/782] 10.222.0.20 () {56 vars in 1251 bytes} [Wed Mar 30 07:03:08 2022] GET /identity/v3/endpoints?service_id=ee7d6269f7ee477890f630bfe380906a&interface=public®ion_id=RegionOne => generated 194 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:03:09.181213 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c35509-9a08-491c-a95c-e00a29c9a7e8 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:09.325374 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76969dad-8811-426e-8321-57288b8b272c None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:09.337476 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c35509-9a08-491c-a95c-e00a29c9a7e8 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:09.366446 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e39a23c-0908-4ae2-9a64-62798908b7b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:09.367029 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e39a23c-0908-4ae2-9a64-62798908b7b8 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:09.367461 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e39a23c-0908-4ae2-9a64-62798908b7b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:09.367925 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e39a23c-0908-4ae2-9a64-62798908b7b8 None admin] PATH_INFO: `/v3/services` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:09.369088 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e39a23c-0908-4ae2-9a64-62798908b7b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:09.370886 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e39a23c-0908-4ae2-9a64-62798908b7b8 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:09.372175 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c76b0cd-e0d2-4be5-9f06-4e361d37c820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:09.373091 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c76b0cd-e0d2-4be5-9f06-4e361d37c820 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:09.373571 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c76b0cd-e0d2-4be5-9f06-4e361d37c820 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:09.374024 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c76b0cd-e0d2-4be5-9f06-4e361d37c820 None admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:09.374951 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c76b0cd-e0d2-4be5-9f06-4e361d37c820 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:09.375439 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c76b0cd-e0d2-4be5-9f06-4e361d37c820 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:09.377030 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c76b0cd-e0d2-4be5-9f06-4e361d37c820 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:09.382939 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 384/783] 10.222.0.20 () {56 vars in 1087 bytes} [Wed Mar 30 07:03:09 2022] GET /identity/v3/services => generated 772 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:09.391188 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 400/784] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Mar 30 07:03:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:09.397034 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e39a23c-0908-4ae2-9a64-62798908b7b8 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:09.505873 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e39a23c-0908-4ae2-9a64-62798908b7b8 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:09.547216 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6089bb0-8b55-4829-b243-a204f74233bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:09.548059 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6089bb0-8b55-4829-b243-a204f74233bd None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:09.548336 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6089bb0-8b55-4829-b243-a204f74233bd None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:09.548604 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6089bb0-8b55-4829-b243-a204f74233bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:09.559964 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6089bb0-8b55-4829-b243-a204f74233bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:09.561406 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6089bb0-8b55-4829-b243-a204f74233bd None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:09.590144 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-b6089bb0-8b55-4829-b243-a204f74233bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 07:03:09.591720 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 385/785] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:03:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 07:03:09.597432 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c76b0cd-e0d2-4be5-9f06-4e361d37c820 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:09.733443 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c76b0cd-e0d2-4be5-9f06-4e361d37c820 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:09.767351 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d259da-10d9-4431-a771-dc2ccb3b0d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:09.768437 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d259da-10d9-4431-a771-dc2ccb3b0d06 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:09.768928 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d259da-10d9-4431-a771-dc2ccb3b0d06 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:09.769387 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d259da-10d9-4431-a771-dc2ccb3b0d06 None admin] PATH_INFO: `/v3/domains` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:09.770292 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d259da-10d9-4431-a771-dc2ccb3b0d06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:09.770780 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d259da-10d9-4431-a771-dc2ccb3b0d06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:09.772383 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d259da-10d9-4431-a771-dc2ccb3b0d06 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:09.785093 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 401/786] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Mar 30 07:03:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:09.790442 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6089bb0-8b55-4829-b243-a204f74233bd None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:09.901680 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6089bb0-8b55-4829-b243-a204f74233bd None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:09.939265 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be9c80c-6e83-4949-b23d-5234370f319e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:09.940101 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be9c80c-6e83-4949-b23d-5234370f319e None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:09.940378 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be9c80c-6e83-4949-b23d-5234370f319e None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:09.940647 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be9c80c-6e83-4949-b23d-5234370f319e None admin] PATH_INFO: `/v3/users/swift` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:09.949020 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be9c80c-6e83-4949-b23d-5234370f319e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:09.950488 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be9c80c-6e83-4949-b23d-5234370f319e None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:09.969456 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-6be9c80c-6e83-4949-b23d-5234370f319e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Mar 30 07:03:09.975370 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 386/787] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Mar 30 07:03:09 2022] GET /identity/v3/users/swift => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 07:03:09.976674 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d259da-10d9-4431-a771-dc2ccb3b0d06 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:10.123205 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d259da-10d9-4431-a771-dc2ccb3b0d06 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:10.174835 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baca7966-7a51-403e-8511-4b763c0ed010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:10.175927 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca7966-7a51-403e-8511-4b763c0ed010 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:10.176366 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca7966-7a51-403e-8511-4b763c0ed010 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:10.176643 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca7966-7a51-403e-8511-4b763c0ed010 None admin] PATH_INFO: `/v3/users` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:10.177776 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baca7966-7a51-403e-8511-4b763c0ed010 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:10.178083 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baca7966-7a51-403e-8511-4b763c0ed010 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:10.179532 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baca7966-7a51-403e-8511-4b763c0ed010 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:10.207993 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 402/788] 10.222.0.20 () {56 vars in 1135 bytes} [Wed Mar 30 07:03:09 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:10.213666 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be9c80c-6e83-4949-b23d-5234370f319e None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:10.340343 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be9c80c-6e83-4949-b23d-5234370f319e None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:10.379278 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22541e9a-5b78-49bb-a3f7-78b53304fae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:10.380043 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22541e9a-5b78-49bb-a3f7-78b53304fae3 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:10.380319 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22541e9a-5b78-49bb-a3f7-78b53304fae3 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:10.380587 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22541e9a-5b78-49bb-a3f7-78b53304fae3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:10.395218 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4589f294-e92c-4ddb-b28a-c9e94c61287f None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:10.395492 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4589f294-e92c-4ddb-b28a-c9e94c61287f None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:10.396038 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4589f294-e92c-4ddb-b28a-c9e94c61287f None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:10.397615 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22541e9a-5b78-49bb-a3f7-78b53304fae3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:10.398639 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 403/789] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:03:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 30 07:03:10.403037 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22541e9a-5b78-49bb-a3f7-78b53304fae3 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:10.404888 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd58554-8d49-45b5-901b-51c32365e25d None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:10.405386 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd58554-8d49-45b5-901b-51c32365e25d None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:10.405855 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd58554-8d49-45b5-901b-51c32365e25d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:10.423872 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-2cd58554-8d49-45b5-901b-51c32365e25d None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:03:10.425395 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-2cd58554-8d49-45b5-901b-51c32365e25d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:03:10.428831 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-22541e9a-5b78-49bb-a3f7-78b53304fae3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 07:03:10.430392 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 387/790] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:03:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:03:10.435798 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22541e9a-5b78-49bb-a3f7-78b53304fae3 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:10.531012 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22541e9a-5b78-49bb-a3f7-78b53304fae3 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:10.566394 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d533cc-0e9e-40ac-b805-a886bd5b3123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:10.568124 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d533cc-0e9e-40ac-b805-a886bd5b3123 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:10.568124 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d533cc-0e9e-40ac-b805-a886bd5b3123 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:10.568124 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d533cc-0e9e-40ac-b805-a886bd5b3123 None admin] PATH_INFO: `/v3/domains` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:10.568346 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d533cc-0e9e-40ac-b805-a886bd5b3123 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:10.568655 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d533cc-0e9e-40ac-b805-a886bd5b3123 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:10.570202 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d533cc-0e9e-40ac-b805-a886bd5b3123 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:10.582202 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 404/791] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:03:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 30 07:03:10.582747 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 388/792] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Mar 30 07:03:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:03:10.588363 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd58554-8d49-45b5-901b-51c32365e25d None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:10.629231 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d533cc-0e9e-40ac-b805-a886bd5b3123 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:10.732323 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd58554-8d49-45b5-901b-51c32365e25d None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:10.768775 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d5e57a-ae43-49c0-9df6-2bc09c61a6cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:10.769588 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d5e57a-ae43-49c0-9df6-2bc09c61a6cd None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:10.769891 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d5e57a-ae43-49c0-9df6-2bc09c61a6cd None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:10.770136 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d5e57a-ae43-49c0-9df6-2bc09c61a6cd None admin] PATH_INFO: `/v3/projects/service` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:10.778121 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d5e57a-ae43-49c0-9df6-2bc09c61a6cd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:10.779575 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d5e57a-ae43-49c0-9df6-2bc09c61a6cd None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:10.791445 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d533cc-0e9e-40ac-b805-a886bd5b3123 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:10.794312 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-b7d5e57a-ae43-49c0-9df6-2bc09c61a6cd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 30 07:03:10.795897 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 405/793] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Mar 30 07:03:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:03:10.802576 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d5e57a-ae43-49c0-9df6-2bc09c61a6cd None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:10.836682 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69774d45-f291-4606-914e-3cdeb4ca1595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:10.837544 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69774d45-f291-4606-914e-3cdeb4ca1595 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:10.837823 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69774d45-f291-4606-914e-3cdeb4ca1595 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:10.838095 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69774d45-f291-4606-914e-3cdeb4ca1595 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:10.848632 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69774d45-f291-4606-914e-3cdeb4ca1595 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 07:03:10.855796 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-69774d45-f291-4606-914e-3cdeb4ca1595 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 30 07:03:10.857524 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 389/794] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Mar 30 07:03:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 07:03:10.858925 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693fbfc6-57f6-408c-b97f-0b03a8eff56b None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:10.863835 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693fbfc6-57f6-408c-b97f-0b03a8eff56b None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:10.864378 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693fbfc6-57f6-408c-b97f-0b03a8eff56b None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:10.866512 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 390/795] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:03:10 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:03:10.868403 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693fbfc6-57f6-408c-b97f-0b03a8eff56b None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:10.906161 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d5e57a-ae43-49c0-9df6-2bc09c61a6cd None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:10.940413 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b176066-35c7-421d-86ae-f881cf25a4f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:10.941599 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b176066-35c7-421d-86ae-f881cf25a4f5 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:10.942261 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b176066-35c7-421d-86ae-f881cf25a4f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:10.942709 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b176066-35c7-421d-86ae-f881cf25a4f5 None admin] PATH_INFO: `/v3/projects` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:10.943724 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b176066-35c7-421d-86ae-f881cf25a4f5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:10.944177 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b176066-35c7-421d-86ae-f881cf25a4f5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:10.946325 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b176066-35c7-421d-86ae-f881cf25a4f5 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:10.962492 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 406/796] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Mar 30 07:03:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:10.964358 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e73d5b-17f6-480a-a4f9-106a28573889 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:10.964837 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e73d5b-17f6-480a-a4f9-106a28573889 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:10.965276 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e73d5b-17f6-480a-a4f9-106a28573889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:10.982802 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-e6e73d5b-17f6-480a-a4f9-106a28573889 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:03:10.984272 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-e6e73d5b-17f6-480a-a4f9-106a28573889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:03:10.989590 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693fbfc6-57f6-408c-b97f-0b03a8eff56b None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:11.031461 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cc093b-3cf3-4e00-8e25-3ba7abcf0cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:11.032503 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cc093b-3cf3-4e00-8e25-3ba7abcf0cf7 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:11.033018 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cc093b-3cf3-4e00-8e25-3ba7abcf0cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:11.033307 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cc093b-3cf3-4e00-8e25-3ba7abcf0cf7 None admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:11.034062 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cc093b-3cf3-4e00-8e25-3ba7abcf0cf7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:11.034370 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cc093b-3cf3-4e00-8e25-3ba7abcf0cf7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:11.036239 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cc093b-3cf3-4e00-8e25-3ba7abcf0cf7 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:11.047891 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 391/797] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Mar 30 07:03:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:11.048998 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cc093b-3cf3-4e00-8e25-3ba7abcf0cf7 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:11.058551 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 407/798] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:03:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 30 07:03:11.060293 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e73d5b-17f6-480a-a4f9-106a28573889 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:11.158991 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cc093b-3cf3-4e00-8e25-3ba7abcf0cf7 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:11.181027 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e73d5b-17f6-480a-a4f9-106a28573889 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:11.198244 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176e3ace-98b8-4ddd-b4ac-32c276f2d0ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:11.199407 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176e3ace-98b8-4ddd-b4ac-32c276f2d0ac None admin] REQUEST_METHOD: `PUT` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:11.199954 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176e3ace-98b8-4ddd-b4ac-32c276f2d0ac None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:11.200541 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176e3ace-98b8-4ddd-b4ac-32c276f2d0ac None admin] PATH_INFO: `/v3/projects/7e4eda4c5cd84307b36a5b48642e816f/users/c452249c502d4b0688e8dd068f8c4951/roles/1c39b9ab8cfd4c0ea71845831920a845` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:11.203721 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176e3ace-98b8-4ddd-b4ac-32c276f2d0ac None admin] RBAC: Authorizing `identity:create_grant(project_id=7e4eda4c5cd84307b36a5b48642e816f, user_id=c452249c502d4b0688e8dd068f8c4951, role_id=1c39b9ab8cfd4c0ea71845831920a845)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:11.205710 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176e3ace-98b8-4ddd-b4ac-32c276f2d0ac None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:11.218811 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6823b5d5-05fc-4303-aeff-e48738b56e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:11.219693 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6823b5d5-05fc-4303-aeff-e48738b56e2f None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:11.220126 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6823b5d5-05fc-4303-aeff-e48738b56e2f None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:11.220395 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6823b5d5-05fc-4303-aeff-e48738b56e2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:11.228672 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 392/799] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Mar 30 07:03:11 2022] PUT /identity/v3/projects/7e4eda4c5cd84307b36a5b48642e816f/users/c452249c502d4b0688e8dd068f8c4951/roles/1c39b9ab8cfd4c0ea71845831920a845 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:03:11.229990 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176e3ace-98b8-4ddd-b4ac-32c276f2d0ac None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:11.245653 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6823b5d5-05fc-4303-aeff-e48738b56e2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:11.249650 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6823b5d5-05fc-4303-aeff-e48738b56e2f None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:11.290344 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-6823b5d5-05fc-4303-aeff-e48738b56e2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 07:03:11.299867 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 408/800] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:03:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:03:11.301150 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6823b5d5-05fc-4303-aeff-e48738b56e2f None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:11.428525 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6823b5d5-05fc-4303-aeff-e48738b56e2f None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:11.461900 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176e3ace-98b8-4ddd-b4ac-32c276f2d0ac None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:11.486699 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5748736c-e372-478f-821f-253d56917146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:11.487676 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5748736c-e372-478f-821f-253d56917146 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:11.488145 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5748736c-e372-478f-821f-253d56917146 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:11.488612 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5748736c-e372-478f-821f-253d56917146 None admin] PATH_INFO: `/v3/domains` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:11.489518 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5748736c-e372-478f-821f-253d56917146 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:11.490004 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5748736c-e372-478f-821f-253d56917146 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:11.491649 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5748736c-e372-478f-821f-253d56917146 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:11.504027 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 409/801] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Mar 30 07:03:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:11.511184 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5748736c-e372-478f-821f-253d56917146 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:11.522714 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1726dc7-d4d6-48eb-bef8-333f0851faea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:11.523777 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1726dc7-d4d6-48eb-bef8-333f0851faea None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:11.524306 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1726dc7-d4d6-48eb-bef8-333f0851faea None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:11.524808 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1726dc7-d4d6-48eb-bef8-333f0851faea None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:11.525688 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1726dc7-d4d6-48eb-bef8-333f0851faea None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:11.527255 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1726dc7-d4d6-48eb-bef8-333f0851faea None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:11.540335 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-e1726dc7-d4d6-48eb-bef8-333f0851faea None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Mar 30 07:03:11.542513 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 393/802] 10.222.0.20 () {56 vars in 1129 bytes} [Wed Mar 30 07:03:11 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:03:11.549570 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1726dc7-d4d6-48eb-bef8-333f0851faea None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:11.639114 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5748736c-e372-478f-821f-253d56917146 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:11.683237 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c05dc4-9189-4f3d-a1f0-ce7deea644f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:11.684248 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c05dc4-9189-4f3d-a1f0-ce7deea644f6 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:11.684537 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c05dc4-9189-4f3d-a1f0-ce7deea644f6 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:11.685153 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c05dc4-9189-4f3d-a1f0-ce7deea644f6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:11.687927 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1726dc7-d4d6-48eb-bef8-333f0851faea None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:11.694459 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c05dc4-9189-4f3d-a1f0-ce7deea644f6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:11.696499 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c05dc4-9189-4f3d-a1f0-ce7deea644f6 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:11.714570 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-39c05dc4-9189-4f3d-a1f0-ce7deea644f6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 30 07:03:11.716222 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 410/803] 10.222.0.20 () {56 vars in 1093 bytes} [Wed Mar 30 07:03:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:03:11.717493 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26bdb0d-5f81-4519-b4a0-f159a1c4b2fc None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:11.717773 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26bdb0d-5f81-4519-b4a0-f159a1c4b2fc None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:11.718042 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26bdb0d-5f81-4519-b4a0-f159a1c4b2fc None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:11.719705 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 411/804] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:03:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:03:11.722660 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26bdb0d-5f81-4519-b4a0-f159a1c4b2fc None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:11.726462 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f16c1d-a1ec-43bc-b097-40d7eb2888ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:11.727127 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f16c1d-a1ec-43bc-b097-40d7eb2888ed None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:11.727402 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f16c1d-a1ec-43bc-b097-40d7eb2888ed None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:11.727710 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f16c1d-a1ec-43bc-b097-40d7eb2888ed None admin] PATH_INFO: `/v3/services` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:11.728500 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f16c1d-a1ec-43bc-b097-40d7eb2888ed None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:11.728800 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f16c1d-a1ec-43bc-b097-40d7eb2888ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:11.730217 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f16c1d-a1ec-43bc-b097-40d7eb2888ed None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:11.735196 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 394/805] 10.222.0.20 () {56 vars in 1124 bytes} [Wed Mar 30 07:03:11 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:11.736853 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df483df3-edb5-428f-a747-006401ec4a46 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:11.737135 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df483df3-edb5-428f-a747-006401ec4a46 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:11.737415 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df483df3-edb5-428f-a747-006401ec4a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:11.757820 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-df483df3-edb5-428f-a747-006401ec4a46 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:03:11.758950 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-df483df3-edb5-428f-a747-006401ec4a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:03:11.824330 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 395/806] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:03:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 30 07:03:11.825196 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df483df3-edb5-428f-a747-006401ec4a46 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:11.846658 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26bdb0d-5f81-4519-b4a0-f159a1c4b2fc None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:11.881671 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56480b82-381d-4ebe-9568-cb45ad4c930a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:11.882351 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56480b82-381d-4ebe-9568-cb45ad4c930a None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:11.882631 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56480b82-381d-4ebe-9568-cb45ad4c930a None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:11.882903 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56480b82-381d-4ebe-9568-cb45ad4c930a None admin] PATH_INFO: `/v3/users` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:11.883752 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56480b82-381d-4ebe-9568-cb45ad4c930a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:11.884348 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56480b82-381d-4ebe-9568-cb45ad4c930a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:11.886041 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56480b82-381d-4ebe-9568-cb45ad4c930a None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:11.907958 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 412/807] 10.222.0.20 () {56 vars in 1133 bytes} [Wed Mar 30 07:03:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:11.908898 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56480b82-381d-4ebe-9568-cb45ad4c930a None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:11.923103 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df483df3-edb5-428f-a747-006401ec4a46 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:11.957940 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95ddc95-7ac6-44e1-a6be-bdab7bbbc2b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:11.958604 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95ddc95-7ac6-44e1-a6be-bdab7bbbc2b4 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:11.958882 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95ddc95-7ac6-44e1-a6be-bdab7bbbc2b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:11.959153 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95ddc95-7ac6-44e1-a6be-bdab7bbbc2b4 None admin] PATH_INFO: `/v3/services` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:11.959881 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95ddc95-7ac6-44e1-a6be-bdab7bbbc2b4 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:11.960186 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95ddc95-7ac6-44e1-a6be-bdab7bbbc2b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:11.961556 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95ddc95-7ac6-44e1-a6be-bdab7bbbc2b4 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:11.966794 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 396/808] 10.222.0.20 () {56 vars in 1124 bytes} [Wed Mar 30 07:03:11 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:11.967613 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95ddc95-7ac6-44e1-a6be-bdab7bbbc2b4 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:12.016745 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56480b82-381d-4ebe-9568-cb45ad4c930a None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:12.051320 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e245c0f0-e98e-443a-8dc7-80002d9cc14d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:12.052588 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e245c0f0-e98e-443a-8dc7-80002d9cc14d None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:12.052870 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e245c0f0-e98e-443a-8dc7-80002d9cc14d None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:12.053415 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e245c0f0-e98e-443a-8dc7-80002d9cc14d None admin] PATH_INFO: `/v3/roles/service` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:12.063061 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95ddc95-7ac6-44e1-a6be-bdab7bbbc2b4 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:12.067024 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e245c0f0-e98e-443a-8dc7-80002d9cc14d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 07:03:12.076267 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-e245c0f0-e98e-443a-8dc7-80002d9cc14d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 30 07:03:12.078591 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 413/809] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Mar 30 07:03:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:03:12.079595 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e245c0f0-e98e-443a-8dc7-80002d9cc14d None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:12.096852 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c23c3ef-3ce9-46b0-ae1d-e0db2a310070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:12.097512 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c23c3ef-3ce9-46b0-ae1d-e0db2a310070 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:12.097788 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c23c3ef-3ce9-46b0-ae1d-e0db2a310070 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:12.098059 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c23c3ef-3ce9-46b0-ae1d-e0db2a310070 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:12.171842 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c23c3ef-3ce9-46b0-ae1d-e0db2a310070 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:12.174250 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c23c3ef-3ce9-46b0-ae1d-e0db2a310070 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:12.214265 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e245c0f0-e98e-443a-8dc7-80002d9cc14d None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:12.260406 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325213da-8574-4980-8156-7654168a9274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:12.261702 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325213da-8574-4980-8156-7654168a9274 None admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:12.262321 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325213da-8574-4980-8156-7654168a9274 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:12.262754 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325213da-8574-4980-8156-7654168a9274 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:12.264492 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325213da-8574-4980-8156-7654168a9274 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:12.266401 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325213da-8574-4980-8156-7654168a9274 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:12.281188 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 397/810] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Mar 30 07:03:11 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 30 07:03:12.281999 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c23c3ef-3ce9-46b0-ae1d-e0db2a310070 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:12.303998 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 414/811] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Mar 30 07:03:12 2022] POST /identity/v3/endpoints => generated 346 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:03:12.305385 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325213da-8574-4980-8156-7654168a9274 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:12.472809 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c23c3ef-3ce9-46b0-ae1d-e0db2a310070 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:12.510790 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325213da-8574-4980-8156-7654168a9274 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:12.521914 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeea14ba-1833-432c-b9b2-d11e65d4ba0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:12.523037 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea14ba-1833-432c-b9b2-d11e65d4ba0f None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:12.523519 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea14ba-1833-432c-b9b2-d11e65d4ba0f None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:12.524061 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea14ba-1833-432c-b9b2-d11e65d4ba0f None admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:12.525093 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeea14ba-1833-432c-b9b2-d11e65d4ba0f None admin] RBAC: Adding query filter params (name=service) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:12.525619 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeea14ba-1833-432c-b9b2-d11e65d4ba0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:12.527304 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeea14ba-1833-432c-b9b2-d11e65d4ba0f None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:12.539169 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 398/812] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Mar 30 07:03:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:12.540723 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59beedb-655b-4c39-aef1-09a989ab6333 None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:12.541250 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59beedb-655b-4c39-aef1-09a989ab6333 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:12.541250 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59beedb-655b-4c39-aef1-09a989ab6333 None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:12.546819 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 399/813] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:03:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:03:12.546819 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59beedb-655b-4c39-aef1-09a989ab6333 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:12.559877 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2959e1-16cd-4632-8927-dd7f69928cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:12.560223 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2959e1-16cd-4632-8927-dd7f69928cd0 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:12.560508 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2959e1-16cd-4632-8927-dd7f69928cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:12.560785 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2959e1-16cd-4632-8927-dd7f69928cd0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:12.575608 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2959e1-16cd-4632-8927-dd7f69928cd0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:12.577253 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2959e1-16cd-4632-8927-dd7f69928cd0 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:12.596522 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-3a2959e1-16cd-4632-8927-dd7f69928cd0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 07:03:12.598046 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 415/814] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:03:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:03:12.599252 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b4a58-8031-4461-822c-f035674234c5 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:12.599532 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b4a58-8031-4461-822c-f035674234c5 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:12.599802 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b4a58-8031-4461-822c-f035674234c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:12.619964 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-fe5b4a58-8031-4461-822c-f035674234c5 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:03:12.621225 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-fe5b4a58-8031-4461-822c-f035674234c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:03:12.670579 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59beedb-655b-4c39-aef1-09a989ab6333 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:12.704994 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da06107f-d115-4d31-b5f0-dd9296e6b000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:12.705519 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 416/815] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:03:12 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 30 07:03:12.706496 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5b4a58-8031-4461-822c-f035674234c5 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:12.712454 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da06107f-d115-4d31-b5f0-dd9296e6b000 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:12.712931 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da06107f-d115-4d31-b5f0-dd9296e6b000 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:12.713276 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da06107f-d115-4d31-b5f0-dd9296e6b000 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:12.739274 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da06107f-d115-4d31-b5f0-dd9296e6b000 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:12.740906 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da06107f-d115-4d31-b5f0-dd9296e6b000 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:12.759855 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-da06107f-d115-4d31-b5f0-dd9296e6b000 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 07:03:12.761448 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 400/816] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:03:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:03:12.762316 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da06107f-d115-4d31-b5f0-dd9296e6b000 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:12.816567 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5b4a58-8031-4461-822c-f035674234c5 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:12.849826 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c908dc4b-ea74-4a21-a257-52f24a4abf4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:12.850582 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c908dc4b-ea74-4a21-a257-52f24a4abf4b None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:12.850765 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c908dc4b-ea74-4a21-a257-52f24a4abf4b None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:12.851035 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c908dc4b-ea74-4a21-a257-52f24a4abf4b None admin] PATH_INFO: `/v3/domains` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:12.851750 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c908dc4b-ea74-4a21-a257-52f24a4abf4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:12.852082 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c908dc4b-ea74-4a21-a257-52f24a4abf4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:12.853506 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c908dc4b-ea74-4a21-a257-52f24a4abf4b None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:12.862707 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da06107f-d115-4d31-b5f0-dd9296e6b000 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:12.865123 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 417/817] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Mar 30 07:03:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:12.865924 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c908dc4b-ea74-4a21-a257-52f24a4abf4b None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:12.897568 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d04295-a319-400e-aebb-00469edf870b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:12.898403 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d04295-a319-400e-aebb-00469edf870b None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:12.898683 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d04295-a319-400e-aebb-00469edf870b None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:12.898954 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d04295-a319-400e-aebb-00469edf870b None admin] PATH_INFO: `/v3/services/network` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:12.899703 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d04295-a319-400e-aebb-00469edf870b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:12.901159 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d04295-a319-400e-aebb-00469edf870b None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:12.912361 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-79d04295-a319-400e-aebb-00469edf870b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Mar 30 07:03:12.918689 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 401/818] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Mar 30 07:03:12 2022] GET /identity/v3/services/network => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:03:12.919618 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d04295-a319-400e-aebb-00469edf870b None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:12.961502 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c908dc4b-ea74-4a21-a257-52f24a4abf4b None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:12.994962 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68332200-e062-464a-90cb-2a2780e5b30e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:12.995624 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68332200-e062-464a-90cb-2a2780e5b30e None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:12.995927 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68332200-e062-464a-90cb-2a2780e5b30e None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:12.996198 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68332200-e062-464a-90cb-2a2780e5b30e None admin] PATH_INFO: `/v3/domains` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:12.996910 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68332200-e062-464a-90cb-2a2780e5b30e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:12.997212 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68332200-e062-464a-90cb-2a2780e5b30e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:12.998638 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68332200-e062-464a-90cb-2a2780e5b30e None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:13.015267 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 418/819] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Mar 30 07:03:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:13.016053 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68332200-e062-464a-90cb-2a2780e5b30e None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:13.019776 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d04295-a319-400e-aebb-00469edf870b None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:13.053277 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db22c35-e03f-4c54-b017-4329f9c7dde3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:13.054075 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db22c35-e03f-4c54-b017-4329f9c7dde3 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:13.054352 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db22c35-e03f-4c54-b017-4329f9c7dde3 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:13.054670 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db22c35-e03f-4c54-b017-4329f9c7dde3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:13.061748 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db22c35-e03f-4c54-b017-4329f9c7dde3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:13.063269 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db22c35-e03f-4c54-b017-4329f9c7dde3 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:13.078509 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-8db22c35-e03f-4c54-b017-4329f9c7dde3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 30 07:03:13.080063 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 402/820] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Mar 30 07:03:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:03:13.080988 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db22c35-e03f-4c54-b017-4329f9c7dde3 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:13.112961 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68332200-e062-464a-90cb-2a2780e5b30e None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:13.147478 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0669ac-79bd-4e85-86bb-0291125f1e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:13.148171 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0669ac-79bd-4e85-86bb-0291125f1e18 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:13.148448 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0669ac-79bd-4e85-86bb-0291125f1e18 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:13.148715 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0669ac-79bd-4e85-86bb-0291125f1e18 None admin] PATH_INFO: `/v3/services` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:13.149417 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0669ac-79bd-4e85-86bb-0291125f1e18 None admin] RBAC: Adding query filter params (name=network) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:13.149776 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0669ac-79bd-4e85-86bb-0291125f1e18 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:13.151139 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0669ac-79bd-4e85-86bb-0291125f1e18 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:13.155964 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 419/821] 10.222.0.20 () {56 vars in 1112 bytes} [Wed Mar 30 07:03:13 2022] GET /identity/v3/services?name=network => generated 124 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:13.156768 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0669ac-79bd-4e85-86bb-0291125f1e18 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:13.187420 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db22c35-e03f-4c54-b017-4329f9c7dde3 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:13.224146 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf08184-fdd1-4a68-aabc-d9904640158c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:13.224956 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf08184-fdd1-4a68-aabc-d9904640158c None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:13.225235 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf08184-fdd1-4a68-aabc-d9904640158c None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:13.225507 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf08184-fdd1-4a68-aabc-d9904640158c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:13.233342 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf08184-fdd1-4a68-aabc-d9904640158c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:13.234871 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf08184-fdd1-4a68-aabc-d9904640158c None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:13.251476 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-5cf08184-fdd1-4a68-aabc-d9904640158c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Mar 30 07:03:13.253264 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 403/822] 10.222.0.20 () {56 vars in 1117 bytes} [Wed Mar 30 07:03:13 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:03:13.254064 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf08184-fdd1-4a68-aabc-d9904640158c None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:13.254241 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0669ac-79bd-4e85-86bb-0291125f1e18 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:13.292529 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bdb98b-4e7f-42f3-8b4a-45f6dc47ce12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:13.293196 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bdb98b-4e7f-42f3-8b4a-45f6dc47ce12 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:13.293471 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bdb98b-4e7f-42f3-8b4a-45f6dc47ce12 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:13.293736 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bdb98b-4e7f-42f3-8b4a-45f6dc47ce12 None admin] PATH_INFO: `/v3/projects` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:13.294511 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bdb98b-4e7f-42f3-8b4a-45f6dc47ce12 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:13.294811 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bdb98b-4e7f-42f3-8b4a-45f6dc47ce12 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:13.296339 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bdb98b-4e7f-42f3-8b4a-45f6dc47ce12 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:13.309459 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 420/823] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Mar 30 07:03:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:13.310314 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bdb98b-4e7f-42f3-8b4a-45f6dc47ce12 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:13.357640 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf08184-fdd1-4a68-aabc-d9904640158c None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:13.394786 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ccc30c-7aee-4b6b-bc9a-46ac717a3e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:13.395640 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ccc30c-7aee-4b6b-bc9a-46ac717a3e6b None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:13.396224 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ccc30c-7aee-4b6b-bc9a-46ac717a3e6b None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:13.396564 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ccc30c-7aee-4b6b-bc9a-46ac717a3e6b None admin] PATH_INFO: `/v3/services` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:13.397280 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ccc30c-7aee-4b6b-bc9a-46ac717a3e6b None admin] RBAC: Adding query filter params (type=network) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:13.397584 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ccc30c-7aee-4b6b-bc9a-46ac717a3e6b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:13.399388 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ccc30c-7aee-4b6b-bc9a-46ac717a3e6b None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:13.407906 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 404/824] 10.222.0.20 () {56 vars in 1112 bytes} [Wed Mar 30 07:03:13 2022] GET /identity/v3/services?type=network => generated 350 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:13.408755 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ccc30c-7aee-4b6b-bc9a-46ac717a3e6b None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:13.414583 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bdb98b-4e7f-42f3-8b4a-45f6dc47ce12 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:13.447736 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee81a44-a52f-485f-9a13-08781a5347b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:13.448451 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee81a44-a52f-485f-9a13-08781a5347b4 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:13.448728 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee81a44-a52f-485f-9a13-08781a5347b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:13.448989 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee81a44-a52f-485f-9a13-08781a5347b4 None admin] PATH_INFO: `/v3/users` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:13.449824 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee81a44-a52f-485f-9a13-08781a5347b4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:13.450180 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee81a44-a52f-485f-9a13-08781a5347b4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:13.451710 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee81a44-a52f-485f-9a13-08781a5347b4 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:13.475967 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 421/825] 10.222.0.20 () {56 vars in 1149 bytes} [Wed Mar 30 07:03:13 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:13.476918 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee81a44-a52f-485f-9a13-08781a5347b4 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:13.513202 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ccc30c-7aee-4b6b-bc9a-46ac717a3e6b None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:13.546383 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6d8d80-6404-40e1-9bb7-7333446b16f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:13.547189 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6d8d80-6404-40e1-9bb7-7333446b16f3 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:13.547346 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6d8d80-6404-40e1-9bb7-7333446b16f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:13.547558 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6d8d80-6404-40e1-9bb7-7333446b16f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:13.548419 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6d8d80-6404-40e1-9bb7-7333446b16f3 None admin] RBAC: Adding query filter params (role.id=1c39b9ab8cfd4c0ea71845831920a845, scope.project.id=7e4eda4c5cd84307b36a5b48642e816f, user.id=72b398c5ed14484d8b7a51fee900597b) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:13.548726 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6d8d80-6404-40e1-9bb7-7333446b16f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:13.550166 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6d8d80-6404-40e1-9bb7-7333446b16f3 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:13.556595 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 405/826] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Mar 30 07:03:13 2022] GET /identity/v3/role_assignments?user.id=72b398c5ed14484d8b7a51fee900597b&scope.project.id=7e4eda4c5cd84307b36a5b48642e816f&role.id=1c39b9ab8cfd4c0ea71845831920a845 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:13.557439 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6d8d80-6404-40e1-9bb7-7333446b16f3 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:13.585414 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee81a44-a52f-485f-9a13-08781a5347b4 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:13.650365 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88f4cd3-c088-488c-b19f-1f6215282d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:13.651021 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88f4cd3-c088-488c-b19f-1f6215282d70 None admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:13.651295 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88f4cd3-c088-488c-b19f-1f6215282d70 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:13.651563 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88f4cd3-c088-488c-b19f-1f6215282d70 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:13.652406 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88f4cd3-c088-488c-b19f-1f6215282d70 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:13.653792 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88f4cd3-c088-488c-b19f-1f6215282d70 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:13.666482 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6d8d80-6404-40e1-9bb7-7333446b16f3 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:13.691067 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 422/827] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Mar 30 07:03:13 2022] POST /identity/v3/endpoints => generated 327 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:03:13.711423 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ad86bb-fc5d-4953-81ed-33e341ec6fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:13.712122 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ace83-17eb-4126-99b7-04c75986e9cd None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:13.712400 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ace83-17eb-4126-99b7-04c75986e9cd None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:13.712677 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ace83-17eb-4126-99b7-04c75986e9cd None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:13.712838 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ad86bb-fc5d-4953-81ed-33e341ec6fb2 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:13.712985 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ad86bb-fc5d-4953-81ed-33e341ec6fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:13.713243 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ad86bb-fc5d-4953-81ed-33e341ec6fb2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:13.714889 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 423/828] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:03:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 30 07:03:13.720825 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4050a0c-0db6-4e2d-9366-0264e84d68e3 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:13.721136 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4050a0c-0db6-4e2d-9366-0264e84d68e3 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:13.721360 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4050a0c-0db6-4e2d-9366-0264e84d68e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:13.726365 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ad86bb-fc5d-4953-81ed-33e341ec6fb2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:13.727962 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ad86bb-fc5d-4953-81ed-33e341ec6fb2 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:13.750344 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-50ad86bb-fc5d-4953-81ed-33e341ec6fb2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 07:03:13.751976 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 406/829] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:03:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:03:13.756893 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-c4050a0c-0db6-4e2d-9366-0264e84d68e3 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:03:13.758746 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ad86bb-fc5d-4953-81ed-33e341ec6fb2 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:13.761007 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-c4050a0c-0db6-4e2d-9366-0264e84d68e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:03:13.886070 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 424/830] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:03:13 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 30 07:03:13.910659 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4050a0c-0db6-4e2d-9366-0264e84d68e3 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:13.924898 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ad86bb-fc5d-4953-81ed-33e341ec6fb2 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:13.974044 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc310687-adb4-41cd-b958-7cf8e1970588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:13.975297 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc310687-adb4-41cd-b958-7cf8e1970588 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:13.975685 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc310687-adb4-41cd-b958-7cf8e1970588 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:13.976005 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc310687-adb4-41cd-b958-7cf8e1970588 None admin] PATH_INFO: `/v3/domains` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:13.976903 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc310687-adb4-41cd-b958-7cf8e1970588 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:13.977204 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc310687-adb4-41cd-b958-7cf8e1970588 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:13.978985 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc310687-adb4-41cd-b958-7cf8e1970588 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:13.995100 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 407/831] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Mar 30 07:03:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:14.001028 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc310687-adb4-41cd-b958-7cf8e1970588 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:14.041978 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4050a0c-0db6-4e2d-9366-0264e84d68e3 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:14.082555 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb16616d-01f5-44bf-ba9f-c56bcfc31712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:14.083366 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb16616d-01f5-44bf-ba9f-c56bcfc31712 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:14.083646 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb16616d-01f5-44bf-ba9f-c56bcfc31712 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:14.083945 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb16616d-01f5-44bf-ba9f-c56bcfc31712 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:14.100388 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb16616d-01f5-44bf-ba9f-c56bcfc31712 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 07:03:14.109312 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-bb16616d-01f5-44bf-ba9f-c56bcfc31712 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 30 07:03:14.115498 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 425/832] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Mar 30 07:03:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 07:03:14.116883 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb16616d-01f5-44bf-ba9f-c56bcfc31712 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:14.126121 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc310687-adb4-41cd-b958-7cf8e1970588 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:14.171651 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00ad550-f559-4d25-8815-b2e9edfd2962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:14.172431 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ad550-f559-4d25-8815-b2e9edfd2962 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:14.172710 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ad550-f559-4d25-8815-b2e9edfd2962 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:14.172978 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ad550-f559-4d25-8815-b2e9edfd2962 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:14.183253 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00ad550-f559-4d25-8815-b2e9edfd2962 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:14.185630 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00ad550-f559-4d25-8815-b2e9edfd2962 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:14.200028 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-e00ad550-f559-4d25-8815-b2e9edfd2962 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 30 07:03:14.205936 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 408/833] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Mar 30 07:03:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 07:03:14.212792 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00ad550-f559-4d25-8815-b2e9edfd2962 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:14.251522 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb16616d-01f5-44bf-ba9f-c56bcfc31712 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:14.287078 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22acc28f-f884-4c1f-b131-4ff4c04e4763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:14.287891 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22acc28f-f884-4c1f-b131-4ff4c04e4763 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:14.288200 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22acc28f-f884-4c1f-b131-4ff4c04e4763 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:14.288474 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22acc28f-f884-4c1f-b131-4ff4c04e4763 None admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:14.289217 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22acc28f-f884-4c1f-b131-4ff4c04e4763 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:14.289520 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22acc28f-f884-4c1f-b131-4ff4c04e4763 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:14.290957 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22acc28f-f884-4c1f-b131-4ff4c04e4763 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:14.305131 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 426/834] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Mar 30 07:03:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:03:14.306221 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22acc28f-f884-4c1f-b131-4ff4c04e4763 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:14.332267 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00ad550-f559-4d25-8815-b2e9edfd2962 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:14.378136 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8309edc5-a63e-4675-939a-12b3627789bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:14.379846 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8309edc5-a63e-4675-939a-12b3627789bc None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:14.380339 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8309edc5-a63e-4675-939a-12b3627789bc None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:14.380787 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8309edc5-a63e-4675-939a-12b3627789bc None admin] PATH_INFO: `/v3/projects` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:14.381749 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8309edc5-a63e-4675-939a-12b3627789bc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:14.382229 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8309edc5-a63e-4675-939a-12b3627789bc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:14.384483 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8309edc5-a63e-4675-939a-12b3627789bc None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:14.404742 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 409/835] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Mar 30 07:03:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:14.406121 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8309edc5-a63e-4675-939a-12b3627789bc None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:14.414724 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22acc28f-f884-4c1f-b131-4ff4c04e4763 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:14.456990 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ee26a8-b0f7-4423-b40f-5411113b79f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:14.458558 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ee26a8-b0f7-4423-b40f-5411113b79f7 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:14.459109 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ee26a8-b0f7-4423-b40f-5411113b79f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:14.459524 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ee26a8-b0f7-4423-b40f-5411113b79f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:14.474022 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ee26a8-b0f7-4423-b40f-5411113b79f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:14.476545 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ee26a8-b0f7-4423-b40f-5411113b79f7 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:14.499937 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-a3ee26a8-b0f7-4423-b40f-5411113b79f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 07:03:14.506819 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 427/836] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:03:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:03:14.508398 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ee26a8-b0f7-4423-b40f-5411113b79f7 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:14.515217 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8309edc5-a63e-4675-939a-12b3627789bc None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:14.559215 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946c8b7b-40e2-414a-aeee-b3cdcd277930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:14.561397 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946c8b7b-40e2-414a-aeee-b3cdcd277930 None admin] REQUEST_METHOD: `PUT` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:14.561884 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946c8b7b-40e2-414a-aeee-b3cdcd277930 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:14.562619 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946c8b7b-40e2-414a-aeee-b3cdcd277930 None admin] PATH_INFO: `/v3/projects/7e4eda4c5cd84307b36a5b48642e816f/users/67102c1adcf0491e9ecdef970ab2d5ec/roles/4848e2a52e0b428997632ab8a8d36e91` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:14.585587 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946c8b7b-40e2-414a-aeee-b3cdcd277930 None admin] RBAC: Authorizing `identity:create_grant(project_id=7e4eda4c5cd84307b36a5b48642e816f, user_id=67102c1adcf0491e9ecdef970ab2d5ec, role_id=4848e2a52e0b428997632ab8a8d36e91)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:14.588219 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946c8b7b-40e2-414a-aeee-b3cdcd277930 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:14.612058 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 410/837] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Mar 30 07:03:14 2022] PUT /identity/v3/projects/7e4eda4c5cd84307b36a5b48642e816f/users/67102c1adcf0491e9ecdef970ab2d5ec/roles/4848e2a52e0b428997632ab8a8d36e91 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 07:03:14.619548 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ee26a8-b0f7-4423-b40f-5411113b79f7 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:14.656965 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36c57a2-f8a2-4599-8760-6529ed2d0169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:14.657717 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36c57a2-f8a2-4599-8760-6529ed2d0169 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:14.658005 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36c57a2-f8a2-4599-8760-6529ed2d0169 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:14.658273 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36c57a2-f8a2-4599-8760-6529ed2d0169 None admin] PATH_INFO: `/v3/domains` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:14.659000 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36c57a2-f8a2-4599-8760-6529ed2d0169 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:14.659348 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36c57a2-f8a2-4599-8760-6529ed2d0169 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:14.660852 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36c57a2-f8a2-4599-8760-6529ed2d0169 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:14.674186 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 428/838] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Mar 30 07:03:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:14.679971 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946c8b7b-40e2-414a-aeee-b3cdcd277930 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:14.785185 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946c8b7b-40e2-414a-aeee-b3cdcd277930 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:14.826349 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2581bea3-d648-4c79-96d7-c173badd712e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:14.827552 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2581bea3-d648-4c79-96d7-c173badd712e None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:14.828057 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2581bea3-d648-4c79-96d7-c173badd712e None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:14.828565 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2581bea3-d648-4c79-96d7-c173badd712e None admin] PATH_INFO: `/v3/users/swift` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:14.837441 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2581bea3-d648-4c79-96d7-c173badd712e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:14.838919 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2581bea3-d648-4c79-96d7-c173badd712e None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:14.855507 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-2581bea3-d648-4c79-96d7-c173badd712e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Mar 30 07:03:14.857322 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 411/839] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Mar 30 07:03:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 07:03:14.863847 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36c57a2-f8a2-4599-8760-6529ed2d0169 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:14.873214 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43652b-725d-4244-977a-945435f29f9f None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:14.873722 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43652b-725d-4244-977a-945435f29f9f None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:14.874005 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43652b-725d-4244-977a-945435f29f9f None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:14.876139 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 412/840] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:03:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 30 07:03:14.881139 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80d140c-40b7-4752-bc2e-0002cc139901 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:14.881475 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80d140c-40b7-4752-bc2e-0002cc139901 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:14.881757 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80d140c-40b7-4752-bc2e-0002cc139901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:14.908903 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-b80d140c-40b7-4752-bc2e-0002cc139901 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:03:14.910085 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-b80d140c-40b7-4752-bc2e-0002cc139901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:03:14.972569 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36c57a2-f8a2-4599-8760-6529ed2d0169 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:15.007840 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 413/841] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:03:14 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 30 07:03:15.015389 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d500cb56-4062-4104-8d43-44729e3fc016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:15.016214 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d500cb56-4062-4104-8d43-44729e3fc016 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:15.016497 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d500cb56-4062-4104-8d43-44729e3fc016 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:15.016773 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d500cb56-4062-4104-8d43-44729e3fc016 None admin] PATH_INFO: `/v3/users` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:15.017614 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d500cb56-4062-4104-8d43-44729e3fc016 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:15.017919 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d500cb56-4062-4104-8d43-44729e3fc016 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:15.019371 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d500cb56-4062-4104-8d43-44729e3fc016 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:15.025276 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80d140c-40b7-4752-bc2e-0002cc139901 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:15.049788 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 429/842] 10.222.0.20 () {56 vars in 1135 bytes} [Wed Mar 30 07:03:14 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:15.061258 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d500cb56-4062-4104-8d43-44729e3fc016 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:15.161483 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80d140c-40b7-4752-bc2e-0002cc139901 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:15.177896 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d500cb56-4062-4104-8d43-44729e3fc016 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:15.202980 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bd05e9-0a3d-435a-844e-0fe6b94b798c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:15.203790 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bd05e9-0a3d-435a-844e-0fe6b94b798c None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:15.204133 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bd05e9-0a3d-435a-844e-0fe6b94b798c None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:15.204410 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bd05e9-0a3d-435a-844e-0fe6b94b798c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:15.205166 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bd05e9-0a3d-435a-844e-0fe6b94b798c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:15.207022 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bd05e9-0a3d-435a-844e-0fe6b94b798c None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:15.219719 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-a1bd05e9-0a3d-435a-844e-0fe6b94b798c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Mar 30 07:03:15.221605 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 414/843] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Mar 30 07:03:15 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 07:03:15.227600 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bd05e9-0a3d-435a-844e-0fe6b94b798c None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:15.228865 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7f00b7-f1e2-4e84-a1bb-ca74cfef4dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:15.229604 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7f00b7-f1e2-4e84-a1bb-ca74cfef4dab None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:15.229949 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7f00b7-f1e2-4e84-a1bb-ca74cfef4dab None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:15.230306 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7f00b7-f1e2-4e84-a1bb-ca74cfef4dab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:15.317798 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7f00b7-f1e2-4e84-a1bb-ca74cfef4dab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:15.319536 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7f00b7-f1e2-4e84-a1bb-ca74cfef4dab None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:15.329542 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bd05e9-0a3d-435a-844e-0fe6b94b798c None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:15.367999 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516f40bc-44ab-41c8-9a8b-bfa22d7890ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:15.369436 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516f40bc-44ab-41c8-9a8b-bfa22d7890ce None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:15.369912 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516f40bc-44ab-41c8-9a8b-bfa22d7890ce None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:15.370373 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516f40bc-44ab-41c8-9a8b-bfa22d7890ce None admin] PATH_INFO: `/v3/services` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:15.371299 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516f40bc-44ab-41c8-9a8b-bfa22d7890ce None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:15.371829 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516f40bc-44ab-41c8-9a8b-bfa22d7890ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:15.373430 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516f40bc-44ab-41c8-9a8b-bfa22d7890ce None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:15.379159 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 415/844] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Mar 30 07:03:15 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:15.384940 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516f40bc-44ab-41c8-9a8b-bfa22d7890ce None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:15.433680 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 430/845] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Mar 30 07:03:15 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Mar 30 07:03:15.435061 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7f00b7-f1e2-4e84-a1bb-ca74cfef4dab None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:15.488904 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516f40bc-44ab-41c8-9a8b-bfa22d7890ce None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:15.530872 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af9703b-dfe3-47b4-b282-1c87f0db5b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:15.531535 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af9703b-dfe3-47b4-b282-1c87f0db5b76 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:15.531833 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af9703b-dfe3-47b4-b282-1c87f0db5b76 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:15.532104 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af9703b-dfe3-47b4-b282-1c87f0db5b76 None admin] PATH_INFO: `/v3/services` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:15.532809 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af9703b-dfe3-47b4-b282-1c87f0db5b76 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:15.533107 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af9703b-dfe3-47b4-b282-1c87f0db5b76 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:15.535170 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af9703b-dfe3-47b4-b282-1c87f0db5b76 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:15.543965 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 416/846] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Mar 30 07:03:15 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:03:15.552207 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7f00b7-f1e2-4e84-a1bb-ca74cfef4dab None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:15.589810 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a73907-a951-4c71-bf30-691d40984c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:15.591101 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a73907-a951-4c71-bf30-691d40984c3f None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:15.591616 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a73907-a951-4c71-bf30-691d40984c3f None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:15.592120 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a73907-a951-4c71-bf30-691d40984c3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:15.604103 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a73907-a951-4c71-bf30-691d40984c3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:15.606078 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a73907-a951-4c71-bf30-691d40984c3f None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:15.624786 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-94a73907-a951-4c71-bf30-691d40984c3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 07:03:15.626771 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 431/847] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:03:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 07:03:15.632767 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af9703b-dfe3-47b4-b282-1c87f0db5b76 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:15.743013 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af9703b-dfe3-47b4-b282-1c87f0db5b76 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:15.781706 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e581304e-1669-40ae-b7d9-f292d7eb859b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:15.782390 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e581304e-1669-40ae-b7d9-f292d7eb859b None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:15.782667 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e581304e-1669-40ae-b7d9-f292d7eb859b None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:15.782938 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e581304e-1669-40ae-b7d9-f292d7eb859b None admin] PATH_INFO: `/v3/domains` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:15.783669 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e581304e-1669-40ae-b7d9-f292d7eb859b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:15.784021 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e581304e-1669-40ae-b7d9-f292d7eb859b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:15.785460 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e581304e-1669-40ae-b7d9-f292d7eb859b None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:15.799606 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 417/848] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Mar 30 07:03:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:15.805636 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a73907-a951-4c71-bf30-691d40984c3f None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:15.919788 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a73907-a951-4c71-bf30-691d40984c3f None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:15.952445 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14faa73a-e850-48ec-b452-5f793d7091a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:15.953253 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14faa73a-e850-48ec-b452-5f793d7091a6 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:15.953527 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14faa73a-e850-48ec-b452-5f793d7091a6 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:15.953793 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14faa73a-e850-48ec-b452-5f793d7091a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:15.960429 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14faa73a-e850-48ec-b452-5f793d7091a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:15.961900 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14faa73a-e850-48ec-b452-5f793d7091a6 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:15.975219 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-14faa73a-e850-48ec-b452-5f793d7091a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 30 07:03:15.976735 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 432/849] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Mar 30 07:03:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:03:15.984948 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e581304e-1669-40ae-b7d9-f292d7eb859b None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:16.083316 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e581304e-1669-40ae-b7d9-f292d7eb859b None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:16.118392 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30deabc-4edd-46f0-a039-5cb3f8a3f610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:16.119447 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30deabc-4edd-46f0-a039-5cb3f8a3f610 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:16.119954 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30deabc-4edd-46f0-a039-5cb3f8a3f610 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:16.120434 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30deabc-4edd-46f0-a039-5cb3f8a3f610 None admin] PATH_INFO: `/v3/projects` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:16.121407 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30deabc-4edd-46f0-a039-5cb3f8a3f610 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:16.121910 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30deabc-4edd-46f0-a039-5cb3f8a3f610 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:16.123545 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30deabc-4edd-46f0-a039-5cb3f8a3f610 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:16.139966 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 418/850] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Mar 30 07:03:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:16.142167 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14faa73a-e850-48ec-b452-5f793d7091a6 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:16.157782 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9e989e-345e-471e-a651-d448be657203 None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:16.158068 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9e989e-345e-471e-a651-d448be657203 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:16.158332 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9e989e-345e-471e-a651-d448be657203 None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:16.160391 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 419/851] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:03:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:03:16.167046 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e74f3e-2a31-45d3-8cf0-555c058ef1ff None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:16.167329 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e74f3e-2a31-45d3-8cf0-555c058ef1ff None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:16.167600 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e74f3e-2a31-45d3-8cf0-555c058ef1ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:16.188892 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-16e74f3e-2a31-45d3-8cf0-555c058ef1ff None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:03:16.189994 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-16e74f3e-2a31-45d3-8cf0-555c058ef1ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:03:16.261647 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14faa73a-e850-48ec-b452-5f793d7091a6 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:16.274385 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 420/852] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:03:16 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 30 07:03:16.296300 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e74f3e-2a31-45d3-8cf0-555c058ef1ff None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:16.303999 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ac99fc-860d-4bc4-aacf-a0b8aa34f4bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:16.304948 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ac99fc-860d-4bc4-aacf-a0b8aa34f4bb None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:16.305432 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ac99fc-860d-4bc4-aacf-a0b8aa34f4bb None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:16.305939 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ac99fc-860d-4bc4-aacf-a0b8aa34f4bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:16.307078 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ac99fc-860d-4bc4-aacf-a0b8aa34f4bb None admin] RBAC: Adding query filter params (role.id=1c39b9ab8cfd4c0ea71845831920a845, scope.project.id=7e4eda4c5cd84307b36a5b48642e816f, user.id=c452249c502d4b0688e8dd068f8c4951) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:16.307610 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ac99fc-860d-4bc4-aacf-a0b8aa34f4bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:16.309287 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ac99fc-860d-4bc4-aacf-a0b8aa34f4bb None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:16.316019 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 433/853] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Mar 30 07:03:16 2022] GET /identity/v3/role_assignments?user.id=c452249c502d4b0688e8dd068f8c4951&scope.project.id=7e4eda4c5cd84307b36a5b48642e816f&role.id=1c39b9ab8cfd4c0ea71845831920a845 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:16.402702 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e74f3e-2a31-45d3-8cf0-555c058ef1ff None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:16.442224 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca47ffb8-58f9-4463-aff0-bccbe336a06a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:16.442992 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca47ffb8-58f9-4463-aff0-bccbe336a06a None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:16.443367 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca47ffb8-58f9-4463-aff0-bccbe336a06a None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:16.443646 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca47ffb8-58f9-4463-aff0-bccbe336a06a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:16.444344 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca47ffb8-58f9-4463-aff0-bccbe336a06a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:16.445761 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca47ffb8-58f9-4463-aff0-bccbe336a06a None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:16.458494 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-ca47ffb8-58f9-4463-aff0-bccbe336a06a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Mar 30 07:03:16.460208 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 421/854] 10.222.0.20 () {56 vars in 1132 bytes} [Wed Mar 30 07:03:16 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 07:03:16.466324 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ac99fc-860d-4bc4-aacf-a0b8aa34f4bb None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:16.573978 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ac99fc-860d-4bc4-aacf-a0b8aa34f4bb None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:16.609328 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bf7efc-9b7d-47e9-ae23-9ea1af931733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:16.610041 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bf7efc-9b7d-47e9-ae23-9ea1af931733 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:16.610322 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bf7efc-9b7d-47e9-ae23-9ea1af931733 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:16.610955 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bf7efc-9b7d-47e9-ae23-9ea1af931733 None admin] PATH_INFO: `/v3/services` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:16.611660 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bf7efc-9b7d-47e9-ae23-9ea1af931733 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:16.611991 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bf7efc-9b7d-47e9-ae23-9ea1af931733 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:16.613429 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bf7efc-9b7d-47e9-ae23-9ea1af931733 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:16.618624 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 434/855] 10.222.0.20 () {56 vars in 1126 bytes} [Wed Mar 30 07:03:16 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:16.624086 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca47ffb8-58f9-4463-aff0-bccbe336a06a None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:16.731205 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca47ffb8-58f9-4463-aff0-bccbe336a06a None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:16.767026 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b98667-481c-42db-94f0-8278e258b8da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:16.767700 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b98667-481c-42db-94f0-8278e258b8da None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:16.768012 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b98667-481c-42db-94f0-8278e258b8da None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:16.768287 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b98667-481c-42db-94f0-8278e258b8da None admin] PATH_INFO: `/v3/services` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:16.769004 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b98667-481c-42db-94f0-8278e258b8da None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:16.769311 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b98667-481c-42db-94f0-8278e258b8da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:16.770701 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b98667-481c-42db-94f0-8278e258b8da None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:16.776379 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 422/856] 10.222.0.20 () {56 vars in 1126 bytes} [Wed Mar 30 07:03:16 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:17.037099 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def01d75-efbb-45ba-9807-a96803cefabe None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:17.037595 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def01d75-efbb-45ba-9807-a96803cefabe None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:17.037595 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def01d75-efbb-45ba-9807-a96803cefabe None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:17.039612 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 435/857] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:03:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:03:17.045250 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a9583-20fe-4735-ba68-a189bae8c708 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:17.045543 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a9583-20fe-4735-ba68-a189bae8c708 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:17.045824 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a9583-20fe-4735-ba68-a189bae8c708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:17.063329 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-308a9583-20fe-4735-ba68-a189bae8c708 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:03:17.064536 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-308a9583-20fe-4735-ba68-a189bae8c708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:03:17.133531 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 423/858] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:03:17 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 30 07:03:17.160073 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def01d75-efbb-45ba-9807-a96803cefabe None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:17.260614 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def01d75-efbb-45ba-9807-a96803cefabe None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:17.293611 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016f7c31-75fc-4efc-b71d-d44cfaca5eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:17.294344 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016f7c31-75fc-4efc-b71d-d44cfaca5eb7 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:17.294621 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016f7c31-75fc-4efc-b71d-d44cfaca5eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:17.294886 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016f7c31-75fc-4efc-b71d-d44cfaca5eb7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:17.304939 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016f7c31-75fc-4efc-b71d-d44cfaca5eb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 07:03:17.311761 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-016f7c31-75fc-4efc-b71d-d44cfaca5eb7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 30 07:03:17.313342 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 436/859] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Mar 30 07:03:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:03:17.319013 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308a9583-20fe-4735-ba68-a189bae8c708 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:17.417972 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308a9583-20fe-4735-ba68-a189bae8c708 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:17.457232 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6e19b4-ef45-42d1-8120-989f966303c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:17.457915 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6e19b4-ef45-42d1-8120-989f966303c9 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:17.458196 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6e19b4-ef45-42d1-8120-989f966303c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:17.458468 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6e19b4-ef45-42d1-8120-989f966303c9 None admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:17.459219 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6e19b4-ef45-42d1-8120-989f966303c9 None admin] RBAC: Adding query filter params (name=service) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:17.459523 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6e19b4-ef45-42d1-8120-989f966303c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:17.460935 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6e19b4-ef45-42d1-8120-989f966303c9 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:17.474300 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 424/860] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Mar 30 07:03:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:17.476885 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016f7c31-75fc-4efc-b71d-d44cfaca5eb7 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:17.586665 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016f7c31-75fc-4efc-b71d-d44cfaca5eb7 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:17.620758 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d590b74-ca10-4aa1-81e9-13be6a04f249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:17.621605 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d590b74-ca10-4aa1-81e9-13be6a04f249 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:17.621891 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d590b74-ca10-4aa1-81e9-13be6a04f249 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:17.622164 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d590b74-ca10-4aa1-81e9-13be6a04f249 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:17.633136 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d590b74-ca10-4aa1-81e9-13be6a04f249 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:17.634772 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d590b74-ca10-4aa1-81e9-13be6a04f249 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:17.651541 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-2d590b74-ca10-4aa1-81e9-13be6a04f249 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 07:03:17.657509 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 437/861] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:03:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:03:17.658897 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6e19b4-ef45-42d1-8120-989f966303c9 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:17.760335 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6e19b4-ef45-42d1-8120-989f966303c9 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:17.794212 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e470de-4985-420b-a2b0-a2d869d91b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:17.794882 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e470de-4985-420b-a2b0-a2d869d91b5b None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:17.795167 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e470de-4985-420b-a2b0-a2d869d91b5b None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:17.795443 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e470de-4985-420b-a2b0-a2d869d91b5b None admin] PATH_INFO: `/v3/domains` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:17.796197 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e470de-4985-420b-a2b0-a2d869d91b5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:17.796499 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e470de-4985-420b-a2b0-a2d869d91b5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:17.797875 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e470de-4985-420b-a2b0-a2d869d91b5b None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:17.814801 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 425/862] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Mar 30 07:03:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:17.816203 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d590b74-ca10-4aa1-81e9-13be6a04f249 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:17.914339 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8d74d9-d897-4965-83ff-dc8fc5c6dec9 None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:17.915021 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8d74d9-d897-4965-83ff-dc8fc5c6dec9 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:17.915487 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8d74d9-d897-4965-83ff-dc8fc5c6dec9 None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:17.916803 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d590b74-ca10-4aa1-81e9-13be6a04f249 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:17.918147 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 426/863] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:03:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 30 07:03:17.924000 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e14631-d713-448f-a6ca-00614268564e None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:17.924636 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e14631-d713-448f-a6ca-00614268564e None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:17.925114 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e14631-d713-448f-a6ca-00614268564e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:17.945855 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-b5e14631-d713-448f-a6ca-00614268564e None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:03:17.948300 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-b5e14631-d713-448f-a6ca-00614268564e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:03:17.951882 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affbecba-2bdb-41ed-a9d5-af227e3e3f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:17.952706 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affbecba-2bdb-41ed-a9d5-af227e3e3f5c None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:17.952983 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affbecba-2bdb-41ed-a9d5-af227e3e3f5c None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:17.953251 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affbecba-2bdb-41ed-a9d5-af227e3e3f5c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:17.961007 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affbecba-2bdb-41ed-a9d5-af227e3e3f5c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:17.962911 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affbecba-2bdb-41ed-a9d5-af227e3e3f5c None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:17.977300 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-affbecba-2bdb-41ed-a9d5-af227e3e3f5c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Mar 30 07:03:17.983584 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 438/864] 10.222.0.20 () {56 vars in 1117 bytes} [Wed Mar 30 07:03:17 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:03:17.984987 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affbecba-2bdb-41ed-a9d5-af227e3e3f5c None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:18.031893 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 427/865] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:03:17 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 30 07:03:18.056602 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e14631-d713-448f-a6ca-00614268564e None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:18.106329 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affbecba-2bdb-41ed-a9d5-af227e3e3f5c None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:18.148508 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1a96fd-93cb-49e4-8375-bce8b00db6cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:18.149807 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1a96fd-93cb-49e4-8375-bce8b00db6cc None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:18.150358 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1a96fd-93cb-49e4-8375-bce8b00db6cc None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:18.150877 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1a96fd-93cb-49e4-8375-bce8b00db6cc None admin] PATH_INFO: `/v3/users` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:18.152037 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1a96fd-93cb-49e4-8375-bce8b00db6cc None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:18.152846 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1a96fd-93cb-49e4-8375-bce8b00db6cc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:18.154697 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1a96fd-93cb-49e4-8375-bce8b00db6cc None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:18.155494 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e14631-d713-448f-a6ca-00614268564e None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:18.180881 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 439/866] 10.222.0.20 () {56 vars in 1149 bytes} [Wed Mar 30 07:03:17 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:03:18.182479 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1a96fd-93cb-49e4-8375-bce8b00db6cc None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:18.194083 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dc82e9-dfa0-4d24-bb9c-2730c2ff8fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:18.194758 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc82e9-dfa0-4d24-bb9c-2730c2ff8fea None admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:18.195035 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc82e9-dfa0-4d24-bb9c-2730c2ff8fea None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:18.195326 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc82e9-dfa0-4d24-bb9c-2730c2ff8fea None admin] PATH_INFO: `/v3/services` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:18.196770 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dc82e9-dfa0-4d24-bb9c-2730c2ff8fea None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:18.198292 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dc82e9-dfa0-4d24-bb9c-2730c2ff8fea None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:18.223883 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 428/867] 10.222.0.20 () {60 vars in 1141 bytes} [Wed Mar 30 07:03:18 2022] POST /identity/v3/services => generated 251 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 07:03:18.309105 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1a96fd-93cb-49e4-8375-bce8b00db6cc None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:18.354694 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273ca5bb-8ccf-431d-82ac-a8d9e050e882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:18.355783 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273ca5bb-8ccf-431d-82ac-a8d9e050e882 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:18.356340 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273ca5bb-8ccf-431d-82ac-a8d9e050e882 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:18.356824 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273ca5bb-8ccf-431d-82ac-a8d9e050e882 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:18.435177 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273ca5bb-8ccf-431d-82ac-a8d9e050e882 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:18.436696 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273ca5bb-8ccf-431d-82ac-a8d9e050e882 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:18.539739 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 440/868] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Mar 30 07:03:18 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Mar 30 07:03:18.541437 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dc82e9-dfa0-4d24-bb9c-2730c2ff8fea None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:18.644461 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dc82e9-dfa0-4d24-bb9c-2730c2ff8fea None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:18.678185 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7973e803-0c4a-43b3-8d88-f1b38dfa76f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:18.678993 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7973e803-0c4a-43b3-8d88-f1b38dfa76f5 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:18.679273 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7973e803-0c4a-43b3-8d88-f1b38dfa76f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:18.679556 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7973e803-0c4a-43b3-8d88-f1b38dfa76f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:18.690423 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7973e803-0c4a-43b3-8d88-f1b38dfa76f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:18.691891 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7973e803-0c4a-43b3-8d88-f1b38dfa76f5 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:18.708879 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-7973e803-0c4a-43b3-8d88-f1b38dfa76f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 07:03:18.714781 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 429/869] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:03:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:03:18.716208 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273ca5bb-8ccf-431d-82ac-a8d9e050e882 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:18.745394 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ee36ee-91b1-4176-ae36-2850de5f80c9 None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:18.745797 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ee36ee-91b1-4176-ae36-2850de5f80c9 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:18.745951 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ee36ee-91b1-4176-ae36-2850de5f80c9 None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:18.747945 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 430/870] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:03:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 30 07:03:18.753633 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fd3c86-8e57-4be3-afff-d53548aa2c27 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:18.753976 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fd3c86-8e57-4be3-afff-d53548aa2c27 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:18.754187 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fd3c86-8e57-4be3-afff-d53548aa2c27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:18.773824 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-b8fd3c86-8e57-4be3-afff-d53548aa2c27 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:03:18.775982 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-b8fd3c86-8e57-4be3-afff-d53548aa2c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:03:18.835170 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273ca5bb-8ccf-431d-82ac-a8d9e050e882 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:18.856047 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 431/871] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:03:18 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 30 07:03:18.873062 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fd3c86-8e57-4be3-afff-d53548aa2c27 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:18.873599 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427d8f90-8b5e-40fd-9d99-047d0c7f9577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:18.874279 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427d8f90-8b5e-40fd-9d99-047d0c7f9577 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:18.874607 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427d8f90-8b5e-40fd-9d99-047d0c7f9577 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:18.874887 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427d8f90-8b5e-40fd-9d99-047d0c7f9577 None admin] PATH_INFO: `/v3/domains` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:18.875611 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427d8f90-8b5e-40fd-9d99-047d0c7f9577 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:18.875978 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427d8f90-8b5e-40fd-9d99-047d0c7f9577 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:18.878375 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427d8f90-8b5e-40fd-9d99-047d0c7f9577 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:18.895918 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 441/872] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Mar 30 07:03:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:18.899556 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427d8f90-8b5e-40fd-9d99-047d0c7f9577 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:18.993730 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fd3c86-8e57-4be3-afff-d53548aa2c27 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:18.998181 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427d8f90-8b5e-40fd-9d99-047d0c7f9577 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:19.035564 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b48c6b3-fc5a-4b69-a206-fae662b313e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:19.036619 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a03051-9b96-46d0-9e7b-afbb1a1a69df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:19.037016 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48c6b3-fc5a-4b69-a206-fae662b313e1 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:19.037470 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48c6b3-fc5a-4b69-a206-fae662b313e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:19.037581 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a03051-9b96-46d0-9e7b-afbb1a1a69df None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:19.037922 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a03051-9b96-46d0-9e7b-afbb1a1a69df None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:19.038199 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48c6b3-fc5a-4b69-a206-fae662b313e1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:19.038305 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a03051-9b96-46d0-9e7b-afbb1a1a69df None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:19.039063 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a03051-9b96-46d0-9e7b-afbb1a1a69df None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:19.041099 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a03051-9b96-46d0-9e7b-afbb1a1a69df None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:19.046479 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b48c6b3-fc5a-4b69-a206-fae662b313e1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:19.048209 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b48c6b3-fc5a-4b69-a206-fae662b313e1 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:19.054063 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-88a03051-9b96-46d0-9e7b-afbb1a1a69df None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Mar 30 07:03:19.059868 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 432/873] 10.222.0.20 () {56 vars in 1126 bytes} [Wed Mar 30 07:03:18 2022] GET /identity/v3/services/object-store => generated 93 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 07:03:19.061905 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a03051-9b96-46d0-9e7b-afbb1a1a69df None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:19.067116 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-8b48c6b3-fc5a-4b69-a206-fae662b313e1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 30 07:03:19.073154 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 442/874] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Mar 30 07:03:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:03:19.075888 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b48c6b3-fc5a-4b69-a206-fae662b313e1 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:19.176974 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b48c6b3-fc5a-4b69-a206-fae662b313e1 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:19.184138 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a03051-9b96-46d0-9e7b-afbb1a1a69df None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:19.214510 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb06ef0-8e7a-4a1d-92e2-86a29e2947eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:19.215158 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb06ef0-8e7a-4a1d-92e2-86a29e2947eb None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:19.215449 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb06ef0-8e7a-4a1d-92e2-86a29e2947eb None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:19.215715 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb06ef0-8e7a-4a1d-92e2-86a29e2947eb None admin] PATH_INFO: `/v3/projects` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:19.216550 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb06ef0-8e7a-4a1d-92e2-86a29e2947eb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:19.216978 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb06ef0-8e7a-4a1d-92e2-86a29e2947eb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:19.218308 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb06ef0-8e7a-4a1d-92e2-86a29e2947eb None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:19.226420 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036b63b2-d6a0-493f-b6cc-837413f0b715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:19.227085 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036b63b2-d6a0-493f-b6cc-837413f0b715 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:19.227363 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036b63b2-d6a0-493f-b6cc-837413f0b715 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:19.227632 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036b63b2-d6a0-493f-b6cc-837413f0b715 None admin] PATH_INFO: `/v3/services` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:19.228447 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036b63b2-d6a0-493f-b6cc-837413f0b715 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:19.228756 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036b63b2-d6a0-493f-b6cc-837413f0b715 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:19.230109 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036b63b2-d6a0-493f-b6cc-837413f0b715 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:19.236577 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 443/875] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Mar 30 07:03:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:19.236577 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7420706f-3756-48e1-877f-898e58d6a92a None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:19.236577 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7420706f-3756-48e1-877f-898e58d6a92a None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:19.236577 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7420706f-3756-48e1-877f-898e58d6a92a None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:19.236577 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 444/876] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:03:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:03:19.239158 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7420706f-3756-48e1-877f-898e58d6a92a None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:19.242446 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 433/877] 10.222.0.20 () {56 vars in 1122 bytes} [Wed Mar 30 07:03:19 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:03:19.242591 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc264fb-ab00-46d2-a2f0-774efa01b01d None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:19.242840 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc264fb-ab00-46d2-a2f0-774efa01b01d None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:19.246294 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc264fb-ab00-46d2-a2f0-774efa01b01d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:19.259441 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-dfc264fb-ab00-46d2-a2f0-774efa01b01d None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:03:19.260583 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-dfc264fb-ab00-46d2-a2f0-774efa01b01d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:03:19.335831 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 434/878] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:03:19 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 30 07:03:19.335831 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc264fb-ab00-46d2-a2f0-774efa01b01d None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:19.346791 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7420706f-3756-48e1-877f-898e58d6a92a None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:19.383056 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf20a4c-f6b0-4fe9-a192-ddf12a1dd5cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:19.383785 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf20a4c-f6b0-4fe9-a192-ddf12a1dd5cf None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:19.384103 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf20a4c-f6b0-4fe9-a192-ddf12a1dd5cf None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:19.384363 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf20a4c-f6b0-4fe9-a192-ddf12a1dd5cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:19.385184 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf20a4c-f6b0-4fe9-a192-ddf12a1dd5cf None admin] RBAC: Adding query filter params (role.id=4848e2a52e0b428997632ab8a8d36e91, scope.project.id=7e4eda4c5cd84307b36a5b48642e816f, user.id=67102c1adcf0491e9ecdef970ab2d5ec) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:19.385500 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf20a4c-f6b0-4fe9-a192-ddf12a1dd5cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:19.386923 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf20a4c-f6b0-4fe9-a192-ddf12a1dd5cf None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:19.399557 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 445/879] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Mar 30 07:03:19 2022] GET /identity/v3/role_assignments?user.id=67102c1adcf0491e9ecdef970ab2d5ec&scope.project.id=7e4eda4c5cd84307b36a5b48642e816f&role.id=4848e2a52e0b428997632ab8a8d36e91 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:19.399557 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf20a4c-f6b0-4fe9-a192-ddf12a1dd5cf None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:19.457804 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc264fb-ab00-46d2-a2f0-774efa01b01d None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:19.498072 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf20a4c-f6b0-4fe9-a192-ddf12a1dd5cf None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:19.501939 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c704529-83f2-410f-ab98-0d052f5ecc55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:19.502635 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c704529-83f2-410f-ab98-0d052f5ecc55 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:19.502910 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c704529-83f2-410f-ab98-0d052f5ecc55 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:19.503180 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c704529-83f2-410f-ab98-0d052f5ecc55 None admin] PATH_INFO: `/v3/services` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:19.503927 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c704529-83f2-410f-ab98-0d052f5ecc55 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:19.504230 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c704529-83f2-410f-ab98-0d052f5ecc55 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:19.505639 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c704529-83f2-410f-ab98-0d052f5ecc55 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:19.512079 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 435/880] 10.222.0.20 () {56 vars in 1122 bytes} [Wed Mar 30 07:03:19 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:19.556815 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c493070d-cefa-4a98-abc2-b7ced5bf6666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:19.557889 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c493070d-cefa-4a98-abc2-b7ced5bf6666 None admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:19.558356 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c493070d-cefa-4a98-abc2-b7ced5bf6666 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:19.558792 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c493070d-cefa-4a98-abc2-b7ced5bf6666 None admin] PATH_INFO: `/v3/services` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:19.559706 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c493070d-cefa-4a98-abc2-b7ced5bf6666 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:19.561334 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c493070d-cefa-4a98-abc2-b7ced5bf6666 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:19.582021 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 446/881] 10.222.0.20 () {60 vars in 1141 bytes} [Wed Mar 30 07:03:19 2022] POST /identity/v3/services => generated 269 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:03:20.584270 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbcf341-8fed-480a-a3db-cb7aa7973566 None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:20.584896 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbcf341-8fed-480a-a3db-cb7aa7973566 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:20.584896 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbcf341-8fed-480a-a3db-cb7aa7973566 None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:20.586858 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 436/882] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:03:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:03:20.592427 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d303004-b4c2-42de-9e0f-7898f32a5190 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:20.593311 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d303004-b4c2-42de-9e0f-7898f32a5190 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:20.593775 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d303004-b4c2-42de-9e0f-7898f32a5190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:20.611395 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-2d303004-b4c2-42de-9e0f-7898f32a5190 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:03:20.612941 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-2d303004-b4c2-42de-9e0f-7898f32a5190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:03:20.690248 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 447/883] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:03:20 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 30 07:03:20.713033 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbcf341-8fed-480a-a3db-cb7aa7973566 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:20.813662 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbcf341-8fed-480a-a3db-cb7aa7973566 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:20.847109 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6552a1-aee4-49b1-ba7a-f59894141a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:20.847861 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6552a1-aee4-49b1-ba7a-f59894141a56 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:20.848148 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6552a1-aee4-49b1-ba7a-f59894141a56 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:20.848423 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6552a1-aee4-49b1-ba7a-f59894141a56 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:20.849086 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6552a1-aee4-49b1-ba7a-f59894141a56 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:20.850463 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6552a1-aee4-49b1-ba7a-f59894141a56 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:20.861870 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-ad6552a1-aee4-49b1-ba7a-f59894141a56 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Mar 30 07:03:20.863517 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 437/884] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Mar 30 07:03:20 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:03:20.869363 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d303004-b4c2-42de-9e0f-7898f32a5190 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:20.965873 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d303004-b4c2-42de-9e0f-7898f32a5190 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:20.999389 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac488ea2-d3f6-40da-bd98-e4f53fe6af93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:21.000083 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac488ea2-d3f6-40da-bd98-e4f53fe6af93 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:21.000359 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac488ea2-d3f6-40da-bd98-e4f53fe6af93 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:21.000632 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac488ea2-d3f6-40da-bd98-e4f53fe6af93 None admin] PATH_INFO: `/v3/services` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:21.001332 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac488ea2-d3f6-40da-bd98-e4f53fe6af93 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:21.001630 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac488ea2-d3f6-40da-bd98-e4f53fe6af93 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:21.003001 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac488ea2-d3f6-40da-bd98-e4f53fe6af93 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:21.007915 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 448/885] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Mar 30 07:03:20 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:21.013556 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6552a1-aee4-49b1-ba7a-f59894141a56 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:21.109521 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6552a1-aee4-49b1-ba7a-f59894141a56 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:21.142724 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6c7b09-b81f-4444-a113-fcceee5c052a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:21.143734 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c7b09-b81f-4444-a113-fcceee5c052a None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:21.144230 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c7b09-b81f-4444-a113-fcceee5c052a None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:21.144711 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c7b09-b81f-4444-a113-fcceee5c052a None admin] PATH_INFO: `/v3/services` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:21.145610 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6c7b09-b81f-4444-a113-fcceee5c052a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:21.146100 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6c7b09-b81f-4444-a113-fcceee5c052a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:21.147757 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6c7b09-b81f-4444-a113-fcceee5c052a None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:21.153315 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 438/886] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Mar 30 07:03:21 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:21.159395 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac488ea2-d3f6-40da-bd98-e4f53fe6af93 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:21.269275 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac488ea2-d3f6-40da-bd98-e4f53fe6af93 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:21.303070 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb7ff5f-4e1f-41a7-84ea-0fc241e398b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:21.303729 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb7ff5f-4e1f-41a7-84ea-0fc241e398b7 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:21.304045 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb7ff5f-4e1f-41a7-84ea-0fc241e398b7 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:21.304314 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb7ff5f-4e1f-41a7-84ea-0fc241e398b7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:21.305088 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb7ff5f-4e1f-41a7-84ea-0fc241e398b7 None admin] RBAC: Adding query filter params (interface=public, service_id=1ed0f930f6774eb08c468ee655cea4e8, region_id=RegionOne) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:21.305416 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb7ff5f-4e1f-41a7-84ea-0fc241e398b7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:21.306898 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb7ff5f-4e1f-41a7-84ea-0fc241e398b7 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:21.312439 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 449/887] 10.222.0.20 () {56 vars in 1251 bytes} [Wed Mar 30 07:03:21 2022] GET /identity/v3/endpoints?service_id=1ed0f930f6774eb08c468ee655cea4e8&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:21.317883 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6c7b09-b81f-4444-a113-fcceee5c052a None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:21.417244 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6c7b09-b81f-4444-a113-fcceee5c052a None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:21.450375 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739c5a72-1e41-41c4-8e7c-2359881ef6b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:21.451395 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739c5a72-1e41-41c4-8e7c-2359881ef6b4 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:21.451951 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739c5a72-1e41-41c4-8e7c-2359881ef6b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:21.452415 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739c5a72-1e41-41c4-8e7c-2359881ef6b4 None admin] PATH_INFO: `/v3/services` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:21.453287 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739c5a72-1e41-41c4-8e7c-2359881ef6b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:21.454845 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739c5a72-1e41-41c4-8e7c-2359881ef6b4 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:21.461210 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 439/888] 10.222.0.20 () {56 vars in 1087 bytes} [Wed Mar 30 07:03:21 2022] GET /identity/v3/services => generated 1268 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:03:21.926476 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb689f80-4406-4f7a-8c6e-faa9086458d3 None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:21.927003 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb689f80-4406-4f7a-8c6e-faa9086458d3 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:21.927003 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb689f80-4406-4f7a-8c6e-faa9086458d3 None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:21.929099 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 450/889] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:03:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:03:21.934746 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8801e21c-f590-4c71-b571-fbde7aa0ed3c None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:21.935178 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8801e21c-f590-4c71-b571-fbde7aa0ed3c None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:21.935368 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8801e21c-f590-4c71-b571-fbde7aa0ed3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:21.938796 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdab1701-c466-4709-a754-1b409729a394 None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:21.939080 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdab1701-c466-4709-a754-1b409729a394 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:21.939359 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdab1701-c466-4709-a754-1b409729a394 None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:21.941334 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 451/890] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:03:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:03:21.946462 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76730a2e-9bb6-4166-a787-8d921b668dea None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:21.946741 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76730a2e-9bb6-4166-a787-8d921b668dea None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:21.947014 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76730a2e-9bb6-4166-a787-8d921b668dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:21.955165 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-8801e21c-f590-4c71-b571-fbde7aa0ed3c None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:03:21.956649 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-8801e21c-f590-4c71-b571-fbde7aa0ed3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:03:21.964196 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-76730a2e-9bb6-4166-a787-8d921b668dea None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:03:21.965355 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-76730a2e-9bb6-4166-a787-8d921b668dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:03:22.022429 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 440/891] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:03:21 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 30 07:03:22.024595 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b60517-b1da-4b63-9763-aae134cb478e None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:22.025104 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b60517-b1da-4b63-9763-aae134cb478e None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:22.025595 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b60517-b1da-4b63-9763-aae134cb478e None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:22.031620 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 441/892] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:03:22 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:03:22.032722 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 452/893] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:03:21 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 30 07:03:22.033194 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2d1a8a-fd4e-44c4-ba0f-c1ffb9a38ac3 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:22.033541 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2d1a8a-fd4e-44c4-ba0f-c1ffb9a38ac3 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:22.033830 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2d1a8a-fd4e-44c4-ba0f-c1ffb9a38ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:22.051556 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76730a2e-9bb6-4166-a787-8d921b668dea None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:22.054694 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-3d2d1a8a-fd4e-44c4-ba0f-c1ffb9a38ac3 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:03:22.056302 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-3d2d1a8a-fd4e-44c4-ba0f-c1ffb9a38ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:03:22.131835 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 442/894] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:03:22 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 30 07:03:22.131835 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2d1a8a-fd4e-44c4-ba0f-c1ffb9a38ac3 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:22.159678 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76730a2e-9bb6-4166-a787-8d921b668dea None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:22.193378 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4a6b57-a7a9-46c5-9e5f-1290565ccbaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:22.194116 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a6b57-a7a9-46c5-9e5f-1290565ccbaf None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:22.194390 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a6b57-a7a9-46c5-9e5f-1290565ccbaf None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:22.194719 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a6b57-a7a9-46c5-9e5f-1290565ccbaf None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:22.210098 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4a6b57-a7a9-46c5-9e5f-1290565ccbaf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 07:03:22.217534 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-ed4a6b57-a7a9-46c5-9e5f-1290565ccbaf None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Mar 30 07:03:22.223754 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 453/895] 10.222.0.20 () {56 vars in 1120 bytes} [Wed Mar 30 07:03:22 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 07:03:22.223754 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4a6b57-a7a9-46c5-9e5f-1290565ccbaf None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:22.238113 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2d1a8a-fd4e-44c4-ba0f-c1ffb9a38ac3 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:22.271481 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f368a1da-7292-4a75-904b-4ece591ad39a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:22.272184 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f368a1da-7292-4a75-904b-4ece591ad39a None admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:22.272455 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f368a1da-7292-4a75-904b-4ece591ad39a None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:22.272726 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f368a1da-7292-4a75-904b-4ece591ad39a None admin] PATH_INFO: `/v3/services` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:22.273447 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f368a1da-7292-4a75-904b-4ece591ad39a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:22.275201 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f368a1da-7292-4a75-904b-4ece591ad39a None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:22.291850 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 443/896] 10.222.0.20 () {60 vars in 1141 bytes} [Wed Mar 30 07:03:22 2022] POST /identity/v3/services => generated 241 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:03:22.292681 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f368a1da-7292-4a75-904b-4ece591ad39a None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:22.341342 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4a6b57-a7a9-46c5-9e5f-1290565ccbaf None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:22.394405 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec2f688-ea9c-4012-8488-7103725be896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:22.395267 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec2f688-ea9c-4012-8488-7103725be896 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:22.395843 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec2f688-ea9c-4012-8488-7103725be896 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:22.396126 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec2f688-ea9c-4012-8488-7103725be896 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:22.396808 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec2f688-ea9c-4012-8488-7103725be896 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:22.398479 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec2f688-ea9c-4012-8488-7103725be896 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:22.408530 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f368a1da-7292-4a75-904b-4ece591ad39a None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:22.414452 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-1ec2f688-ea9c-4012-8488-7103725be896 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Mar 30 07:03:22.420094 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 454/897] 10.222.0.20 () {56 vars in 1132 bytes} [Wed Mar 30 07:03:22 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:03:22.422584 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec2f688-ea9c-4012-8488-7103725be896 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:22.451501 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e8dbb8-ce9a-4d69-acf3-414615478af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:22.452160 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e8dbb8-ce9a-4d69-acf3-414615478af8 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:22.452441 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e8dbb8-ce9a-4d69-acf3-414615478af8 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:22.452772 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e8dbb8-ce9a-4d69-acf3-414615478af8 None admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:22.453539 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e8dbb8-ce9a-4d69-acf3-414615478af8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:22.453888 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e8dbb8-ce9a-4d69-acf3-414615478af8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:22.455608 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e8dbb8-ce9a-4d69-acf3-414615478af8 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:22.469843 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 444/898] 10.222.0.20 () {56 vars in 1115 bytes} [Wed Mar 30 07:03:22 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:22.472067 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e8dbb8-ce9a-4d69-acf3-414615478af8 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:22.550012 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec2f688-ea9c-4012-8488-7103725be896 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:22.586909 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408df88f-2248-457f-8673-5b1858cfe7bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:22.587577 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408df88f-2248-457f-8673-5b1858cfe7bc None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:22.589859 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408df88f-2248-457f-8673-5b1858cfe7bc None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:22.589859 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408df88f-2248-457f-8673-5b1858cfe7bc None admin] PATH_INFO: `/v3/services` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:22.589859 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408df88f-2248-457f-8673-5b1858cfe7bc None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:22.589859 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408df88f-2248-457f-8673-5b1858cfe7bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:22.592214 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408df88f-2248-457f-8673-5b1858cfe7bc None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:22.596261 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 455/899] 10.222.0.20 () {56 vars in 1126 bytes} [Wed Mar 30 07:03:22 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:03:22.596492 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e8dbb8-ce9a-4d69-acf3-414615478af8 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:22.606138 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408df88f-2248-457f-8673-5b1858cfe7bc None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:22.637925 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03e482f-5929-4967-9064-dff2c94b3550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:22.640268 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03e482f-5929-4967-9064-dff2c94b3550 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:22.640731 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03e482f-5929-4967-9064-dff2c94b3550 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:22.641023 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03e482f-5929-4967-9064-dff2c94b3550 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:22.655664 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03e482f-5929-4967-9064-dff2c94b3550 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:22.657187 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03e482f-5929-4967-9064-dff2c94b3550 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:22.677644 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-f03e482f-5929-4967-9064-dff2c94b3550 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 07:03:22.679498 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 445/900] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:03:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 07:03:22.685342 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03e482f-5929-4967-9064-dff2c94b3550 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:22.739100 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408df88f-2248-457f-8673-5b1858cfe7bc None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:22.780960 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f40cf4f-9493-4fcd-ad0e-10db9833c5a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:22.782238 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f40cf4f-9493-4fcd-ad0e-10db9833c5a0 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:22.782872 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f40cf4f-9493-4fcd-ad0e-10db9833c5a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:22.783642 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f40cf4f-9493-4fcd-ad0e-10db9833c5a0 None admin] PATH_INFO: `/v3/services` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:22.784947 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f40cf4f-9493-4fcd-ad0e-10db9833c5a0 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:22.785472 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f40cf4f-9493-4fcd-ad0e-10db9833c5a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:22.786026 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03e482f-5929-4967-9064-dff2c94b3550 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:22.787498 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f40cf4f-9493-4fcd-ad0e-10db9833c5a0 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:22.794428 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 456/901] 10.222.0.20 () {56 vars in 1126 bytes} [Wed Mar 30 07:03:22 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:22.800992 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f40cf4f-9493-4fcd-ad0e-10db9833c5a0 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:22.825012 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53e6e23-fb94-415f-bf9c-5016c9597ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:22.825679 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53e6e23-fb94-415f-bf9c-5016c9597ce0 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:22.825959 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53e6e23-fb94-415f-bf9c-5016c9597ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:22.826230 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53e6e23-fb94-415f-bf9c-5016c9597ce0 None admin] PATH_INFO: `/v3/domains` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:22.826946 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53e6e23-fb94-415f-bf9c-5016c9597ce0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:22.827250 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53e6e23-fb94-415f-bf9c-5016c9597ce0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:22.829183 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53e6e23-fb94-415f-bf9c-5016c9597ce0 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:22.847888 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 446/902] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Mar 30 07:03:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:22.851729 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53e6e23-fb94-415f-bf9c-5016c9597ce0 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:22.928635 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f40cf4f-9493-4fcd-ad0e-10db9833c5a0 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:22.964900 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53e6e23-fb94-415f-bf9c-5016c9597ce0 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:22.972589 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2f37cf-8f13-41fb-8823-a924f995bfa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:22.973305 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2f37cf-8f13-41fb-8823-a924f995bfa4 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:22.973593 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2f37cf-8f13-41fb-8823-a924f995bfa4 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:22.973863 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2f37cf-8f13-41fb-8823-a924f995bfa4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:22.974651 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2f37cf-8f13-41fb-8823-a924f995bfa4 None admin] RBAC: Adding query filter params (interface=public, service_id=d099b1be5c6143f0aea5f6530ae27cb2, region_id=RegionOne) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:22.974956 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2f37cf-8f13-41fb-8823-a924f995bfa4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:22.976368 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2f37cf-8f13-41fb-8823-a924f995bfa4 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:22.986941 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 457/903] 10.222.0.20 () {56 vars in 1251 bytes} [Wed Mar 30 07:03:22 2022] GET /identity/v3/endpoints?service_id=d099b1be5c6143f0aea5f6530ae27cb2&interface=public®ion_id=RegionOne => generated 194 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:03:22.987798 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2f37cf-8f13-41fb-8823-a924f995bfa4 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:23.003013 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf6cf8b-07d7-4c81-a120-8f940b5b0232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:23.004255 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf6cf8b-07d7-4c81-a120-8f940b5b0232 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:23.004753 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf6cf8b-07d7-4c81-a120-8f940b5b0232 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:23.005242 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf6cf8b-07d7-4c81-a120-8f940b5b0232 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:23.013151 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf6cf8b-07d7-4c81-a120-8f940b5b0232 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:23.014863 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf6cf8b-07d7-4c81-a120-8f940b5b0232 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:23.029753 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-1bf6cf8b-07d7-4c81-a120-8f940b5b0232 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Mar 30 07:03:23.035945 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 447/904] 10.222.0.20 () {56 vars in 1117 bytes} [Wed Mar 30 07:03:22 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:03:23.037571 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf6cf8b-07d7-4c81-a120-8f940b5b0232 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:23.091346 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2f37cf-8f13-41fb-8823-a924f995bfa4 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:23.125952 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c88e442-e33c-4b6a-9688-a700c096dc66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:23.126711 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c88e442-e33c-4b6a-9688-a700c096dc66 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:23.126889 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c88e442-e33c-4b6a-9688-a700c096dc66 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:23.127168 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c88e442-e33c-4b6a-9688-a700c096dc66 None admin] PATH_INFO: `/v3/services` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:23.127873 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c88e442-e33c-4b6a-9688-a700c096dc66 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:23.129256 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c88e442-e33c-4b6a-9688-a700c096dc66 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:23.138667 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf6cf8b-07d7-4c81-a120-8f940b5b0232 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:23.143521 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 458/905] 10.222.0.20 () {56 vars in 1087 bytes} [Wed Mar 30 07:03:22 2022] GET /identity/v3/services => generated 1497 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:03:23.179098 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2720fd3e-5a36-4c83-995b-704e3aa2ce60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:23.180284 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2720fd3e-5a36-4c83-995b-704e3aa2ce60 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:23.180842 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2720fd3e-5a36-4c83-995b-704e3aa2ce60 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:23.181316 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2720fd3e-5a36-4c83-995b-704e3aa2ce60 None admin] PATH_INFO: `/v3/users` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:23.182378 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2720fd3e-5a36-4c83-995b-704e3aa2ce60 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:23.182920 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2720fd3e-5a36-4c83-995b-704e3aa2ce60 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:23.184621 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2720fd3e-5a36-4c83-995b-704e3aa2ce60 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:23.219080 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 448/906] 10.222.0.20 () {56 vars in 1149 bytes} [Wed Mar 30 07:03:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:03:23.220942 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c88e442-e33c-4b6a-9688-a700c096dc66 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:23.328544 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c88e442-e33c-4b6a-9688-a700c096dc66 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:23.366717 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e3fe21-76fc-428e-9c96-02a3e3da60d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:23.367378 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e3fe21-76fc-428e-9c96-02a3e3da60d9 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:23.367658 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e3fe21-76fc-428e-9c96-02a3e3da60d9 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:23.368146 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e3fe21-76fc-428e-9c96-02a3e3da60d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:23.437411 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e3fe21-76fc-428e-9c96-02a3e3da60d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:23.439000 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e3fe21-76fc-428e-9c96-02a3e3da60d9 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:23.546135 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 459/907] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Mar 30 07:03:23 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 30 07:03:23.551927 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2720fd3e-5a36-4c83-995b-704e3aa2ce60 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:23.652784 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2720fd3e-5a36-4c83-995b-704e3aa2ce60 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:23.687269 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8606bcbe-e70e-4dd6-8a1e-7070eac76336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:23.688154 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8606bcbe-e70e-4dd6-8a1e-7070eac76336 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:23.688437 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8606bcbe-e70e-4dd6-8a1e-7070eac76336 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:23.688708 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8606bcbe-e70e-4dd6-8a1e-7070eac76336 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:23.699106 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8606bcbe-e70e-4dd6-8a1e-7070eac76336 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:23.700615 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8606bcbe-e70e-4dd6-8a1e-7070eac76336 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:23.717550 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-8606bcbe-e70e-4dd6-8a1e-7070eac76336 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 07:03:23.723443 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 449/908] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:03:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:03:23.724863 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e3fe21-76fc-428e-9c96-02a3e3da60d9 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:23.806662 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef6e95-b8c3-4ea2-91f9-3257e5af2556 None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:23.806986 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef6e95-b8c3-4ea2-91f9-3257e5af2556 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:23.807198 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef6e95-b8c3-4ea2-91f9-3257e5af2556 None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:23.809301 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 450/909] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:03:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 30 07:03:23.814905 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c3968b-8ac8-445e-a2d9-3578fef886b0 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:23.815190 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c3968b-8ac8-445e-a2d9-3578fef886b0 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:23.815465 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c3968b-8ac8-445e-a2d9-3578fef886b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:23.828191 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e3fe21-76fc-428e-9c96-02a3e3da60d9 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:23.833290 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-d3c3968b-8ac8-445e-a2d9-3578fef886b0 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:03:23.834468 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-d3c3968b-8ac8-445e-a2d9-3578fef886b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:03:23.870652 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91303a58-9635-4e07-bcc3-5cba8c89cba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:23.871688 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91303a58-9635-4e07-bcc3-5cba8c89cba6 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:23.872201 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91303a58-9635-4e07-bcc3-5cba8c89cba6 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:23.872673 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91303a58-9635-4e07-bcc3-5cba8c89cba6 None admin] PATH_INFO: `/v3/domains` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:23.873589 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91303a58-9635-4e07-bcc3-5cba8c89cba6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:23.874089 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91303a58-9635-4e07-bcc3-5cba8c89cba6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:23.876108 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91303a58-9635-4e07-bcc3-5cba8c89cba6 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:23.895454 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 460/910] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Mar 30 07:03:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:23.897583 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91303a58-9635-4e07-bcc3-5cba8c89cba6 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:23.908634 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 451/911] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:03:23 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 30 07:03:23.932233 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c3968b-8ac8-445e-a2d9-3578fef886b0 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:24.013495 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91303a58-9635-4e07-bcc3-5cba8c89cba6 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:24.030046 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c3968b-8ac8-445e-a2d9-3578fef886b0 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:24.047390 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda3ba10-ce89-4945-be48-5ab3eac914a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:24.048375 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda3ba10-ce89-4945-be48-5ab3eac914a3 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:24.048655 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda3ba10-ce89-4945-be48-5ab3eac914a3 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:24.048924 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda3ba10-ce89-4945-be48-5ab3eac914a3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:24.057889 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda3ba10-ce89-4945-be48-5ab3eac914a3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:24.059973 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda3ba10-ce89-4945-be48-5ab3eac914a3 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:24.066678 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4c98aa-078f-490f-91ed-309b8188308e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:24.067802 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c98aa-078f-490f-91ed-309b8188308e None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:24.068365 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c98aa-078f-490f-91ed-309b8188308e None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:24.068879 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c98aa-078f-490f-91ed-309b8188308e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:24.069733 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4c98aa-078f-490f-91ed-309b8188308e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:24.071560 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4c98aa-078f-490f-91ed-309b8188308e None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:24.075023 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-fda3ba10-ce89-4945-be48-5ab3eac914a3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 30 07:03:24.081329 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 461/912] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Mar 30 07:03:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:03:24.082794 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda3ba10-ce89-4945-be48-5ab3eac914a3 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:24.087981 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-5b4c98aa-078f-490f-91ed-309b8188308e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Mar 30 07:03:24.092041 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 452/913] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Mar 30 07:03:23 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 07:03:24.096010 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4c98aa-078f-490f-91ed-309b8188308e None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:24.187512 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda3ba10-ce89-4945-be48-5ab3eac914a3 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:24.222233 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4c98aa-078f-490f-91ed-309b8188308e None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:24.226927 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57772c98-f30b-4da3-969b-c9d0cfe61d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:24.228104 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57772c98-f30b-4da3-969b-c9d0cfe61d5b None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:24.228527 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57772c98-f30b-4da3-969b-c9d0cfe61d5b None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:24.228897 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57772c98-f30b-4da3-969b-c9d0cfe61d5b None admin] PATH_INFO: `/v3/projects` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:24.229782 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57772c98-f30b-4da3-969b-c9d0cfe61d5b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:24.230183 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57772c98-f30b-4da3-969b-c9d0cfe61d5b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:24.231853 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57772c98-f30b-4da3-969b-c9d0cfe61d5b None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:24.246513 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 462/914] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Mar 30 07:03:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:24.255582 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57772c98-f30b-4da3-969b-c9d0cfe61d5b None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:24.262408 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be73457-a869-469f-9c53-376789c4a947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:24.263200 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be73457-a869-469f-9c53-376789c4a947 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:24.263544 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be73457-a869-469f-9c53-376789c4a947 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:24.263908 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be73457-a869-469f-9c53-376789c4a947 None admin] PATH_INFO: `/v3/services` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:24.264695 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be73457-a869-469f-9c53-376789c4a947 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:24.265065 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be73457-a869-469f-9c53-376789c4a947 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:24.266526 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be73457-a869-469f-9c53-376789c4a947 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:24.272160 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 453/915] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Mar 30 07:03:24 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:24.278808 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be73457-a869-469f-9c53-376789c4a947 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:24.383796 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be73457-a869-469f-9c53-376789c4a947 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:24.385061 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57772c98-f30b-4da3-969b-c9d0cfe61d5b None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:24.422820 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ac09b4-4371-4b90-8303-252a77bc3c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:24.423597 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ac09b4-4371-4b90-8303-252a77bc3c05 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:24.423973 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ac09b4-4371-4b90-8303-252a77bc3c05 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:24.424386 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ac09b4-4371-4b90-8303-252a77bc3c05 None admin] PATH_INFO: `/v3/services` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:24.425140 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1134bf73-a318-45ad-bcaf-4cc7c276aacc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:24.425298 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ac09b4-4371-4b90-8303-252a77bc3c05 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:24.425602 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ac09b4-4371-4b90-8303-252a77bc3c05 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:24.426267 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1134bf73-a318-45ad-bcaf-4cc7c276aacc None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:24.426691 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1134bf73-a318-45ad-bcaf-4cc7c276aacc None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:24.427116 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1134bf73-a318-45ad-bcaf-4cc7c276aacc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:24.427259 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ac09b4-4371-4b90-8303-252a77bc3c05 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:24.428441 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1134bf73-a318-45ad-bcaf-4cc7c276aacc None admin] RBAC: Adding query filter params (role.id=14814d9e7d1c442eb709661619f37b61, scope.project.id=7e4eda4c5cd84307b36a5b48642e816f, user.id=67102c1adcf0491e9ecdef970ab2d5ec) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:24.428932 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1134bf73-a318-45ad-bcaf-4cc7c276aacc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:24.430685 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1134bf73-a318-45ad-bcaf-4cc7c276aacc None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:24.435995 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 454/916] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Mar 30 07:03:24 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:24.440585 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ac09b4-4371-4b90-8303-252a77bc3c05 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:24.447995 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 463/917] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Mar 30 07:03:24 2022] GET /identity/v3/role_assignments?user.id=67102c1adcf0491e9ecdef970ab2d5ec&scope.project.id=7e4eda4c5cd84307b36a5b48642e816f&role.id=14814d9e7d1c442eb709661619f37b61 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:24.548460 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ac09b4-4371-4b90-8303-252a77bc3c05 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:24.584585 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c517826-e55e-4899-bb3e-3aa84d45d9a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:24.585256 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c517826-e55e-4899-bb3e-3aa84d45d9a6 None admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:24.585590 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c517826-e55e-4899-bb3e-3aa84d45d9a6 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:24.585862 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c517826-e55e-4899-bb3e-3aa84d45d9a6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:24.586716 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c517826-e55e-4899-bb3e-3aa84d45d9a6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:24.588784 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c517826-e55e-4899-bb3e-3aa84d45d9a6 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:24.615636 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 455/918] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Mar 30 07:03:24 2022] POST /identity/v3/endpoints => generated 346 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 07:03:24.672467 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f74e1e-96bd-4c12-b156-544058678b86 None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:24.672856 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f74e1e-96bd-4c12-b156-544058678b86 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:24.673041 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f74e1e-96bd-4c12-b156-544058678b86 None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:24.675140 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 464/919] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:03:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:03:24.681289 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bc3fea-2e0c-427c-bda7-3730edb5a0ee None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:24.681597 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bc3fea-2e0c-427c-bda7-3730edb5a0ee None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:24.681847 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bc3fea-2e0c-427c-bda7-3730edb5a0ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:24.700315 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-25bc3fea-2e0c-427c-bda7-3730edb5a0ee None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:03:24.701834 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-25bc3fea-2e0c-427c-bda7-3730edb5a0ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:03:24.780911 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 456/920] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:03:24 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 30 07:03:24.804632 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f74e1e-96bd-4c12-b156-544058678b86 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:24.910228 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f74e1e-96bd-4c12-b156-544058678b86 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:24.942959 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df80e988-28d0-4bbc-b5d6-6ae93e4ec4f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:24.944279 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df80e988-28d0-4bbc-b5d6-6ae93e4ec4f2 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:24.944751 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df80e988-28d0-4bbc-b5d6-6ae93e4ec4f2 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:24.945255 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df80e988-28d0-4bbc-b5d6-6ae93e4ec4f2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:24.946286 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df80e988-28d0-4bbc-b5d6-6ae93e4ec4f2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:24.947981 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df80e988-28d0-4bbc-b5d6-6ae93e4ec4f2 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:24.959628 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-df80e988-28d0-4bbc-b5d6-6ae93e4ec4f2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Mar 30 07:03:24.961370 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 465/921] 10.222.0.20 () {56 vars in 1126 bytes} [Wed Mar 30 07:03:24 2022] GET /identity/v3/services/object-store => generated 93 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:03:24.967597 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bc3fea-2e0c-427c-bda7-3730edb5a0ee None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:25.063173 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bc3fea-2e0c-427c-bda7-3730edb5a0ee None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:25.096686 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3175eb3-c523-4c19-b36e-8da616ea2ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:25.097689 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3175eb3-c523-4c19-b36e-8da616ea2ddf None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:25.098158 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3175eb3-c523-4c19-b36e-8da616ea2ddf None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:25.098614 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3175eb3-c523-4c19-b36e-8da616ea2ddf None admin] PATH_INFO: `/v3/services` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:25.099529 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3175eb3-c523-4c19-b36e-8da616ea2ddf None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:25.100075 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3175eb3-c523-4c19-b36e-8da616ea2ddf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:25.101636 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3175eb3-c523-4c19-b36e-8da616ea2ddf None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:25.106803 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 457/922] 10.222.0.20 () {56 vars in 1122 bytes} [Wed Mar 30 07:03:24 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:25.113205 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df80e988-28d0-4bbc-b5d6-6ae93e4ec4f2 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:25.214714 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df80e988-28d0-4bbc-b5d6-6ae93e4ec4f2 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:25.248394 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d36db58-f909-4b43-a132-62a191d07f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:25.249065 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d36db58-f909-4b43-a132-62a191d07f91 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:25.249344 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d36db58-f909-4b43-a132-62a191d07f91 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:25.249616 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d36db58-f909-4b43-a132-62a191d07f91 None admin] PATH_INFO: `/v3/services` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:25.250321 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d36db58-f909-4b43-a132-62a191d07f91 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:25.250622 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d36db58-f909-4b43-a132-62a191d07f91 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:25.252065 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d36db58-f909-4b43-a132-62a191d07f91 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:25.257480 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 466/923] 10.222.0.20 () {56 vars in 1122 bytes} [Wed Mar 30 07:03:25 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:25.263365 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3175eb3-c523-4c19-b36e-8da616ea2ddf None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:25.365777 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3175eb3-c523-4c19-b36e-8da616ea2ddf None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:25.399132 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdb0eb0-ad73-4252-b5fb-22d876f8a3e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:25.400235 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdb0eb0-ad73-4252-b5fb-22d876f8a3e6 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:25.400707 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdb0eb0-ad73-4252-b5fb-22d876f8a3e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:25.401166 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdb0eb0-ad73-4252-b5fb-22d876f8a3e6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:25.402146 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdb0eb0-ad73-4252-b5fb-22d876f8a3e6 None admin] RBAC: Adding query filter params (interface=public, service_id=79b39e3122a24cf9a3bc39a0c63845e8, region_id=RegionOne) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:25.402641 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdb0eb0-ad73-4252-b5fb-22d876f8a3e6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:25.404207 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdb0eb0-ad73-4252-b5fb-22d876f8a3e6 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:25.409621 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 458/924] 10.222.0.20 () {56 vars in 1251 bytes} [Wed Mar 30 07:03:25 2022] GET /identity/v3/endpoints?service_id=79b39e3122a24cf9a3bc39a0c63845e8&interface=public®ion_id=RegionOne => generated 194 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:25.415441 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d36db58-f909-4b43-a132-62a191d07f91 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:25.515645 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d36db58-f909-4b43-a132-62a191d07f91 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:25.550682 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4552943e-ec8e-4542-9893-30e6f4acb06b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:25.551357 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4552943e-ec8e-4542-9893-30e6f4acb06b None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:25.551637 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4552943e-ec8e-4542-9893-30e6f4acb06b None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:25.551944 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4552943e-ec8e-4542-9893-30e6f4acb06b None admin] PATH_INFO: `/v3/services` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:25.552630 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4552943e-ec8e-4542-9893-30e6f4acb06b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:25.554003 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4552943e-ec8e-4542-9893-30e6f4acb06b None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:25.560441 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 467/925] 10.222.0.20 () {56 vars in 1087 bytes} [Wed Mar 30 07:03:25 2022] GET /identity/v3/services => generated 1497 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:03:25.683016 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbe94e7-9b8e-4e85-b248-43f85167ac4f None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:25.683291 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbe94e7-9b8e-4e85-b248-43f85167ac4f None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:25.683569 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbe94e7-9b8e-4e85-b248-43f85167ac4f None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:25.685844 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 459/926] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:03:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:03:25.691661 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470ada48-3b4f-4b6a-92dd-bc6a00a5f6de None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:25.691978 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470ada48-3b4f-4b6a-92dd-bc6a00a5f6de None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:25.692256 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470ada48-3b4f-4b6a-92dd-bc6a00a5f6de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:25.710352 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-470ada48-3b4f-4b6a-92dd-bc6a00a5f6de None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:03:25.711582 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-470ada48-3b4f-4b6a-92dd-bc6a00a5f6de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:03:25.781887 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 468/927] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:03:25 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 30 07:03:25.804304 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbe94e7-9b8e-4e85-b248-43f85167ac4f None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:25.908336 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbe94e7-9b8e-4e85-b248-43f85167ac4f None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:25.942426 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9a5e21-326e-4181-bc94-d825c8909361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:25.943244 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9a5e21-326e-4181-bc94-d825c8909361 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:25.943516 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9a5e21-326e-4181-bc94-d825c8909361 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:25.943787 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9a5e21-326e-4181-bc94-d825c8909361 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:25.944465 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9a5e21-326e-4181-bc94-d825c8909361 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:25.945912 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9a5e21-326e-4181-bc94-d825c8909361 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:25.957854 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-cd9a5e21-326e-4181-bc94-d825c8909361 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Mar 30 07:03:25.959360 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 460/928] 10.222.0.20 () {56 vars in 1132 bytes} [Wed Mar 30 07:03:25 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:03:25.968970 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470ada48-3b4f-4b6a-92dd-bc6a00a5f6de None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:26.071180 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470ada48-3b4f-4b6a-92dd-bc6a00a5f6de None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:26.103966 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a53964c-4b8f-46e6-afbd-3f11539b1b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:26.104636 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a53964c-4b8f-46e6-afbd-3f11539b1b9f None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:26.104915 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a53964c-4b8f-46e6-afbd-3f11539b1b9f None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:26.105185 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a53964c-4b8f-46e6-afbd-3f11539b1b9f None admin] PATH_INFO: `/v3/services` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:26.105887 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a53964c-4b8f-46e6-afbd-3f11539b1b9f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:26.106193 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a53964c-4b8f-46e6-afbd-3f11539b1b9f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:26.107563 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a53964c-4b8f-46e6-afbd-3f11539b1b9f None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:26.112982 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 469/929] 10.222.0.20 () {56 vars in 1126 bytes} [Wed Mar 30 07:03:25 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:26.118637 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9a5e21-326e-4181-bc94-d825c8909361 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:26.227461 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9a5e21-326e-4181-bc94-d825c8909361 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:26.261083 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcaa7a1-2cde-4447-af93-b9557a1de450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:26.261746 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcaa7a1-2cde-4447-af93-b9557a1de450 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:26.262024 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcaa7a1-2cde-4447-af93-b9557a1de450 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:26.262292 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcaa7a1-2cde-4447-af93-b9557a1de450 None admin] PATH_INFO: `/v3/services` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:26.262990 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcaa7a1-2cde-4447-af93-b9557a1de450 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:26.263288 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcaa7a1-2cde-4447-af93-b9557a1de450 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:26.264678 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcaa7a1-2cde-4447-af93-b9557a1de450 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:26.270131 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 461/930] 10.222.0.20 () {56 vars in 1126 bytes} [Wed Mar 30 07:03:26 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:26.276064 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a53964c-4b8f-46e6-afbd-3f11539b1b9f None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:26.380604 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a53964c-4b8f-46e6-afbd-3f11539b1b9f None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:26.416015 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c7e9bf-4b91-4a4e-ba73-f22c961049b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:26.416709 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c7e9bf-4b91-4a4e-ba73-f22c961049b2 None admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:26.416996 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c7e9bf-4b91-4a4e-ba73-f22c961049b2 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:26.417270 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c7e9bf-4b91-4a4e-ba73-f22c961049b2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:26.418039 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c7e9bf-4b91-4a4e-ba73-f22c961049b2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:26.419464 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c7e9bf-4b91-4a4e-ba73-f22c961049b2 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:26.443329 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 470/931] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Mar 30 07:03:26 2022] POST /identity/v3/endpoints => generated 347 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:03:26.801530 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07bf3d4-db3e-46da-aaf3-56b19daccc75 None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:26.801835 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07bf3d4-db3e-46da-aaf3-56b19daccc75 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:26.802118 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07bf3d4-db3e-46da-aaf3-56b19daccc75 None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:26.804218 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 462/932] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:03:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:03:26.809597 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1025b6ac-39d1-46f0-91b1-def5fd273bae None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:26.809884 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1025b6ac-39d1-46f0-91b1-def5fd273bae None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:26.810161 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1025b6ac-39d1-46f0-91b1-def5fd273bae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:26.828741 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-1025b6ac-39d1-46f0-91b1-def5fd273bae None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:03:26.829946 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-1025b6ac-39d1-46f0-91b1-def5fd273bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:03:26.908182 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 471/933] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:03:26 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 30 07:03:26.931189 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07bf3d4-db3e-46da-aaf3-56b19daccc75 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:27.034615 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07bf3d4-db3e-46da-aaf3-56b19daccc75 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:27.072632 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b0ac70-fd6d-4491-b73a-a4854ac24482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:27.073262 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b0ac70-fd6d-4491-b73a-a4854ac24482 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:27.073544 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b0ac70-fd6d-4491-b73a-a4854ac24482 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:27.073817 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b0ac70-fd6d-4491-b73a-a4854ac24482 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:27.074227 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c5e0b0-c7cc-4ad3-8d1a-0c559d6940a3 None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:27.074517 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c5e0b0-c7cc-4ad3-8d1a-0c559d6940a3 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:27.074792 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c5e0b0-c7cc-4ad3-8d1a-0c559d6940a3 None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:27.076848 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 472/934] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:03:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 30 07:03:27.081588 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2577fa1-ea18-4e80-abc8-f85fa76538d4 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:27.081861 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2577fa1-ea18-4e80-abc8-f85fa76538d4 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:27.082134 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2577fa1-ea18-4e80-abc8-f85fa76538d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:27.084176 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b0ac70-fd6d-4491-b73a-a4854ac24482 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 07:03:27.092898 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-e4b0ac70-fd6d-4491-b73a-a4854ac24482 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Mar 30 07:03:27.094897 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 463/935] 10.222.0.20 () {56 vars in 1120 bytes} [Wed Mar 30 07:03:26 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 07:03:27.098855 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-f2577fa1-ea18-4e80-abc8-f85fa76538d4 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:03:27.100149 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-f2577fa1-ea18-4e80-abc8-f85fa76538d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:03:27.100721 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b0ac70-fd6d-4491-b73a-a4854ac24482 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:27.182585 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 473/936] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:03:27 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 30 07:03:27.206101 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2577fa1-ea18-4e80-abc8-f85fa76538d4 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:27.214046 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b0ac70-fd6d-4491-b73a-a4854ac24482 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:27.252376 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b28749-1a31-4581-af4d-ddddcb738b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:27.253051 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b28749-1a31-4581-af4d-ddddcb738b82 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:27.253328 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b28749-1a31-4581-af4d-ddddcb738b82 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:27.253603 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b28749-1a31-4581-af4d-ddddcb738b82 None admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:27.254354 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b28749-1a31-4581-af4d-ddddcb738b82 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:27.254655 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b28749-1a31-4581-af4d-ddddcb738b82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:27.256079 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b28749-1a31-4581-af4d-ddddcb738b82 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:27.269653 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 464/937] 10.222.0.20 () {56 vars in 1115 bytes} [Wed Mar 30 07:03:27 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:27.270989 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b28749-1a31-4581-af4d-ddddcb738b82 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:27.311488 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2577fa1-ea18-4e80-abc8-f85fa76538d4 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:27.345293 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3934f88b-c29a-4288-a2e6-a1dd0196a0e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:27.345973 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3934f88b-c29a-4288-a2e6-a1dd0196a0e6 None admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:27.346254 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3934f88b-c29a-4288-a2e6-a1dd0196a0e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:27.346522 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3934f88b-c29a-4288-a2e6-a1dd0196a0e6 None admin] PATH_INFO: `/v3/projects` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:27.347221 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3934f88b-c29a-4288-a2e6-a1dd0196a0e6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:27.348698 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3934f88b-c29a-4288-a2e6-a1dd0196a0e6 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:27.350062 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.common [None req-3934f88b-c29a-4288-a2e6-a1dd0196a0e6 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Mar 30 07:03:27.369768 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.sql.core [None req-3934f88b-c29a-4288-a2e6-a1dd0196a0e6 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Mar 30 07:03:27.369768 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Mar 30 07:03:27.369768 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [parameters: {'id': '68b7e24f9b9f4f748a126668871dda1b', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Mar 30 07:03:27.369768 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79960) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Mar 30 07:03:27.376202 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-3934f88b-c29a-4288-a2e6-a1dd0196a0e6 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 68b7e24f9b9f4f748a126668871dda1b.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 68b7e24f9b9f4f748a126668871dda1b. Mar 30 07:03:27.380901 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 474/938] 10.222.0.20 () {60 vars in 1140 bytes} [Wed Mar 30 07:03:27 2022] POST /identity/v3/projects => generated 262 bytes in 172 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Mar 30 07:03:27.383634 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3934f88b-c29a-4288-a2e6-a1dd0196a0e6 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:27.388976 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b28749-1a31-4581-af4d-ddddcb738b82 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:27.433152 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3689a30c-ad1a-4391-aece-ed1b02928054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:27.434280 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3689a30c-ad1a-4391-aece-ed1b02928054 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:27.434620 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3689a30c-ad1a-4391-aece-ed1b02928054 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:27.434992 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3689a30c-ad1a-4391-aece-ed1b02928054 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:27.449414 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3689a30c-ad1a-4391-aece-ed1b02928054 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:27.450886 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3689a30c-ad1a-4391-aece-ed1b02928054 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:27.472378 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-3689a30c-ad1a-4391-aece-ed1b02928054 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 07:03:27.478460 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 465/939] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:03:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 07:03:27.479940 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3689a30c-ad1a-4391-aece-ed1b02928054 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:27.498312 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3934f88b-c29a-4288-a2e6-a1dd0196a0e6 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:27.542750 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c77706d-44b7-44a8-8690-99610423ead7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:27.544722 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c77706d-44b7-44a8-8690-99610423ead7 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:27.545011 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c77706d-44b7-44a8-8690-99610423ead7 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:27.545278 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c77706d-44b7-44a8-8690-99610423ead7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:27.553403 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c77706d-44b7-44a8-8690-99610423ead7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:27.555076 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c77706d-44b7-44a8-8690-99610423ead7 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:27.571424 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-4c77706d-44b7-44a8-8690-99610423ead7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 30 07:03:27.578915 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 475/940] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Mar 30 07:03:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 07:03:27.580610 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c77706d-44b7-44a8-8690-99610423ead7 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:27.595490 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3689a30c-ad1a-4391-aece-ed1b02928054 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:27.632617 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a8b224-257b-420c-8032-c08318099a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:27.633331 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a8b224-257b-420c-8032-c08318099a38 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:27.633683 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a8b224-257b-420c-8032-c08318099a38 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:27.633959 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a8b224-257b-420c-8032-c08318099a38 None admin] PATH_INFO: `/v3/domains` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:27.634693 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a8b224-257b-420c-8032-c08318099a38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:27.634994 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a8b224-257b-420c-8032-c08318099a38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:27.636763 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a8b224-257b-420c-8032-c08318099a38 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:27.653314 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 466/941] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Mar 30 07:03:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:03:27.654576 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a8b224-257b-420c-8032-c08318099a38 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:27.710792 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c77706d-44b7-44a8-8690-99610423ead7 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:27.755380 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46df6730-674a-4560-b345-e68a1dd94d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:27.756660 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df6730-674a-4560-b345-e68a1dd94d94 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:27.757336 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df6730-674a-4560-b345-e68a1dd94d94 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:27.757777 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df6730-674a-4560-b345-e68a1dd94d94 None admin] PATH_INFO: `/v3/projects` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:27.758792 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46df6730-674a-4560-b345-e68a1dd94d94 None admin] RBAC: Adding query filter params (name=service) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:27.759291 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46df6730-674a-4560-b345-e68a1dd94d94 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:27.759403 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a8b224-257b-420c-8032-c08318099a38 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:27.761184 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46df6730-674a-4560-b345-e68a1dd94d94 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:27.792011 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 476/942] 10.222.0.20 () {56 vars in 1112 bytes} [Wed Mar 30 07:03:27 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:03:27.802203 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec66dd7a-22b0-4b4a-83c5-e7900fbfdf70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:27.803079 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec66dd7a-22b0-4b4a-83c5-e7900fbfdf70 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:27.803363 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec66dd7a-22b0-4b4a-83c5-e7900fbfdf70 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:27.803639 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec66dd7a-22b0-4b4a-83c5-e7900fbfdf70 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:27.812703 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec66dd7a-22b0-4b4a-83c5-e7900fbfdf70 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:27.814348 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec66dd7a-22b0-4b4a-83c5-e7900fbfdf70 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:27.831121 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-ec66dd7a-22b0-4b4a-83c5-e7900fbfdf70 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Mar 30 07:03:27.837359 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 467/943] 10.222.0.20 () {56 vars in 1117 bytes} [Wed Mar 30 07:03:27 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:03:27.839267 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46df6730-674a-4560-b345-e68a1dd94d94 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:27.947793 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46df6730-674a-4560-b345-e68a1dd94d94 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:27.983240 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e88799-7188-40ef-9622-ff1686472e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:27.983964 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e88799-7188-40ef-9622-ff1686472e59 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:27.984247 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e88799-7188-40ef-9622-ff1686472e59 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:27.984523 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e88799-7188-40ef-9622-ff1686472e59 None admin] PATH_INFO: `/v3/users` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:27.985805 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e88799-7188-40ef-9622-ff1686472e59 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:27.986114 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e88799-7188-40ef-9622-ff1686472e59 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:27.987590 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e88799-7188-40ef-9622-ff1686472e59 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:28.011974 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 477/944] 10.222.0.20 () {56 vars in 1149 bytes} [Wed Mar 30 07:03:27 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:28.014216 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec66dd7a-22b0-4b4a-83c5-e7900fbfdf70 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:28.063785 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b2138f-59e3-4f66-97ad-90d02f020354 None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:28.064153 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b2138f-59e3-4f66-97ad-90d02f020354 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:28.064377 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b2138f-59e3-4f66-97ad-90d02f020354 None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:28.066522 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 478/945] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:03:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:03:28.071592 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f8185f-c424-4a37-896e-03282a5775fa None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:28.072038 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f8185f-c424-4a37-896e-03282a5775fa None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:28.072514 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f8185f-c424-4a37-896e-03282a5775fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:28.093114 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-33f8185f-c424-4a37-896e-03282a5775fa None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:03:28.094620 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-33f8185f-c424-4a37-896e-03282a5775fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:03:28.125327 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec66dd7a-22b0-4b4a-83c5-e7900fbfdf70 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:28.168284 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc0ba01-d689-4cce-951c-cb07cd1bbd64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:28.169096 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc0ba01-d689-4cce-951c-cb07cd1bbd64 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:28.169373 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc0ba01-d689-4cce-951c-cb07cd1bbd64 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:28.169643 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc0ba01-d689-4cce-951c-cb07cd1bbd64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:28.170989 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 479/946] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:03:28 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 30 07:03:28.184991 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc0ba01-d689-4cce-951c-cb07cd1bbd64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:28.186471 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc0ba01-d689-4cce-951c-cb07cd1bbd64 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:28.200320 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f8185f-c424-4a37-896e-03282a5775fa None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:28.213172 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-dbc0ba01-d689-4cce-951c-cb07cd1bbd64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 07:03:28.215864 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 468/947] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:03:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:03:28.221188 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc0ba01-d689-4cce-951c-cb07cd1bbd64 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:28.312189 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f8185f-c424-4a37-896e-03282a5775fa None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:28.343470 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc0ba01-d689-4cce-951c-cb07cd1bbd64 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:28.349589 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8888d872-dc33-4830-8e35-6a4f32eb8d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:28.350721 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8888d872-dc33-4830-8e35-6a4f32eb8d0e None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:28.351199 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8888d872-dc33-4830-8e35-6a4f32eb8d0e None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:28.351663 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8888d872-dc33-4830-8e35-6a4f32eb8d0e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:28.352923 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8888d872-dc33-4830-8e35-6a4f32eb8d0e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:28.354627 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8888d872-dc33-4830-8e35-6a4f32eb8d0e None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:28.366601 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-8888d872-dc33-4830-8e35-6a4f32eb8d0e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Mar 30 07:03:28.368727 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 480/948] 10.222.0.20 () {56 vars in 1126 bytes} [Wed Mar 30 07:03:28 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:03:28.375320 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8888d872-dc33-4830-8e35-6a4f32eb8d0e None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:28.387018 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e09e42-1f1e-4eb1-b975-e5f4689ae3d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:28.388070 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e09e42-1f1e-4eb1-b975-e5f4689ae3d5 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:28.388356 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e09e42-1f1e-4eb1-b975-e5f4689ae3d5 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:28.388632 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e09e42-1f1e-4eb1-b975-e5f4689ae3d5 None admin] PATH_INFO: `/v3/domains` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:28.389362 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e09e42-1f1e-4eb1-b975-e5f4689ae3d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:28.389674 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e09e42-1f1e-4eb1-b975-e5f4689ae3d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:28.391752 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e09e42-1f1e-4eb1-b975-e5f4689ae3d5 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:28.411788 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 469/949] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Mar 30 07:03:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:03:28.413448 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e09e42-1f1e-4eb1-b975-e5f4689ae3d5 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:28.484134 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8888d872-dc33-4830-8e35-6a4f32eb8d0e None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:28.514065 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e09e42-1f1e-4eb1-b975-e5f4689ae3d5 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:28.518874 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59444f8-9108-4d3c-8fba-b50e0de0c10d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:28.519852 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59444f8-9108-4d3c-8fba-b50e0de0c10d None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:28.520351 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59444f8-9108-4d3c-8fba-b50e0de0c10d None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:28.520844 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59444f8-9108-4d3c-8fba-b50e0de0c10d None admin] PATH_INFO: `/v3/services` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:28.521739 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59444f8-9108-4d3c-8fba-b50e0de0c10d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:28.522234 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59444f8-9108-4d3c-8fba-b50e0de0c10d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:28.523800 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59444f8-9108-4d3c-8fba-b50e0de0c10d None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:28.529657 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 481/950] 10.222.0.20 () {56 vars in 1122 bytes} [Wed Mar 30 07:03:28 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:28.535899 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59444f8-9108-4d3c-8fba-b50e0de0c10d None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:28.552987 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c275a019-e378-4eec-bf53-cb1812be8525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:28.553796 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c275a019-e378-4eec-bf53-cb1812be8525 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:28.554136 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c275a019-e378-4eec-bf53-cb1812be8525 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:28.554349 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c275a019-e378-4eec-bf53-cb1812be8525 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:28.561226 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c275a019-e378-4eec-bf53-cb1812be8525 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:28.562686 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c275a019-e378-4eec-bf53-cb1812be8525 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:28.576723 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-c275a019-e378-4eec-bf53-cb1812be8525 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 30 07:03:28.582853 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 470/951] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Mar 30 07:03:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:03:28.584373 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c275a019-e378-4eec-bf53-cb1812be8525 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:28.642713 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59444f8-9108-4d3c-8fba-b50e0de0c10d None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:28.677594 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1e1859-ebe2-4879-a6a3-dbaf39917df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:28.678670 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1e1859-ebe2-4879-a6a3-dbaf39917df2 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:28.679157 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1e1859-ebe2-4879-a6a3-dbaf39917df2 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:28.679630 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1e1859-ebe2-4879-a6a3-dbaf39917df2 None admin] PATH_INFO: `/v3/services` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:28.680850 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1e1859-ebe2-4879-a6a3-dbaf39917df2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:28.681447 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1e1859-ebe2-4879-a6a3-dbaf39917df2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:28.683015 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1e1859-ebe2-4879-a6a3-dbaf39917df2 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:28.684286 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c275a019-e378-4eec-bf53-cb1812be8525 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:28.688965 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 482/952] 10.222.0.20 () {56 vars in 1122 bytes} [Wed Mar 30 07:03:28 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:28.696244 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1e1859-ebe2-4879-a6a3-dbaf39917df2 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:28.724347 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f59d133-0012-432d-995e-2977ddaf67e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:28.725128 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f59d133-0012-432d-995e-2977ddaf67e8 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:28.725412 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f59d133-0012-432d-995e-2977ddaf67e8 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:28.725687 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f59d133-0012-432d-995e-2977ddaf67e8 None admin] PATH_INFO: `/v3/projects` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:28.726641 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f59d133-0012-432d-995e-2977ddaf67e8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:28.726953 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f59d133-0012-432d-995e-2977ddaf67e8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:28.729079 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f59d133-0012-432d-995e-2977ddaf67e8 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:28.748050 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 471/953] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Mar 30 07:03:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:28.751141 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f59d133-0012-432d-995e-2977ddaf67e8 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:28.813166 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1e1859-ebe2-4879-a6a3-dbaf39917df2 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:28.846267 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7d4135-cd88-4d6b-aff5-8255f36ef5ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:28.846939 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d4135-cd88-4d6b-aff5-8255f36ef5ce None admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:28.847214 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d4135-cd88-4d6b-aff5-8255f36ef5ce None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:28.847481 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d4135-cd88-4d6b-aff5-8255f36ef5ce None admin] PATH_INFO: `/v3/endpoints` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:28.848305 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7d4135-cd88-4d6b-aff5-8255f36ef5ce None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:28.849684 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7d4135-cd88-4d6b-aff5-8255f36ef5ce None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:28.852199 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f59d133-0012-432d-995e-2977ddaf67e8 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:28.869112 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 483/954] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Mar 30 07:03:28 2022] POST /identity/v3/endpoints => generated 349 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:03:28.871179 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5da782-0033-458e-901d-2dda2d9ea7c0 None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:28.871689 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5da782-0033-458e-901d-2dda2d9ea7c0 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:28.872458 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5da782-0033-458e-901d-2dda2d9ea7c0 None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:28.876070 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 484/955] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:03:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:03:28.885491 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60202c1-144e-4a57-bd09-f48c122642f0 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:28.886086 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60202c1-144e-4a57-bd09-f48c122642f0 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:28.886542 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60202c1-144e-4a57-bd09-f48c122642f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:28.906277 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-e60202c1-144e-4a57-bd09-f48c122642f0 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:03:28.908029 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-e60202c1-144e-4a57-bd09-f48c122642f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:03:28.908688 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62dbb37-65d9-4cc8-bbe7-4b34f6ef8132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:28.909746 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62dbb37-65d9-4cc8-bbe7-4b34f6ef8132 None admin] REQUEST_METHOD: `PUT` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:28.910037 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62dbb37-65d9-4cc8-bbe7-4b34f6ef8132 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:28.910316 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62dbb37-65d9-4cc8-bbe7-4b34f6ef8132 None admin] PATH_INFO: `/v3/projects/7e4eda4c5cd84307b36a5b48642e816f/users/67102c1adcf0491e9ecdef970ab2d5ec/roles/14814d9e7d1c442eb709661619f37b61` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:28.913466 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62dbb37-65d9-4cc8-bbe7-4b34f6ef8132 None admin] RBAC: Authorizing `identity:create_grant(project_id=7e4eda4c5cd84307b36a5b48642e816f, user_id=67102c1adcf0491e9ecdef970ab2d5ec, role_id=14814d9e7d1c442eb709661619f37b61)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:28.914997 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62dbb37-65d9-4cc8-bbe7-4b34f6ef8132 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:28.935933 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 472/956] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Mar 30 07:03:28 2022] PUT /identity/v3/projects/7e4eda4c5cd84307b36a5b48642e816f/users/67102c1adcf0491e9ecdef970ab2d5ec/roles/14814d9e7d1c442eb709661619f37b61 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 07:03:28.997040 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 485/957] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:03:28 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 30 07:03:29.020644 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62dbb37-65d9-4cc8-bbe7-4b34f6ef8132 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:29.139263 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62dbb37-65d9-4cc8-bbe7-4b34f6ef8132 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:29.175116 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19530824-3670-493b-a20e-46db70fdbb7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:29.176323 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19530824-3670-493b-a20e-46db70fdbb7e None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:29.176826 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19530824-3670-493b-a20e-46db70fdbb7e None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:29.177291 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19530824-3670-493b-a20e-46db70fdbb7e None admin] PATH_INFO: `/v3/services/compute` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:29.178141 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19530824-3670-493b-a20e-46db70fdbb7e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:29.179719 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19530824-3670-493b-a20e-46db70fdbb7e None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:29.191833 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-19530824-3670-493b-a20e-46db70fdbb7e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Mar 30 07:03:29.193630 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 473/958] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Mar 30 07:03:29 2022] GET /identity/v3/services/compute => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:03:29.200357 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60202c1-144e-4a57-bd09-f48c122642f0 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:29.303894 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60202c1-144e-4a57-bd09-f48c122642f0 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:29.339580 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24ade51-4940-4298-9d87-c4fba83c9159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:29.341162 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ade51-4940-4298-9d87-c4fba83c9159 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:29.341682 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ade51-4940-4298-9d87-c4fba83c9159 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:29.342159 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ade51-4940-4298-9d87-c4fba83c9159 None admin] PATH_INFO: `/v3/services` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:29.343064 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24ade51-4940-4298-9d87-c4fba83c9159 None admin] RBAC: Adding query filter params (name=compute) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:29.343587 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24ade51-4940-4298-9d87-c4fba83c9159 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:29.345190 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24ade51-4940-4298-9d87-c4fba83c9159 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:29.350655 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 486/959] 10.222.0.20 () {56 vars in 1112 bytes} [Wed Mar 30 07:03:29 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:29.356918 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19530824-3670-493b-a20e-46db70fdbb7e None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:29.456064 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19530824-3670-493b-a20e-46db70fdbb7e None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:29.493028 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dd910e-c686-4429-913a-8fb5770bfabb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:29.493697 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd910e-c686-4429-913a-8fb5770bfabb None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:29.493971 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd910e-c686-4429-913a-8fb5770bfabb None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:29.494242 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd910e-c686-4429-913a-8fb5770bfabb None admin] PATH_INFO: `/v3/services` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:29.494937 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dd910e-c686-4429-913a-8fb5770bfabb None admin] RBAC: Adding query filter params (type=compute) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:29.495236 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dd910e-c686-4429-913a-8fb5770bfabb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:29.496631 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dd910e-c686-4429-913a-8fb5770bfabb None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:29.501541 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 474/960] 10.222.0.20 () {56 vars in 1112 bytes} [Wed Mar 30 07:03:29 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:30.240411 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9432d93-07b9-457f-a02c-7c2343b20100 None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:30.241042 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9432d93-07b9-457f-a02c-7c2343b20100 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:30.241541 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9432d93-07b9-457f-a02c-7c2343b20100 None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:30.244095 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 487/961] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:03:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:03:30.249008 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b296942-bcb0-4837-9ad7-ddf5c9d16d5c None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:30.249291 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b296942-bcb0-4837-9ad7-ddf5c9d16d5c None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:30.249563 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b296942-bcb0-4837-9ad7-ddf5c9d16d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:30.266510 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-9b296942-bcb0-4837-9ad7-ddf5c9d16d5c None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:03:30.267693 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-9b296942-bcb0-4837-9ad7-ddf5c9d16d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:03:30.332670 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 475/962] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:03:30 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 30 07:03:30.357503 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9432d93-07b9-457f-a02c-7c2343b20100 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:30.458690 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9432d93-07b9-457f-a02c-7c2343b20100 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:30.493396 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cf87e4-55a5-4070-9595-09975122c9fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:30.494415 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf87e4-55a5-4070-9595-09975122c9fd None admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:30.494916 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf87e4-55a5-4070-9595-09975122c9fd None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:30.495408 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf87e4-55a5-4070-9595-09975122c9fd None admin] PATH_INFO: `/v3/users` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:30.496344 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cf87e4-55a5-4070-9595-09975122c9fd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:30.497991 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cf87e4-55a5-4070-9595-09975122c9fd None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:30.513671 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.sql.core [None req-c8cf87e4-55a5-4070-9595-09975122c9fd None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Mar 30 07:03:30.513671 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Mar 30 07:03:30.513671 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [parameters: {'user_id': '219981cb6e8548568c3053c811de2594', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Mar 30 07:03:30.513671 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79960) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Mar 30 07:03:30.520305 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-c8cf87e4-55a5-4070-9595-09975122c9fd None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Mar 30 07:03:30.522202 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 488/963] 10.222.0.20 () {60 vars in 1131 bytes} [Wed Mar 30 07:03:30 2022] POST /identity/v3/users => generated 160 bytes in 165 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:03:30.528136 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b296942-bcb0-4837-9ad7-ddf5c9d16d5c None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:30.626515 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b296942-bcb0-4837-9ad7-ddf5c9d16d5c None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:30.660356 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8cdd23-a346-4c7d-81af-03445132e5ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:30.661184 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8cdd23-a346-4c7d-81af-03445132e5ac None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:30.661461 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8cdd23-a346-4c7d-81af-03445132e5ac None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:30.661722 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8cdd23-a346-4c7d-81af-03445132e5ac None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:30.670235 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8cdd23-a346-4c7d-81af-03445132e5ac None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:30.671722 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8cdd23-a346-4c7d-81af-03445132e5ac None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:30.686874 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-3c8cdd23-a346-4c7d-81af-03445132e5ac None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Mar 30 07:03:30.688415 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 476/964] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Mar 30 07:03:30 2022] GET /identity/v3/users/cinder => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:03:30.694518 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cf87e4-55a5-4070-9595-09975122c9fd None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:30.801775 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cf87e4-55a5-4070-9595-09975122c9fd None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:30.835326 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b3f43e-9d9c-48ea-beb8-e5b2130f9101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:30.836107 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b3f43e-9d9c-48ea-beb8-e5b2130f9101 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:30.836449 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b3f43e-9d9c-48ea-beb8-e5b2130f9101 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:30.836726 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b3f43e-9d9c-48ea-beb8-e5b2130f9101 None admin] PATH_INFO: `/v3/users` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:30.837534 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b3f43e-9d9c-48ea-beb8-e5b2130f9101 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:30.837838 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b3f43e-9d9c-48ea-beb8-e5b2130f9101 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:30.839487 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b3f43e-9d9c-48ea-beb8-e5b2130f9101 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:30.879493 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 489/965] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Mar 30 07:03:30 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:31.275453 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e794f7aa-9e44-4605-b3a4-ccf4ddfeec6d None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:31.275718 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e794f7aa-9e44-4605-b3a4-ccf4ddfeec6d None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:31.275986 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e794f7aa-9e44-4605-b3a4-ccf4ddfeec6d None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:31.277759 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 477/966] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:03:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:03:31.283352 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1822ca-25e0-4beb-9591-26edf0f7a5e9 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:31.283607 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1822ca-25e0-4beb-9591-26edf0f7a5e9 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:31.283936 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1822ca-25e0-4beb-9591-26edf0f7a5e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:31.301215 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-9f1822ca-25e0-4beb-9591-26edf0f7a5e9 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:03:31.302686 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-9f1822ca-25e0-4beb-9591-26edf0f7a5e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:03:31.371592 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309280cb-674f-4582-84a0-11cbaf7b6b8e None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:31.371937 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309280cb-674f-4582-84a0-11cbaf7b6b8e None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:31.372181 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309280cb-674f-4582-84a0-11cbaf7b6b8e None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:31.374148 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 478/967] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:03:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:03:31.375968 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 490/968] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:03:31 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 30 07:03:31.379745 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a97fc5-774e-4c67-ab63-69c489930760 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:31.380151 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a97fc5-774e-4c67-ab63-69c489930760 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:31.380495 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a97fc5-774e-4c67-ab63-69c489930760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:31.395235 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1822ca-25e0-4beb-9591-26edf0f7a5e9 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:31.398852 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-a4a97fc5-774e-4c67-ab63-69c489930760 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:03:31.400093 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-a4a97fc5-774e-4c67-ab63-69c489930760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:03:31.467754 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 479/969] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:03:31 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 30 07:03:31.491898 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a97fc5-774e-4c67-ab63-69c489930760 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:31.497395 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1822ca-25e0-4beb-9591-26edf0f7a5e9 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:31.532028 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1036ae-1387-4207-a8aa-4b2fc2415087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:31.532850 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1036ae-1387-4207-a8aa-4b2fc2415087 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:31.533128 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1036ae-1387-4207-a8aa-4b2fc2415087 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:31.533398 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1036ae-1387-4207-a8aa-4b2fc2415087 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:31.534048 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1036ae-1387-4207-a8aa-4b2fc2415087 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:31.535444 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1036ae-1387-4207-a8aa-4b2fc2415087 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:31.547198 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-4a1036ae-1387-4207-a8aa-4b2fc2415087 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Mar 30 07:03:31.548579 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 491/970] 10.222.0.20 () {56 vars in 1126 bytes} [Wed Mar 30 07:03:31 2022] GET /identity/v3/services/object-store => generated 93 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 07:03:31.554204 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1036ae-1387-4207-a8aa-4b2fc2415087 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:31.595071 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a97fc5-774e-4c67-ab63-69c489930760 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:31.628159 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72be3710-317c-4d75-9bb9-1ae84cdea378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:31.628980 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be3710-317c-4d75-9bb9-1ae84cdea378 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:31.629259 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be3710-317c-4d75-9bb9-1ae84cdea378 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:31.629533 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be3710-317c-4d75-9bb9-1ae84cdea378 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:31.639334 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72be3710-317c-4d75-9bb9-1ae84cdea378 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 07:03:31.646720 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-72be3710-317c-4d75-9bb9-1ae84cdea378 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Mar 30 07:03:31.648096 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 480/971] 10.222.0.20 () {56 vars in 1120 bytes} [Wed Mar 30 07:03:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 07:03:31.653984 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72be3710-317c-4d75-9bb9-1ae84cdea378 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:31.654739 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1036ae-1387-4207-a8aa-4b2fc2415087 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:31.688771 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde692f2-d9bf-4f50-a95f-a4bd03dda83b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:31.689433 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde692f2-d9bf-4f50-a95f-a4bd03dda83b None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:31.689723 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde692f2-d9bf-4f50-a95f-a4bd03dda83b None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:31.689983 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde692f2-d9bf-4f50-a95f-a4bd03dda83b None admin] PATH_INFO: `/v3/services` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:31.690708 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde692f2-d9bf-4f50-a95f-a4bd03dda83b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:31.691016 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde692f2-d9bf-4f50-a95f-a4bd03dda83b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:31.692435 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde692f2-d9bf-4f50-a95f-a4bd03dda83b None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:31.701885 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 492/972] 10.222.0.20 () {56 vars in 1122 bytes} [Wed Mar 30 07:03:31 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:03:31.703001 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde692f2-d9bf-4f50-a95f-a4bd03dda83b None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:31.761738 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72be3710-317c-4d75-9bb9-1ae84cdea378 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:31.795051 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6d022c-0aea-48bd-b82f-259f07a06f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:31.795723 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d022c-0aea-48bd-b82f-259f07a06f77 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:31.796036 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d022c-0aea-48bd-b82f-259f07a06f77 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:31.796309 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d022c-0aea-48bd-b82f-259f07a06f77 None admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:31.797051 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6d022c-0aea-48bd-b82f-259f07a06f77 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:31.797378 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6d022c-0aea-48bd-b82f-259f07a06f77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:31.798769 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6d022c-0aea-48bd-b82f-259f07a06f77 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:31.801109 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde692f2-d9bf-4f50-a95f-a4bd03dda83b None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:31.807604 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 481/973] 10.222.0.20 () {56 vars in 1115 bytes} [Wed Mar 30 07:03:31 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:03:31.813042 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6d022c-0aea-48bd-b82f-259f07a06f77 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:31.836588 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5356c592-03d2-4506-b4a8-1ef2deab7ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:31.837264 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5356c592-03d2-4506-b4a8-1ef2deab7ceb None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:31.837541 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5356c592-03d2-4506-b4a8-1ef2deab7ceb None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:31.837809 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5356c592-03d2-4506-b4a8-1ef2deab7ceb None admin] PATH_INFO: `/v3/services` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:31.838513 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5356c592-03d2-4506-b4a8-1ef2deab7ceb None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:31.838815 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5356c592-03d2-4506-b4a8-1ef2deab7ceb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:31.840231 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5356c592-03d2-4506-b4a8-1ef2deab7ceb None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:31.845212 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 493/974] 10.222.0.20 () {56 vars in 1122 bytes} [Wed Mar 30 07:03:31 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:31.846279 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0439dacd-9e1e-479c-adca-3e0a37b3a388 None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:31.846563 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0439dacd-9e1e-479c-adca-3e0a37b3a388 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:31.846834 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0439dacd-9e1e-479c-adca-3e0a37b3a388 None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:31.848473 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 494/975] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:03:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:03:31.850617 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0439dacd-9e1e-479c-adca-3e0a37b3a388 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:31.909463 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6d022c-0aea-48bd-b82f-259f07a06f77 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:31.943360 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fdade6-88f5-4b6d-98c2-545a445a96ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:31.944171 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fdade6-88f5-4b6d-98c2-545a445a96ab None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:31.944427 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fdade6-88f5-4b6d-98c2-545a445a96ab None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:31.944696 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fdade6-88f5-4b6d-98c2-545a445a96ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:31.946300 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0439dacd-9e1e-479c-adca-3e0a37b3a388 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:31.954895 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fdade6-88f5-4b6d-98c2-545a445a96ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:31.956463 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fdade6-88f5-4b6d-98c2-545a445a96ab None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:31.972669 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-21fdade6-88f5-4b6d-98c2-545a445a96ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 07:03:31.973861 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 482/976] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:03:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 07:03:31.975023 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b8ba7d-b719-4175-948d-8566804f0696 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:31.975304 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b8ba7d-b719-4175-948d-8566804f0696 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:31.975522 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b8ba7d-b719-4175-948d-8566804f0696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:31.980447 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43272adf-9fdf-4905-812c-a22377f1996e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:31.981104 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43272adf-9fdf-4905-812c-a22377f1996e None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:31.981389 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43272adf-9fdf-4905-812c-a22377f1996e None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:31.981653 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43272adf-9fdf-4905-812c-a22377f1996e None admin] PATH_INFO: `/v3/endpoints` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:31.982434 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43272adf-9fdf-4905-812c-a22377f1996e None admin] RBAC: Adding query filter params (interface=admin, service_id=79b39e3122a24cf9a3bc39a0c63845e8, region_id=RegionOne) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:31.982741 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43272adf-9fdf-4905-812c-a22377f1996e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:31.984175 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43272adf-9fdf-4905-812c-a22377f1996e None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:31.989763 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 495/977] 10.222.0.20 () {56 vars in 1249 bytes} [Wed Mar 30 07:03:31 2022] GET /identity/v3/endpoints?service_id=79b39e3122a24cf9a3bc39a0c63845e8&interface=admin®ion_id=RegionOne => generated 193 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:31.990842 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43272adf-9fdf-4905-812c-a22377f1996e None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:31.993303 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-c6b8ba7d-b719-4175-948d-8566804f0696 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:03:31.994521 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-c6b8ba7d-b719-4175-948d-8566804f0696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:03:32.058470 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 483/978] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:03:31 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 30 07:03:32.059243 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b8ba7d-b719-4175-948d-8566804f0696 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:32.094226 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43272adf-9fdf-4905-812c-a22377f1996e None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:32.127271 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f1d3d5-2a11-480c-b27f-c39c37edd2ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:32.127958 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f1d3d5-2a11-480c-b27f-c39c37edd2ba None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:32.128234 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f1d3d5-2a11-480c-b27f-c39c37edd2ba None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:32.128504 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f1d3d5-2a11-480c-b27f-c39c37edd2ba None admin] PATH_INFO: `/v3/domains` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:32.129206 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f1d3d5-2a11-480c-b27f-c39c37edd2ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:32.129511 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f1d3d5-2a11-480c-b27f-c39c37edd2ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:32.130881 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f1d3d5-2a11-480c-b27f-c39c37edd2ba None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:32.146362 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 496/979] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Mar 30 07:03:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:32.147187 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f1d3d5-2a11-480c-b27f-c39c37edd2ba None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:32.157676 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b8ba7d-b719-4175-948d-8566804f0696 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:32.190161 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aecb595-4fad-4353-ad57-e7ef2f5461be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:32.190824 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aecb595-4fad-4353-ad57-e7ef2f5461be None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:32.191102 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aecb595-4fad-4353-ad57-e7ef2f5461be None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:32.191372 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aecb595-4fad-4353-ad57-e7ef2f5461be None admin] PATH_INFO: `/v3/services` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:32.192071 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aecb595-4fad-4353-ad57-e7ef2f5461be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:32.193440 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aecb595-4fad-4353-ad57-e7ef2f5461be None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:32.199290 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 484/980] 10.222.0.20 () {56 vars in 1087 bytes} [Wed Mar 30 07:03:32 2022] GET /identity/v3/services => generated 1497 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:03:32.200085 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aecb595-4fad-4353-ad57-e7ef2f5461be None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:32.259718 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f1d3d5-2a11-480c-b27f-c39c37edd2ba None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:32.299626 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d5cb28-8678-481f-a103-736b33a970de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:32.300364 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d5cb28-8678-481f-a103-736b33a970de None admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:32.300643 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d5cb28-8678-481f-a103-736b33a970de None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:32.300918 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d5cb28-8678-481f-a103-736b33a970de None admin] PATH_INFO: `/v3/services` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:32.301662 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d5cb28-8678-481f-a103-736b33a970de None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:32.303083 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d5cb28-8678-481f-a103-736b33a970de None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:32.317932 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 497/981] 10.222.0.20 () {60 vars in 1141 bytes} [Wed Mar 30 07:03:32 2022] POST /identity/v3/services => generated 242 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:03:32.318332 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aecb595-4fad-4353-ad57-e7ef2f5461be None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:32.366081 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5d9b2b-c6cb-4cc9-b493-60e1d5e087f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:32.366930 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5d9b2b-c6cb-4cc9-b493-60e1d5e087f7 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:32.367203 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5d9b2b-c6cb-4cc9-b493-60e1d5e087f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:32.367471 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5d9b2b-c6cb-4cc9-b493-60e1d5e087f7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:32.376153 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5d9b2b-c6cb-4cc9-b493-60e1d5e087f7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:32.377700 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5d9b2b-c6cb-4cc9-b493-60e1d5e087f7 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:32.396303 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-dc5d9b2b-c6cb-4cc9-b493-60e1d5e087f7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Mar 30 07:03:32.397791 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 485/982] 10.222.0.20 () {56 vars in 1117 bytes} [Wed Mar 30 07:03:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:03:32.404484 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d5cb28-8678-481f-a103-736b33a970de None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:32.512916 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d5cb28-8678-481f-a103-736b33a970de None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:32.548091 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4d7fbd-18ba-4d1f-a0f8-7bcce8d87359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:32.548826 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4d7fbd-18ba-4d1f-a0f8-7bcce8d87359 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:32.549128 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4d7fbd-18ba-4d1f-a0f8-7bcce8d87359 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:32.549445 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4d7fbd-18ba-4d1f-a0f8-7bcce8d87359 None admin] PATH_INFO: `/v3/users` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:32.550278 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4d7fbd-18ba-4d1f-a0f8-7bcce8d87359 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:32.550587 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4d7fbd-18ba-4d1f-a0f8-7bcce8d87359 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:32.552070 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4d7fbd-18ba-4d1f-a0f8-7bcce8d87359 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:32.570295 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 498/983] 10.222.0.20 () {56 vars in 1149 bytes} [Wed Mar 30 07:03:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:32.576645 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5d9b2b-c6cb-4cc9-b493-60e1d5e087f7 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:32.673931 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5d9b2b-c6cb-4cc9-b493-60e1d5e087f7 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:32.708630 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12dd30c-1475-42f9-be48-f8fb5c06cb27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:32.709276 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12dd30c-1475-42f9-be48-f8fb5c06cb27 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:32.709557 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12dd30c-1475-42f9-be48-f8fb5c06cb27 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:32.709827 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12dd30c-1475-42f9-be48-f8fb5c06cb27 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:32.774070 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12dd30c-1475-42f9-be48-f8fb5c06cb27 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:32.775543 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12dd30c-1475-42f9-be48-f8fb5c06cb27 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:32.867386 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 486/984] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Mar 30 07:03:32 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 30 07:03:32.872996 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4d7fbd-18ba-4d1f-a0f8-7bcce8d87359 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:32.971855 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4d7fbd-18ba-4d1f-a0f8-7bcce8d87359 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:33.006444 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc00424-2d54-4bec-b466-82ce477338f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:33.007257 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc00424-2d54-4bec-b466-82ce477338f5 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:33.007543 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc00424-2d54-4bec-b466-82ce477338f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:33.007819 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc00424-2d54-4bec-b466-82ce477338f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:33.018218 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc00424-2d54-4bec-b466-82ce477338f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:33.019671 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc00424-2d54-4bec-b466-82ce477338f5 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:33.036653 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-bcc00424-2d54-4bec-b466-82ce477338f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 07:03:33.038054 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 499/985] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:03:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:03:33.043782 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12dd30c-1475-42f9-be48-f8fb5c06cb27 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:33.144434 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12dd30c-1475-42f9-be48-f8fb5c06cb27 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:33.177751 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa16f946-9ce2-4d59-b63a-abd683fd98fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:33.178409 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa16f946-9ce2-4d59-b63a-abd683fd98fd None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:33.178668 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa16f946-9ce2-4d59-b63a-abd683fd98fd None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:33.178956 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa16f946-9ce2-4d59-b63a-abd683fd98fd None admin] PATH_INFO: `/v3/domains` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:33.179676 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa16f946-9ce2-4d59-b63a-abd683fd98fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:33.180093 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa16f946-9ce2-4d59-b63a-abd683fd98fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:33.181642 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa16f946-9ce2-4d59-b63a-abd683fd98fd None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:33.193462 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 487/986] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Mar 30 07:03:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:33.198940 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc00424-2d54-4bec-b466-82ce477338f5 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:33.302796 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc00424-2d54-4bec-b466-82ce477338f5 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:33.341467 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f9c835-0d3f-4f7c-a14e-4771e8c4c37b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:33.342287 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f9c835-0d3f-4f7c-a14e-4771e8c4c37b None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:33.342569 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f9c835-0d3f-4f7c-a14e-4771e8c4c37b None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:33.342840 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f9c835-0d3f-4f7c-a14e-4771e8c4c37b None admin] PATH_INFO: `/v3/projects/service` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:33.350106 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f9c835-0d3f-4f7c-a14e-4771e8c4c37b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:33.351566 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f9c835-0d3f-4f7c-a14e-4771e8c4c37b None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:33.365026 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-c7f9c835-0d3f-4f7c-a14e-4771e8c4c37b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 30 07:03:33.366443 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 500/987] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Mar 30 07:03:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:03:33.372343 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa16f946-9ce2-4d59-b63a-abd683fd98fd None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:33.475281 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa16f946-9ce2-4d59-b63a-abd683fd98fd None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:33.509574 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee06b179-2651-44a1-a0f0-70a25461be69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:33.510225 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee06b179-2651-44a1-a0f0-70a25461be69 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:33.510501 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee06b179-2651-44a1-a0f0-70a25461be69 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:33.510769 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee06b179-2651-44a1-a0f0-70a25461be69 None admin] PATH_INFO: `/v3/projects` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:33.511547 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee06b179-2651-44a1-a0f0-70a25461be69 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:33.511893 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee06b179-2651-44a1-a0f0-70a25461be69 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:33.513307 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee06b179-2651-44a1-a0f0-70a25461be69 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:33.525173 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 488/988] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Mar 30 07:03:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:33.531064 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f9c835-0d3f-4f7c-a14e-4771e8c4c37b None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:33.628749 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f9c835-0d3f-4f7c-a14e-4771e8c4c37b None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:33.660386 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fc2203-9f63-403d-825d-d907c9491db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:33.661037 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fc2203-9f63-403d-825d-d907c9491db7 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:33.661303 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fc2203-9f63-403d-825d-d907c9491db7 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:33.661585 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fc2203-9f63-403d-825d-d907c9491db7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:33.662404 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fc2203-9f63-403d-825d-d907c9491db7 None admin] RBAC: Adding query filter params (role.id=14814d9e7d1c442eb709661619f37b61, scope.project.id=7e4eda4c5cd84307b36a5b48642e816f, user.id=67102c1adcf0491e9ecdef970ab2d5ec) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:33.662709 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fc2203-9f63-403d-825d-d907c9491db7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:33.664179 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fc2203-9f63-403d-825d-d907c9491db7 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:33.670408 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 501/989] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Mar 30 07:03:33 2022] GET /identity/v3/role_assignments?user.id=67102c1adcf0491e9ecdef970ab2d5ec&scope.project.id=7e4eda4c5cd84307b36a5b48642e816f&role.id=14814d9e7d1c442eb709661619f37b61 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:34.496905 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc023849-f17e-47ec-a1e0-ddd6cb289702 None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:34.497413 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc023849-f17e-47ec-a1e0-ddd6cb289702 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:34.497413 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc023849-f17e-47ec-a1e0-ddd6cb289702 None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:34.499179 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 489/990] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:03:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:03:34.504598 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcf9306-9dd1-4cc6-a4bc-574e60d9321b None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:34.504874 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcf9306-9dd1-4cc6-a4bc-574e60d9321b None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:34.505152 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcf9306-9dd1-4cc6-a4bc-574e60d9321b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:34.522868 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-9fcf9306-9dd1-4cc6-a4bc-574e60d9321b None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:03:34.524155 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-9fcf9306-9dd1-4cc6-a4bc-574e60d9321b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:03:34.591841 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 502/991] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:03:34 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 30 07:03:34.615021 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc023849-f17e-47ec-a1e0-ddd6cb289702 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:34.621978 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2ee350-5507-4bea-89ec-eedf3f85ce60 None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:34.622234 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2ee350-5507-4bea-89ec-eedf3f85ce60 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:34.622720 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2ee350-5507-4bea-89ec-eedf3f85ce60 None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:34.624749 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 503/992] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:03:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 30 07:03:34.629691 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce22cae4-3aa4-43d2-ab83-9219a02e3b16 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:34.629981 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce22cae4-3aa4-43d2-ab83-9219a02e3b16 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:34.630220 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce22cae4-3aa4-43d2-ab83-9219a02e3b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:34.647053 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-ce22cae4-3aa4-43d2-ab83-9219a02e3b16 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:03:34.648237 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-ce22cae4-3aa4-43d2-ab83-9219a02e3b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:03:34.712878 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 504/993] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:03:34 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 30 07:03:34.715654 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc023849-f17e-47ec-a1e0-ddd6cb289702 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:34.736678 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce22cae4-3aa4-43d2-ab83-9219a02e3b16 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:34.748820 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb48361f-094c-42a3-8062-5ccb65b62f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:34.749558 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb48361f-094c-42a3-8062-5ccb65b62f5c None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:34.749834 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb48361f-094c-42a3-8062-5ccb65b62f5c None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:34.750101 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb48361f-094c-42a3-8062-5ccb65b62f5c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:34.750752 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb48361f-094c-42a3-8062-5ccb65b62f5c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:34.752150 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb48361f-094c-42a3-8062-5ccb65b62f5c None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:34.762975 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-eb48361f-094c-42a3-8062-5ccb65b62f5c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Mar 30 07:03:34.764325 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 490/994] 10.222.0.20 () {56 vars in 1126 bytes} [Wed Mar 30 07:03:34 2022] GET /identity/v3/services/object-store => generated 93 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:03:34.769891 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb48361f-094c-42a3-8062-5ccb65b62f5c None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:34.835579 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce22cae4-3aa4-43d2-ab83-9219a02e3b16 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:34.870510 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb48361f-094c-42a3-8062-5ccb65b62f5c None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:34.873453 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dc4e02-5e76-468d-b117-b6918c535ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:34.874346 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dc4e02-5e76-468d-b117-b6918c535ec9 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:34.874724 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dc4e02-5e76-468d-b117-b6918c535ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:34.875057 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dc4e02-5e76-468d-b117-b6918c535ec9 None admin] PATH_INFO: `/v3/services/compute` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:34.875777 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dc4e02-5e76-468d-b117-b6918c535ec9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:34.877274 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dc4e02-5e76-468d-b117-b6918c535ec9 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:34.889245 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-c8dc4e02-5e76-468d-b117-b6918c535ec9 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Mar 30 07:03:34.890686 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 505/995] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Mar 30 07:03:34 2022] GET /identity/v3/services/compute => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 07:03:34.897051 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dc4e02-5e76-468d-b117-b6918c535ec9 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:34.916791 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9e8f65-4c38-4341-baba-8ecc935f54c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:34.917514 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e8f65-4c38-4341-baba-8ecc935f54c9 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:34.917797 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e8f65-4c38-4341-baba-8ecc935f54c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:34.918072 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e8f65-4c38-4341-baba-8ecc935f54c9 None admin] PATH_INFO: `/v3/services` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:34.918780 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9e8f65-4c38-4341-baba-8ecc935f54c9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:34.919084 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9e8f65-4c38-4341-baba-8ecc935f54c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:34.920516 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9e8f65-4c38-4341-baba-8ecc935f54c9 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:34.929940 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 491/996] 10.222.0.20 () {56 vars in 1122 bytes} [Wed Mar 30 07:03:34 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:03:34.931005 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9e8f65-4c38-4341-baba-8ecc935f54c9 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:34.993891 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dc4e02-5e76-468d-b117-b6918c535ec9 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:35.025517 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9e8f65-4c38-4341-baba-8ecc935f54c9 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:35.026542 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9ec012-be01-4d89-9964-5df8f750d360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:35.027217 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9ec012-be01-4d89-9964-5df8f750d360 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:35.027588 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9ec012-be01-4d89-9964-5df8f750d360 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:35.027769 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9ec012-be01-4d89-9964-5df8f750d360 None admin] PATH_INFO: `/v3/services` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:35.028556 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9ec012-be01-4d89-9964-5df8f750d360 None admin] RBAC: Adding query filter params (name=compute) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:35.029423 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9ec012-be01-4d89-9964-5df8f750d360 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:35.030242 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9ec012-be01-4d89-9964-5df8f750d360 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:35.035323 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 506/997] 10.222.0.20 () {56 vars in 1112 bytes} [Wed Mar 30 07:03:34 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:35.041095 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9ec012-be01-4d89-9964-5df8f750d360 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:35.061294 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3dbf52-e8a7-4437-84eb-1644164598cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:35.061962 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3dbf52-e8a7-4437-84eb-1644164598cf None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:35.062245 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3dbf52-e8a7-4437-84eb-1644164598cf None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:35.062520 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3dbf52-e8a7-4437-84eb-1644164598cf None admin] PATH_INFO: `/v3/services` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:35.063220 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3dbf52-e8a7-4437-84eb-1644164598cf None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:35.063532 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3dbf52-e8a7-4437-84eb-1644164598cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:35.064934 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3dbf52-e8a7-4437-84eb-1644164598cf None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:35.069711 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 492/998] 10.222.0.20 () {56 vars in 1122 bytes} [Wed Mar 30 07:03:34 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:03:35.075650 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3dbf52-e8a7-4437-84eb-1644164598cf None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:35.139656 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9ec012-be01-4d89-9964-5df8f750d360 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:35.173046 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08d041a-141a-4469-872d-dd5b15a70439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:35.174092 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08d041a-141a-4469-872d-dd5b15a70439 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:35.174209 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3dbf52-e8a7-4437-84eb-1644164598cf None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:35.174680 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08d041a-141a-4469-872d-dd5b15a70439 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:35.175145 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08d041a-141a-4469-872d-dd5b15a70439 None admin] PATH_INFO: `/v3/services` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:35.176111 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08d041a-141a-4469-872d-dd5b15a70439 None admin] RBAC: Adding query filter params (type=compute) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:35.176629 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08d041a-141a-4469-872d-dd5b15a70439 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:35.178091 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08d041a-141a-4469-872d-dd5b15a70439 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:35.183146 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 507/999] 10.222.0.20 () {56 vars in 1112 bytes} [Wed Mar 30 07:03:35 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:03:35.188661 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08d041a-141a-4469-872d-dd5b15a70439 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:35.207330 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a101e1c-0798-4eba-8f44-269c10ddf854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:35.208046 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a101e1c-0798-4eba-8f44-269c10ddf854 None admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:35.208328 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a101e1c-0798-4eba-8f44-269c10ddf854 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:35.208603 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a101e1c-0798-4eba-8f44-269c10ddf854 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:35.209342 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a101e1c-0798-4eba-8f44-269c10ddf854 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:35.210726 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a101e1c-0798-4eba-8f44-269c10ddf854 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:35.228332 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 493/1000] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Mar 30 07:03:35 2022] POST /identity/v3/endpoints => generated 325 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 07:03:35.295656 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08d041a-141a-4469-872d-dd5b15a70439 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:35.339353 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad303db-f55e-4060-a25c-c8274aa11352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:35.340050 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad303db-f55e-4060-a25c-c8274aa11352 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:35.340328 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad303db-f55e-4060-a25c-c8274aa11352 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:35.340595 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad303db-f55e-4060-a25c-c8274aa11352 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:35.341381 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad303db-f55e-4060-a25c-c8274aa11352 None admin] RBAC: Adding query filter params (interface=public, service_id=0d943913b35a4757b1c518e6a2dbce66, region_id=RegionOne) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:35.341684 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad303db-f55e-4060-a25c-c8274aa11352 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:35.343082 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad303db-f55e-4060-a25c-c8274aa11352 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:35.353682 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 508/1001] 10.222.0.20 () {56 vars in 1251 bytes} [Wed Mar 30 07:03:35 2022] GET /identity/v3/endpoints?service_id=0d943913b35a4757b1c518e6a2dbce66&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:03:35.354985 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a101e1c-0798-4eba-8f44-269c10ddf854 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:35.460770 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a101e1c-0798-4eba-8f44-269c10ddf854 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:35.493546 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d950e5e6-3db5-4be9-9432-44b636da0850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:35.494220 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d950e5e6-3db5-4be9-9432-44b636da0850 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:35.494498 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d950e5e6-3db5-4be9-9432-44b636da0850 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:35.494769 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d950e5e6-3db5-4be9-9432-44b636da0850 None admin] PATH_INFO: `/v3/services` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:35.495473 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d950e5e6-3db5-4be9-9432-44b636da0850 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:35.496886 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d950e5e6-3db5-4be9-9432-44b636da0850 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:35.503138 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 494/1002] 10.222.0.20 () {56 vars in 1087 bytes} [Wed Mar 30 07:03:35 2022] GET /identity/v3/services => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:03:36.002091 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6fc191-bbd4-46d6-97e4-fa56750d0f7e None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:36.002623 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6fc191-bbd4-46d6-97e4-fa56750d0f7e None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:36.002623 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6fc191-bbd4-46d6-97e4-fa56750d0f7e None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:36.004464 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 509/1003] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:03:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:03:36.010090 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ebfe59-b94a-4e2b-b0ba-0df7e3b17a8e None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:36.010383 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ebfe59-b94a-4e2b-b0ba-0df7e3b17a8e None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:36.010659 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ebfe59-b94a-4e2b-b0ba-0df7e3b17a8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:36.028339 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-37ebfe59-b94a-4e2b-b0ba-0df7e3b17a8e None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:03:36.029522 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-37ebfe59-b94a-4e2b-b0ba-0df7e3b17a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:03:36.096691 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 495/1004] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:03:36 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 30 07:03:36.119545 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6fc191-bbd4-46d6-97e4-fa56750d0f7e None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:36.222743 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6fc191-bbd4-46d6-97e4-fa56750d0f7e None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:36.256828 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e60688c-6747-4b96-9e73-555931840add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:36.257539 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e60688c-6747-4b96-9e73-555931840add None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:36.257815 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e60688c-6747-4b96-9e73-555931840add None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:36.258102 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e60688c-6747-4b96-9e73-555931840add None admin] PATH_INFO: `/v3/services/image` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:36.258759 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e60688c-6747-4b96-9e73-555931840add None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:36.260210 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e60688c-6747-4b96-9e73-555931840add None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:36.270860 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-6e60688c-6747-4b96-9e73-555931840add None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Mar 30 07:03:36.272297 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 510/1005] 10.222.0.20 () {56 vars in 1105 bytes} [Wed Mar 30 07:03:36 2022] GET /identity/v3/services/image => generated 86 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:03:36.278434 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ebfe59-b94a-4e2b-b0ba-0df7e3b17a8e None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:36.384221 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ebfe59-b94a-4e2b-b0ba-0df7e3b17a8e None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:36.419207 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca36724-3b70-4dea-8884-8835dd60ab4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:36.419893 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca36724-3b70-4dea-8884-8835dd60ab4f None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:36.420174 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca36724-3b70-4dea-8884-8835dd60ab4f None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:36.420450 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca36724-3b70-4dea-8884-8835dd60ab4f None admin] PATH_INFO: `/v3/services` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:36.421160 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca36724-3b70-4dea-8884-8835dd60ab4f None admin] RBAC: Adding query filter params (name=image) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:36.421462 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca36724-3b70-4dea-8884-8835dd60ab4f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:36.422849 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca36724-3b70-4dea-8884-8835dd60ab4f None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:36.428011 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 496/1006] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:03:36 2022] GET /identity/v3/services?name=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:36.434277 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e60688c-6747-4b96-9e73-555931840add None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:36.530579 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e60688c-6747-4b96-9e73-555931840add None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:36.562741 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b50a5e2-4646-4aed-9b85-f03c27b1d598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:36.563409 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b50a5e2-4646-4aed-9b85-f03c27b1d598 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:36.563694 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b50a5e2-4646-4aed-9b85-f03c27b1d598 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:36.564009 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b50a5e2-4646-4aed-9b85-f03c27b1d598 None admin] PATH_INFO: `/v3/services` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:36.564711 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b50a5e2-4646-4aed-9b85-f03c27b1d598 None admin] RBAC: Adding query filter params (type=image) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:36.565011 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b50a5e2-4646-4aed-9b85-f03c27b1d598 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:36.566385 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b50a5e2-4646-4aed-9b85-f03c27b1d598 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:36.579905 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 511/1007] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:03:36 2022] GET /identity/v3/services?type=image => generated 122 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:37.530246 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6bbf79-89bf-4aee-92a3-cab03ec6430d None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:37.530763 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6bbf79-89bf-4aee-92a3-cab03ec6430d None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:37.530763 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6bbf79-89bf-4aee-92a3-cab03ec6430d None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:37.532669 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 497/1008] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:03:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:03:37.537841 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4b2f16-c04e-43aa-9cc6-72dce37d815a None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:37.538255 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4b2f16-c04e-43aa-9cc6-72dce37d815a None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:37.538502 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4b2f16-c04e-43aa-9cc6-72dce37d815a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:37.556094 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-2a4b2f16-c04e-43aa-9cc6-72dce37d815a None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:03:37.557286 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-2a4b2f16-c04e-43aa-9cc6-72dce37d815a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:03:37.624362 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 512/1009] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:03:37 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 30 07:03:37.648030 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6bbf79-89bf-4aee-92a3-cab03ec6430d None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:37.751828 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6bbf79-89bf-4aee-92a3-cab03ec6430d None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:37.786847 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2695a017-4036-49ab-bf3b-06fa103fad20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:37.787561 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2695a017-4036-49ab-bf3b-06fa103fad20 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:37.787844 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2695a017-4036-49ab-bf3b-06fa103fad20 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:37.788144 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2695a017-4036-49ab-bf3b-06fa103fad20 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:37.789422 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2695a017-4036-49ab-bf3b-06fa103fad20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:37.790952 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2695a017-4036-49ab-bf3b-06fa103fad20 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:37.792846 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 498/1010] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:03:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:37.798575 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4b2f16-c04e-43aa-9cc6-72dce37d815a None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:37.829007 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa3044-0a4c-415b-ab9b-9901078375e5 None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:37.829281 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa3044-0a4c-415b-ab9b-9901078375e5 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:37.829551 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa3044-0a4c-415b-ab9b-9901078375e5 None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:37.831441 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 499/1011] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:03:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 30 07:03:37.835976 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d1625-7465-47ac-a9fa-0cdc025acd31 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:37.836464 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d1625-7465-47ac-a9fa-0cdc025acd31 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:37.836770 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d1625-7465-47ac-a9fa-0cdc025acd31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:37.853098 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-f75d1625-7465-47ac-a9fa-0cdc025acd31 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:03:37.854260 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-f75d1625-7465-47ac-a9fa-0cdc025acd31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:03:37.897465 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4b2f16-c04e-43aa-9cc6-72dce37d815a None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:37.917808 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 500/1012] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:03:37 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 30 07:03:37.930809 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0d6385-7d90-4e26-a582-0b3961cdf2a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:37.931472 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0d6385-7d90-4e26-a582-0b3961cdf2a0 None admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:37.931751 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0d6385-7d90-4e26-a582-0b3961cdf2a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:37.932065 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0d6385-7d90-4e26-a582-0b3961cdf2a0 None admin] PATH_INFO: `/v3/projects` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:37.932768 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0d6385-7d90-4e26-a582-0b3961cdf2a0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:37.934183 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0d6385-7d90-4e26-a582-0b3961cdf2a0 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:37.941185 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75d1625-7465-47ac-a9fa-0cdc025acd31 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:37.960521 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 513/1013] 10.222.0.20 () {60 vars in 1141 bytes} [Wed Mar 30 07:03:37 2022] POST /identity/v3/projects => generated 311 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:03:38.055035 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75d1625-7465-47ac-a9fa-0cdc025acd31 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:38.092009 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb090081-f4ba-4739-bd4e-2e1b6ea2972a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:38.092827 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb090081-f4ba-4739-bd4e-2e1b6ea2972a None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:38.093106 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb090081-f4ba-4739-bd4e-2e1b6ea2972a None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:38.093379 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb090081-f4ba-4739-bd4e-2e1b6ea2972a None admin] PATH_INFO: `/v3/services/compute` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:38.094042 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb090081-f4ba-4739-bd4e-2e1b6ea2972a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:38.095437 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb090081-f4ba-4739-bd4e-2e1b6ea2972a None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:38.107329 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-bb090081-f4ba-4739-bd4e-2e1b6ea2972a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Mar 30 07:03:38.108858 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 501/1014] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Mar 30 07:03:37 2022] GET /identity/v3/services/compute => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 07:03:38.115136 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0d6385-7d90-4e26-a582-0b3961cdf2a0 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:38.218350 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0d6385-7d90-4e26-a582-0b3961cdf2a0 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:38.251232 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91b9bb3-f69f-421f-94bc-aaab9649ce8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:38.251935 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91b9bb3-f69f-421f-94bc-aaab9649ce8b None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:38.252217 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91b9bb3-f69f-421f-94bc-aaab9649ce8b None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:38.252493 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91b9bb3-f69f-421f-94bc-aaab9649ce8b None admin] PATH_INFO: `/v3/services` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:38.253199 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91b9bb3-f69f-421f-94bc-aaab9649ce8b None admin] RBAC: Adding query filter params (name=compute) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:38.253502 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91b9bb3-f69f-421f-94bc-aaab9649ce8b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:38.254893 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91b9bb3-f69f-421f-94bc-aaab9649ce8b None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:38.259850 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 514/1015] 10.222.0.20 () {56 vars in 1112 bytes} [Wed Mar 30 07:03:38 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:38.265404 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb090081-f4ba-4739-bd4e-2e1b6ea2972a None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:38.367870 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb090081-f4ba-4739-bd4e-2e1b6ea2972a None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:38.402656 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ad24b6-24c6-4d92-9e57-bfa039bcf9b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:38.403325 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ad24b6-24c6-4d92-9e57-bfa039bcf9b4 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:38.403604 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ad24b6-24c6-4d92-9e57-bfa039bcf9b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:38.403915 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ad24b6-24c6-4d92-9e57-bfa039bcf9b4 None admin] PATH_INFO: `/v3/services` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:38.404626 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ad24b6-24c6-4d92-9e57-bfa039bcf9b4 None admin] RBAC: Adding query filter params (type=compute) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:38.404930 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ad24b6-24c6-4d92-9e57-bfa039bcf9b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:38.406306 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ad24b6-24c6-4d92-9e57-bfa039bcf9b4 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:38.411354 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 502/1016] 10.222.0.20 () {56 vars in 1112 bytes} [Wed Mar 30 07:03:38 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:38.418106 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91b9bb3-f69f-421f-94bc-aaab9649ce8b None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:38.527545 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91b9bb3-f69f-421f-94bc-aaab9649ce8b None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:38.562432 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b9b8b0-6052-449f-9fa7-bb0dc120a595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:38.563089 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b9b8b0-6052-449f-9fa7-bb0dc120a595 None admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:38.563353 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b9b8b0-6052-449f-9fa7-bb0dc120a595 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:38.563633 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b9b8b0-6052-449f-9fa7-bb0dc120a595 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:38.564416 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b9b8b0-6052-449f-9fa7-bb0dc120a595 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:38.565782 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b9b8b0-6052-449f-9fa7-bb0dc120a595 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:38.591849 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 515/1017] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Mar 30 07:03:38 2022] POST /identity/v3/endpoints => generated 334 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:03:38.857792 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9053e811-1219-4d92-b227-f377ed1afc68 None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:38.858330 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9053e811-1219-4d92-b227-f377ed1afc68 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:38.858330 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9053e811-1219-4d92-b227-f377ed1afc68 None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:38.860673 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 503/1018] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:03:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:03:38.865710 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51b659e-03eb-4b60-b6b2-ce5943bc37a9 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:38.865990 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51b659e-03eb-4b60-b6b2-ce5943bc37a9 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:38.866259 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51b659e-03eb-4b60-b6b2-ce5943bc37a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:38.883983 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-c51b659e-03eb-4b60-b6b2-ce5943bc37a9 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:03:38.885583 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-c51b659e-03eb-4b60-b6b2-ce5943bc37a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:03:38.957875 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 516/1019] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:03:38 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 30 07:03:38.981230 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9053e811-1219-4d92-b227-f377ed1afc68 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:39.082287 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9053e811-1219-4d92-b227-f377ed1afc68 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:39.115733 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6978ab9a-4821-4332-bb94-660e98ff3f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:39.116345 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6978ab9a-4821-4332-bb94-660e98ff3f1f None admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:39.116621 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6978ab9a-4821-4332-bb94-660e98ff3f1f None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:39.116895 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6978ab9a-4821-4332-bb94-660e98ff3f1f None admin] PATH_INFO: `/v3/services` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:39.117705 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6978ab9a-4821-4332-bb94-660e98ff3f1f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:39.119577 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6978ab9a-4821-4332-bb94-660e98ff3f1f None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:39.139883 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 504/1020] 10.222.0.20 () {60 vars in 1141 bytes} [Wed Mar 30 07:03:38 2022] POST /identity/v3/services => generated 242 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:03:40.299857 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc13c2b-53af-4129-a0c6-7bc422c9bcd7 None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:40.300398 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc13c2b-53af-4129-a0c6-7bc422c9bcd7 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:40.300398 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc13c2b-53af-4129-a0c6-7bc422c9bcd7 None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:40.302372 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 517/1021] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:03:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:03:40.307847 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa88d086-2740-4c02-89e1-bd0661d06450 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:40.308297 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa88d086-2740-4c02-89e1-bd0661d06450 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:40.308376 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa88d086-2740-4c02-89e1-bd0661d06450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:40.325357 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-aa88d086-2740-4c02-89e1-bd0661d06450 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:03:40.326505 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-aa88d086-2740-4c02-89e1-bd0661d06450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:03:40.414912 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 505/1022] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:03:40 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 30 07:03:40.439554 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc13c2b-53af-4129-a0c6-7bc422c9bcd7 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:40.546469 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc13c2b-53af-4129-a0c6-7bc422c9bcd7 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:40.580954 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fccc98-0f59-4759-b226-8c3d967497d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:40.581752 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fccc98-0f59-4759-b226-8c3d967497d6 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:40.582027 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fccc98-0f59-4759-b226-8c3d967497d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:40.582292 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fccc98-0f59-4759-b226-8c3d967497d6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:40.583442 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fccc98-0f59-4759-b226-8c3d967497d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:40.584905 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fccc98-0f59-4759-b226-8c3d967497d6 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:40.586708 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 518/1023] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:03:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:40.592429 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa88d086-2740-4c02-89e1-bd0661d06450 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:40.694138 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa88d086-2740-4c02-89e1-bd0661d06450 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:40.727124 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b50def-3be7-4029-9811-9a45d03c9c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:40.727789 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b50def-3be7-4029-9811-9a45d03c9c2d None admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:40.728090 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b50def-3be7-4029-9811-9a45d03c9c2d None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:40.728355 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b50def-3be7-4029-9811-9a45d03c9c2d None admin] PATH_INFO: `/v3/users` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:40.729069 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b50def-3be7-4029-9811-9a45d03c9c2d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:40.730500 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b50def-3be7-4029-9811-9a45d03c9c2d None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:40.752107 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 506/1024] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Mar 30 07:03:40 2022] POST /identity/v3/users => generated 285 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:03:40.983347 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b3fc97-683b-4682-ad63-52b95adf4617 None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:40.983712 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b3fc97-683b-4682-ad63-52b95adf4617 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:40.983975 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b3fc97-683b-4682-ad63-52b95adf4617 None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:40.986122 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 519/1025] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:03:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:03:40.991465 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8d58f3-f72a-40d9-938c-3c2ed5cd8536 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:40.991754 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8d58f3-f72a-40d9-938c-3c2ed5cd8536 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:40.992102 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8d58f3-f72a-40d9-938c-3c2ed5cd8536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:41.009980 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-2b8d58f3-f72a-40d9-938c-3c2ed5cd8536 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:03:41.011192 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-2b8d58f3-f72a-40d9-938c-3c2ed5cd8536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:03:41.079924 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 507/1026] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:03:40 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 30 07:03:41.104175 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b3fc97-683b-4682-ad63-52b95adf4617 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:41.209518 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b3fc97-683b-4682-ad63-52b95adf4617 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:41.245446 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da390b94-290c-4b1b-869a-433b9796b6da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:41.246199 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da390b94-290c-4b1b-869a-433b9796b6da None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:41.246481 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da390b94-290c-4b1b-869a-433b9796b6da None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:41.246757 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da390b94-290c-4b1b-869a-433b9796b6da None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:41.257200 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da390b94-290c-4b1b-869a-433b9796b6da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 07:03:41.264730 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-da390b94-290c-4b1b-869a-433b9796b6da None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Mar 30 07:03:41.266127 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 520/1027] 10.222.0.20 () {56 vars in 1120 bytes} [Wed Mar 30 07:03:41 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:03:41.272071 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8d58f3-f72a-40d9-938c-3c2ed5cd8536 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:41.373356 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8d58f3-f72a-40d9-938c-3c2ed5cd8536 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:41.407674 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e9cdd9-178f-43a8-ade5-ee0389620593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:41.408371 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e9cdd9-178f-43a8-ade5-ee0389620593 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:41.408651 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e9cdd9-178f-43a8-ade5-ee0389620593 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:41.408930 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e9cdd9-178f-43a8-ade5-ee0389620593 None admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:41.409674 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e9cdd9-178f-43a8-ade5-ee0389620593 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:41.409976 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e9cdd9-178f-43a8-ade5-ee0389620593 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:41.411345 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e9cdd9-178f-43a8-ade5-ee0389620593 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:41.419423 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 508/1028] 10.222.0.20 () {56 vars in 1115 bytes} [Wed Mar 30 07:03:41 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:41.424922 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da390b94-290c-4b1b-869a-433b9796b6da None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:41.425448 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad7ee0-b1e3-45a6-84e5-ba282ac42c5f None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:41.425751 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad7ee0-b1e3-45a6-84e5-ba282ac42c5f None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:41.426022 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad7ee0-b1e3-45a6-84e5-ba282ac42c5f None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:41.427730 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 509/1029] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:03:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:03:41.432807 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eb3edf-56e1-4100-92f2-33ad76340f7d None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:41.433093 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eb3edf-56e1-4100-92f2-33ad76340f7d None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:41.433363 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eb3edf-56e1-4100-92f2-33ad76340f7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:41.450226 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-d7eb3edf-56e1-4100-92f2-33ad76340f7d None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:03:41.451392 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-d7eb3edf-56e1-4100-92f2-33ad76340f7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:03:41.515888 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 510/1030] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:03:41 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 30 07:03:41.525387 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da390b94-290c-4b1b-869a-433b9796b6da None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:41.538404 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eb3edf-56e1-4100-92f2-33ad76340f7d None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:41.557909 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e419e65d-bb38-43c2-88f0-279766ea82c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:41.558770 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e419e65d-bb38-43c2-88f0-279766ea82c9 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:41.559052 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e419e65d-bb38-43c2-88f0-279766ea82c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:41.559326 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e419e65d-bb38-43c2-88f0-279766ea82c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:41.569754 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e419e65d-bb38-43c2-88f0-279766ea82c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:41.571493 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e419e65d-bb38-43c2-88f0-279766ea82c9 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:41.588055 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-e419e65d-bb38-43c2-88f0-279766ea82c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 07:03:41.589460 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 521/1031] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:03:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:03:41.594880 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e419e65d-bb38-43c2-88f0-279766ea82c9 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:41.634390 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eb3edf-56e1-4100-92f2-33ad76340f7d None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:41.675898 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e992f800-ab10-4f86-86bd-c6b09e20bc05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:41.676698 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e992f800-ab10-4f86-86bd-c6b09e20bc05 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:41.676975 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e992f800-ab10-4f86-86bd-c6b09e20bc05 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:41.677244 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e992f800-ab10-4f86-86bd-c6b09e20bc05 None admin] PATH_INFO: `/v3/services/image` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:41.677897 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e992f800-ab10-4f86-86bd-c6b09e20bc05 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:41.679383 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e992f800-ab10-4f86-86bd-c6b09e20bc05 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:41.690433 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-e992f800-ab10-4f86-86bd-c6b09e20bc05 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Mar 30 07:03:41.691646 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 511/1032] 10.222.0.20 () {56 vars in 1105 bytes} [Wed Mar 30 07:03:41 2022] GET /identity/v3/services/image => generated 86 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 07:03:41.697832 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e992f800-ab10-4f86-86bd-c6b09e20bc05 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:41.702663 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e419e65d-bb38-43c2-88f0-279766ea82c9 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:41.736201 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f02df0-35ac-453d-9478-bc2ca85c105b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:41.736865 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f02df0-35ac-453d-9478-bc2ca85c105b None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:41.737141 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f02df0-35ac-453d-9478-bc2ca85c105b None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:41.737408 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f02df0-35ac-453d-9478-bc2ca85c105b None admin] PATH_INFO: `/v3/domains` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:41.738119 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f02df0-35ac-453d-9478-bc2ca85c105b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:41.738420 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f02df0-35ac-453d-9478-bc2ca85c105b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:41.739865 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f02df0-35ac-453d-9478-bc2ca85c105b None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:41.751796 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 522/1033] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Mar 30 07:03:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:03:41.757181 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f02df0-35ac-453d-9478-bc2ca85c105b None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:41.807551 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e992f800-ab10-4f86-86bd-c6b09e20bc05 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:41.841831 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de4c74f-8c8c-4182-aff9-870c6d9b0354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:41.843269 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de4c74f-8c8c-4182-aff9-870c6d9b0354 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:41.843941 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de4c74f-8c8c-4182-aff9-870c6d9b0354 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:41.844457 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de4c74f-8c8c-4182-aff9-870c6d9b0354 None admin] PATH_INFO: `/v3/services` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:41.845478 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de4c74f-8c8c-4182-aff9-870c6d9b0354 None admin] RBAC: Adding query filter params (name=image) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:41.846239 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de4c74f-8c8c-4182-aff9-870c6d9b0354 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:41.848228 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de4c74f-8c8c-4182-aff9-870c6d9b0354 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:41.853471 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 512/1034] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:03:41 2022] GET /identity/v3/services?name=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:03:41.856902 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f02df0-35ac-453d-9478-bc2ca85c105b None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:41.858909 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de4c74f-8c8c-4182-aff9-870c6d9b0354 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:41.892765 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55b853b-9257-49b5-9ab8-f87641a61b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:41.893587 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55b853b-9257-49b5-9ab8-f87641a61b78 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:41.893869 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55b853b-9257-49b5-9ab8-f87641a61b78 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:41.894124 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55b853b-9257-49b5-9ab8-f87641a61b78 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:41.901698 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55b853b-9257-49b5-9ab8-f87641a61b78 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:41.903162 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55b853b-9257-49b5-9ab8-f87641a61b78 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:41.917250 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-b55b853b-9257-49b5-9ab8-f87641a61b78 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 30 07:03:41.918489 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 523/1035] 10.222.0.20 () {56 vars in 1093 bytes} [Wed Mar 30 07:03:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 07:03:41.924395 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55b853b-9257-49b5-9ab8-f87641a61b78 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:41.967887 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de4c74f-8c8c-4182-aff9-870c6d9b0354 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:42.005349 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21149f97-b05c-409c-bc7e-289daf7915d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:42.006319 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21149f97-b05c-409c-bc7e-289daf7915d8 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:42.006785 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21149f97-b05c-409c-bc7e-289daf7915d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:42.007118 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21149f97-b05c-409c-bc7e-289daf7915d8 None admin] PATH_INFO: `/v3/services` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:42.008027 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21149f97-b05c-409c-bc7e-289daf7915d8 None admin] RBAC: Adding query filter params (type=image) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:42.008341 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21149f97-b05c-409c-bc7e-289daf7915d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:42.009691 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21149f97-b05c-409c-bc7e-289daf7915d8 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:42.020314 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 513/1036] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:03:41 2022] GET /identity/v3/services?type=image => generated 350 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:42.021700 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21149f97-b05c-409c-bc7e-289daf7915d8 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:42.023674 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55b853b-9257-49b5-9ab8-f87641a61b78 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:42.059698 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0f8f23-4a42-4055-bbf1-65138acafc67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:42.060408 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f8f23-4a42-4055-bbf1-65138acafc67 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:42.060691 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f8f23-4a42-4055-bbf1-65138acafc67 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:42.060961 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f8f23-4a42-4055-bbf1-65138acafc67 None admin] PATH_INFO: `/v3/users` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:42.061797 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0f8f23-4a42-4055-bbf1-65138acafc67 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:42.062105 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0f8f23-4a42-4055-bbf1-65138acafc67 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:42.063539 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0f8f23-4a42-4055-bbf1-65138acafc67 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:42.080520 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 524/1037] 10.222.0.20 () {56 vars in 1133 bytes} [Wed Mar 30 07:03:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:03:42.086249 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0f8f23-4a42-4055-bbf1-65138acafc67 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:42.125504 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21149f97-b05c-409c-bc7e-289daf7915d8 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:42.157520 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e35c68-06ec-4899-be15-3e6da6e976c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:42.158180 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e35c68-06ec-4899-be15-3e6da6e976c0 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:42.158458 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e35c68-06ec-4899-be15-3e6da6e976c0 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:42.158726 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e35c68-06ec-4899-be15-3e6da6e976c0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:42.159506 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e35c68-06ec-4899-be15-3e6da6e976c0 None admin] RBAC: Adding query filter params (interface=public, service_id=f5ce2a0d24614a80abf8947af89cad71, region_id=RegionOne) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:42.159837 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e35c68-06ec-4899-be15-3e6da6e976c0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:42.161201 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e35c68-06ec-4899-be15-3e6da6e976c0 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:42.166278 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 514/1038] 10.222.0.20 () {56 vars in 1251 bytes} [Wed Mar 30 07:03:42 2022] GET /identity/v3/endpoints?service_id=f5ce2a0d24614a80abf8947af89cad71&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:03:42.171871 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e35c68-06ec-4899-be15-3e6da6e976c0 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:42.187495 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0f8f23-4a42-4055-bbf1-65138acafc67 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:42.228790 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d134fa0d-bcac-4677-ba6b-13776d33a2c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:42.229452 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d134fa0d-bcac-4677-ba6b-13776d33a2c7 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:42.229732 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d134fa0d-bcac-4677-ba6b-13776d33a2c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:42.230004 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d134fa0d-bcac-4677-ba6b-13776d33a2c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:42.273293 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e35c68-06ec-4899-be15-3e6da6e976c0 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:42.301665 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d134fa0d-bcac-4677-ba6b-13776d33a2c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:42.303141 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d134fa0d-bcac-4677-ba6b-13776d33a2c7 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:42.306779 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135478d0-a928-4a2d-bcdd-fee0800d9cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:42.307442 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135478d0-a928-4a2d-bcdd-fee0800d9cc9 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:42.307715 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135478d0-a928-4a2d-bcdd-fee0800d9cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:42.308011 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135478d0-a928-4a2d-bcdd-fee0800d9cc9 None admin] PATH_INFO: `/v3/services` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:42.308711 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135478d0-a928-4a2d-bcdd-fee0800d9cc9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:42.310099 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135478d0-a928-4a2d-bcdd-fee0800d9cc9 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:42.316675 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 515/1039] 10.222.0.20 () {56 vars in 1087 bytes} [Wed Mar 30 07:03:42 2022] GET /identity/v3/services => generated 1957 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:03:42.417731 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 525/1040] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Mar 30 07:03:42 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 30 07:03:42.424038 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135478d0-a928-4a2d-bcdd-fee0800d9cc9 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:42.533950 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135478d0-a928-4a2d-bcdd-fee0800d9cc9 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:42.566236 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061a19e6-a757-4736-85d0-955d5cd35fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:42.566955 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061a19e6-a757-4736-85d0-955d5cd35fa5 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:42.567233 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061a19e6-a757-4736-85d0-955d5cd35fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:42.567502 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061a19e6-a757-4736-85d0-955d5cd35fa5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:42.580770 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061a19e6-a757-4736-85d0-955d5cd35fa5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:42.582240 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061a19e6-a757-4736-85d0-955d5cd35fa5 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:42.599743 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-061a19e6-a757-4736-85d0-955d5cd35fa5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 07:03:42.601230 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 516/1041] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:03:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:03:42.607559 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d134fa0d-bcac-4677-ba6b-13776d33a2c7 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:42.708460 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d134fa0d-bcac-4677-ba6b-13776d33a2c7 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:42.743840 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3fea22-976a-4d17-9830-4d9ba9af3e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:42.744573 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3fea22-976a-4d17-9830-4d9ba9af3e25 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:42.744855 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3fea22-976a-4d17-9830-4d9ba9af3e25 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:42.745131 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3fea22-976a-4d17-9830-4d9ba9af3e25 None admin] PATH_INFO: `/v3/domains` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:42.745843 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3fea22-976a-4d17-9830-4d9ba9af3e25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:42.746146 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3fea22-976a-4d17-9830-4d9ba9af3e25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:42.747525 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3fea22-976a-4d17-9830-4d9ba9af3e25 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:42.759507 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 526/1042] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Mar 30 07:03:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:42.765548 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061a19e6-a757-4736-85d0-955d5cd35fa5 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:42.868427 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061a19e6-a757-4736-85d0-955d5cd35fa5 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:42.902973 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2980f808-aad4-481c-8810-ed6c168c6f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:42.903774 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2980f808-aad4-481c-8810-ed6c168c6f5a None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:42.904098 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2980f808-aad4-481c-8810-ed6c168c6f5a None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:42.904369 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2980f808-aad4-481c-8810-ed6c168c6f5a None admin] PATH_INFO: `/v3/projects/service` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:42.911345 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2980f808-aad4-481c-8810-ed6c168c6f5a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:42.912838 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2980f808-aad4-481c-8810-ed6c168c6f5a None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:42.928184 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-2980f808-aad4-481c-8810-ed6c168c6f5a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 30 07:03:42.929652 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 517/1043] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Mar 30 07:03:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:03:42.935462 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3fea22-976a-4d17-9830-4d9ba9af3e25 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:43.035302 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3fea22-976a-4d17-9830-4d9ba9af3e25 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:43.067887 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157514e7-cbf8-4649-b97d-77ad63d47d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:43.068556 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157514e7-cbf8-4649-b97d-77ad63d47d25 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:43.068833 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157514e7-cbf8-4649-b97d-77ad63d47d25 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:43.069104 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157514e7-cbf8-4649-b97d-77ad63d47d25 None admin] PATH_INFO: `/v3/projects` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:43.069887 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157514e7-cbf8-4649-b97d-77ad63d47d25 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:43.070195 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157514e7-cbf8-4649-b97d-77ad63d47d25 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:43.071642 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157514e7-cbf8-4649-b97d-77ad63d47d25 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:43.083640 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 527/1044] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Mar 30 07:03:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:43.089599 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2980f808-aad4-481c-8810-ed6c168c6f5a None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:43.133561 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b183b413-940f-46fc-a0da-0fa6b3e205d8 None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:43.133759 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b183b413-940f-46fc-a0da-0fa6b3e205d8 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:43.134026 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b183b413-940f-46fc-a0da-0fa6b3e205d8 None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:43.135998 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 528/1045] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:03:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 30 07:03:43.141567 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84009005-6207-4a09-a41d-8602fe61c509 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:43.141855 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84009005-6207-4a09-a41d-8602fe61c509 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:43.142108 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84009005-6207-4a09-a41d-8602fe61c509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:43.158958 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-84009005-6207-4a09-a41d-8602fe61c509 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:03:43.160152 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-84009005-6207-4a09-a41d-8602fe61c509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:03:43.191064 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2980f808-aad4-481c-8810-ed6c168c6f5a None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:43.231268 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff17c92-aed8-4bcc-90b0-7cc6a6fb29c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:43.232708 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff17c92-aed8-4bcc-90b0-7cc6a6fb29c9 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:43.232829 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 529/1046] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:03:43 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 30 07:03:43.232912 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff17c92-aed8-4bcc-90b0-7cc6a6fb29c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:43.233381 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff17c92-aed8-4bcc-90b0-7cc6a6fb29c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:43.235630 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff17c92-aed8-4bcc-90b0-7cc6a6fb29c9 None admin] RBAC: Adding query filter params (role.id=14814d9e7d1c442eb709661619f37b61, scope.project.id=7e4eda4c5cd84307b36a5b48642e816f, user.id=72b398c5ed14484d8b7a51fee900597b) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:43.235630 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff17c92-aed8-4bcc-90b0-7cc6a6fb29c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:43.236420 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff17c92-aed8-4bcc-90b0-7cc6a6fb29c9 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:43.244911 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 518/1047] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Mar 30 07:03:43 2022] GET /identity/v3/role_assignments?user.id=72b398c5ed14484d8b7a51fee900597b&scope.project.id=7e4eda4c5cd84307b36a5b48642e816f&role.id=14814d9e7d1c442eb709661619f37b61 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:43.257990 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84009005-6207-4a09-a41d-8602fe61c509 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:43.365153 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84009005-6207-4a09-a41d-8602fe61c509 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:43.403124 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac74437-54de-4344-a572-f830f6748b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:43.403850 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac74437-54de-4344-a572-f830f6748b1a None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:43.404152 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac74437-54de-4344-a572-f830f6748b1a None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:43.404402 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac74437-54de-4344-a572-f830f6748b1a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:43.417239 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac74437-54de-4344-a572-f830f6748b1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 07:03:43.422941 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-bac74437-54de-4344-a572-f830f6748b1a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 30 07:03:43.424394 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 530/1048] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Mar 30 07:03:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:03:43.431012 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff17c92-aed8-4bcc-90b0-7cc6a6fb29c9 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:43.535272 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff17c92-aed8-4bcc-90b0-7cc6a6fb29c9 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:43.571656 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2285e248-563c-4d20-945f-52ca323a6287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:43.572383 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2285e248-563c-4d20-945f-52ca323a6287 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:43.572635 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2285e248-563c-4d20-945f-52ca323a6287 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:43.572912 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2285e248-563c-4d20-945f-52ca323a6287 None admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:43.573685 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2285e248-563c-4d20-945f-52ca323a6287 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:43.573946 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2285e248-563c-4d20-945f-52ca323a6287 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:43.575324 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2285e248-563c-4d20-945f-52ca323a6287 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:43.583904 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 519/1049] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Mar 30 07:03:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:43.589975 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac74437-54de-4344-a572-f830f6748b1a None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:43.690720 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac74437-54de-4344-a572-f830f6748b1a None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:43.724018 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9725b522-7772-436f-aa58-2818a33005c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:43.724907 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9725b522-7772-436f-aa58-2818a33005c8 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:43.725184 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9725b522-7772-436f-aa58-2818a33005c8 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:43.725454 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9725b522-7772-436f-aa58-2818a33005c8 None admin] PATH_INFO: `/v3/users/8027eb1d1170442cb3f289eace573bd9` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:43.739644 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9725b522-7772-436f-aa58-2818a33005c8 None admin] RBAC: Authorizing `identity:get_user(user_id=8027eb1d1170442cb3f289eace573bd9)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:43.741175 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9725b522-7772-436f-aa58-2818a33005c8 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:43.743249 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 531/1050] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Mar 30 07:03:43 2022] GET /identity/v3/users/8027eb1d1170442cb3f289eace573bd9 => generated 285 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:43.749032 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2285e248-563c-4d20-945f-52ca323a6287 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:43.842747 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2285e248-563c-4d20-945f-52ca323a6287 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:43.875108 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8a951e-3e98-45f1-9397-a99684d3272b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:43.875618 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8a951e-3e98-45f1-9397-a99684d3272b None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:43.875968 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8a951e-3e98-45f1-9397-a99684d3272b None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:43.876265 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8a951e-3e98-45f1-9397-a99684d3272b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:43.943015 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8a951e-3e98-45f1-9397-a99684d3272b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:43.944437 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8a951e-3e98-45f1-9397-a99684d3272b None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:44.046928 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 520/1051] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Mar 30 07:03:43 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Mar 30 07:03:44.048170 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9725b522-7772-436f-aa58-2818a33005c8 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:44.149094 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9725b522-7772-436f-aa58-2818a33005c8 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:44.183462 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905b0857-0957-41a7-b590-1527e61c9dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:44.184364 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b0857-0957-41a7-b590-1527e61c9dfe None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:44.184648 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b0857-0957-41a7-b590-1527e61c9dfe None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:44.184922 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b0857-0957-41a7-b590-1527e61c9dfe None admin] PATH_INFO: `/v3/projects/060de596bda24515a5df064dd77052f0` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:44.186112 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905b0857-0957-41a7-b590-1527e61c9dfe None admin] RBAC: Authorizing `identity:get_project(project_id=060de596bda24515a5df064dd77052f0)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:44.187552 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905b0857-0957-41a7-b590-1527e61c9dfe None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:44.189517 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 532/1052] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Mar 30 07:03:44 2022] GET /identity/v3/projects/060de596bda24515a5df064dd77052f0 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:44.195748 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8a951e-3e98-45f1-9397-a99684d3272b None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:44.300747 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8a951e-3e98-45f1-9397-a99684d3272b None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:44.335584 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142e4b39-0b3d-453a-984f-a68ddac087fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:44.336337 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142e4b39-0b3d-453a-984f-a68ddac087fc None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:44.336574 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142e4b39-0b3d-453a-984f-a68ddac087fc None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:44.336862 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142e4b39-0b3d-453a-984f-a68ddac087fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:44.337708 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142e4b39-0b3d-453a-984f-a68ddac087fc None admin] RBAC: Adding query filter params (role.id=1c39b9ab8cfd4c0ea71845831920a845, scope.project.id=060de596bda24515a5df064dd77052f0, user.id=8027eb1d1170442cb3f289eace573bd9) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:44.338176 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142e4b39-0b3d-453a-984f-a68ddac087fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:44.339666 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142e4b39-0b3d-453a-984f-a68ddac087fc None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:44.346425 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 521/1053] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Mar 30 07:03:44 2022] GET /identity/v3/role_assignments?user.id=8027eb1d1170442cb3f289eace573bd9&scope.project.id=060de596bda24515a5df064dd77052f0&role.id=1c39b9ab8cfd4c0ea71845831920a845 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:44.643843 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd1fa3d-8413-4b93-a361-32f1fefcec1a None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:44.644188 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd1fa3d-8413-4b93-a361-32f1fefcec1a None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:44.644485 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd1fa3d-8413-4b93-a361-32f1fefcec1a None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:44.646320 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 533/1054] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:03:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:03:44.651796 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04e43fc-f790-4375-9c8a-ebe3da14acc5 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:44.652285 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04e43fc-f790-4375-9c8a-ebe3da14acc5 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:44.652361 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04e43fc-f790-4375-9c8a-ebe3da14acc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:44.670381 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-d04e43fc-f790-4375-9c8a-ebe3da14acc5 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:03:44.671568 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-d04e43fc-f790-4375-9c8a-ebe3da14acc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:03:44.739993 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 522/1055] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:03:44 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 30 07:03:44.762415 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd1fa3d-8413-4b93-a361-32f1fefcec1a None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:44.862367 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd1fa3d-8413-4b93-a361-32f1fefcec1a None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:44.894448 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94d941b-7428-42d4-90e2-bcc9859aacb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:44.895172 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d941b-7428-42d4-90e2-bcc9859aacb3 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:44.895445 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d941b-7428-42d4-90e2-bcc9859aacb3 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:44.895714 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d941b-7428-42d4-90e2-bcc9859aacb3 None admin] PATH_INFO: `/v3/services/image` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:44.896386 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94d941b-7428-42d4-90e2-bcc9859aacb3 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:44.897758 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94d941b-7428-42d4-90e2-bcc9859aacb3 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:44.908274 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-d94d941b-7428-42d4-90e2-bcc9859aacb3 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Mar 30 07:03:44.909591 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 534/1056] 10.222.0.20 () {56 vars in 1105 bytes} [Wed Mar 30 07:03:44 2022] GET /identity/v3/services/image => generated 86 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:03:44.915794 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04e43fc-f790-4375-9c8a-ebe3da14acc5 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:45.015856 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04e43fc-f790-4375-9c8a-ebe3da14acc5 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:45.050887 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a07ab68-f210-4e6b-af36-7950899d834b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:45.051547 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a07ab68-f210-4e6b-af36-7950899d834b None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:45.051831 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a07ab68-f210-4e6b-af36-7950899d834b None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:45.052121 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a07ab68-f210-4e6b-af36-7950899d834b None admin] PATH_INFO: `/v3/services` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:45.052859 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a07ab68-f210-4e6b-af36-7950899d834b None admin] RBAC: Adding query filter params (name=image) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:45.053151 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a07ab68-f210-4e6b-af36-7950899d834b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:45.054525 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a07ab68-f210-4e6b-af36-7950899d834b None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:45.059637 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 523/1057] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:03:44 2022] GET /identity/v3/services?name=image => generated 122 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:45.065399 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94d941b-7428-42d4-90e2-bcc9859aacb3 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:45.169909 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94d941b-7428-42d4-90e2-bcc9859aacb3 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:45.206517 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6eb58f-5afd-4245-aa02-8dee021fd969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:45.207060 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6eb58f-5afd-4245-aa02-8dee021fd969 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:45.207439 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6eb58f-5afd-4245-aa02-8dee021fd969 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:45.207624 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6eb58f-5afd-4245-aa02-8dee021fd969 None admin] PATH_INFO: `/v3/services` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:45.208441 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6eb58f-5afd-4245-aa02-8dee021fd969 None admin] RBAC: Adding query filter params (type=image) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:45.208671 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6eb58f-5afd-4245-aa02-8dee021fd969 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:45.210052 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6eb58f-5afd-4245-aa02-8dee021fd969 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:45.215847 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 535/1058] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:03:45 2022] GET /identity/v3/services?type=image => generated 350 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:45.221445 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a07ab68-f210-4e6b-af36-7950899d834b None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:45.322203 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a07ab68-f210-4e6b-af36-7950899d834b None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:45.357107 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1227e8c-acb9-4b2a-9deb-d92205ed6064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:45.358113 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1227e8c-acb9-4b2a-9deb-d92205ed6064 None admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:45.358583 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1227e8c-acb9-4b2a-9deb-d92205ed6064 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:45.359033 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1227e8c-acb9-4b2a-9deb-d92205ed6064 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:45.360037 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1227e8c-acb9-4b2a-9deb-d92205ed6064 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:45.361953 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1227e8c-acb9-4b2a-9deb-d92205ed6064 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:45.387712 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 524/1059] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Mar 30 07:03:45 2022] POST /identity/v3/endpoints => generated 327 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:03:45.508123 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1614def2-12f5-4721-afd7-fe00303c1f56 None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:45.508310 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1614def2-12f5-4721-afd7-fe00303c1f56 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:45.508575 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1614def2-12f5-4721-afd7-fe00303c1f56 None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:45.510383 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 536/1060] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:03:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:03:45.516746 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c4decd-b5a8-451c-962c-b174d12e3931 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:45.517039 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c4decd-b5a8-451c-962c-b174d12e3931 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:45.517306 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c4decd-b5a8-451c-962c-b174d12e3931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:45.536416 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-c2c4decd-b5a8-451c-962c-b174d12e3931 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:03:45.537639 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-c2c4decd-b5a8-451c-962c-b174d12e3931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:03:45.613170 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 525/1061] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:03:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 30 07:03:45.636238 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1614def2-12f5-4721-afd7-fe00303c1f56 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:45.737335 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1614def2-12f5-4721-afd7-fe00303c1f56 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:45.770897 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81de313-f3eb-4ec7-9fb3-de7ca83f8f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:45.771642 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81de313-f3eb-4ec7-9fb3-de7ca83f8f61 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:45.771951 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81de313-f3eb-4ec7-9fb3-de7ca83f8f61 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:45.772230 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81de313-f3eb-4ec7-9fb3-de7ca83f8f61 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:45.783133 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81de313-f3eb-4ec7-9fb3-de7ca83f8f61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 07:03:45.790542 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-b81de313-f3eb-4ec7-9fb3-de7ca83f8f61 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Mar 30 07:03:45.791756 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 537/1062] 10.222.0.20 () {56 vars in 1120 bytes} [Wed Mar 30 07:03:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:03:45.797819 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c4decd-b5a8-451c-962c-b174d12e3931 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:45.898050 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c4decd-b5a8-451c-962c-b174d12e3931 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:45.932226 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc32ef8-7579-426f-b469-23ef0ede4dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:45.932900 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc32ef8-7579-426f-b469-23ef0ede4dc6 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:45.933178 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc32ef8-7579-426f-b469-23ef0ede4dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:45.933451 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc32ef8-7579-426f-b469-23ef0ede4dc6 None admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:45.934196 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc32ef8-7579-426f-b469-23ef0ede4dc6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:45.934500 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc32ef8-7579-426f-b469-23ef0ede4dc6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:45.935929 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc32ef8-7579-426f-b469-23ef0ede4dc6 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:45.943908 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 526/1063] 10.222.0.20 () {56 vars in 1115 bytes} [Wed Mar 30 07:03:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:45.950064 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81de313-f3eb-4ec7-9fb3-de7ca83f8f61 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:46.048945 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81de313-f3eb-4ec7-9fb3-de7ca83f8f61 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:46.083122 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4ca2c7-587d-4bf3-8316-be0e40a1a4ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:46.083942 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4ca2c7-587d-4bf3-8316-be0e40a1a4ae None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:46.084201 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4ca2c7-587d-4bf3-8316-be0e40a1a4ae None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:46.084466 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4ca2c7-587d-4bf3-8316-be0e40a1a4ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:46.094714 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4ca2c7-587d-4bf3-8316-be0e40a1a4ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:46.096194 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4ca2c7-587d-4bf3-8316-be0e40a1a4ae None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:46.114093 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-ac4ca2c7-587d-4bf3-8316-be0e40a1a4ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 07:03:46.115492 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 538/1064] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:03:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:03:46.121228 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc32ef8-7579-426f-b469-23ef0ede4dc6 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:46.224518 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc32ef8-7579-426f-b469-23ef0ede4dc6 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:46.259710 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cdc574-e90a-4d75-a0ff-34c831254387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:46.260433 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cdc574-e90a-4d75-a0ff-34c831254387 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:46.260715 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cdc574-e90a-4d75-a0ff-34c831254387 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:46.260986 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cdc574-e90a-4d75-a0ff-34c831254387 None admin] PATH_INFO: `/v3/domains` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:46.261733 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cdc574-e90a-4d75-a0ff-34c831254387 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:46.262037 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cdc574-e90a-4d75-a0ff-34c831254387 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:46.263481 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cdc574-e90a-4d75-a0ff-34c831254387 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:46.278479 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 527/1065] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Mar 30 07:03:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:46.284171 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4ca2c7-587d-4bf3-8316-be0e40a1a4ae None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:46.384566 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4ca2c7-587d-4bf3-8316-be0e40a1a4ae None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:46.418513 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aab1f5b-115b-4144-8369-3e821dcf0b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:46.419305 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aab1f5b-115b-4144-8369-3e821dcf0b8d None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:46.419548 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aab1f5b-115b-4144-8369-3e821dcf0b8d None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:46.419862 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aab1f5b-115b-4144-8369-3e821dcf0b8d None admin] PATH_INFO: `/v3/users/nova` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:46.427135 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aab1f5b-115b-4144-8369-3e821dcf0b8d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:46.428601 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aab1f5b-115b-4144-8369-3e821dcf0b8d None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:46.442316 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-1aab1f5b-115b-4144-8369-3e821dcf0b8d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 30 07:03:46.443859 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 539/1066] 10.222.0.20 () {56 vars in 1093 bytes} [Wed Mar 30 07:03:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:03:46.449621 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cdc574-e90a-4d75-a0ff-34c831254387 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:46.553697 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cdc574-e90a-4d75-a0ff-34c831254387 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:46.588852 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d765266-4c12-41b6-a2f0-28ee931d0f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:46.589525 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d765266-4c12-41b6-a2f0-28ee931d0f21 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:46.589806 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d765266-4c12-41b6-a2f0-28ee931d0f21 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:46.590077 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d765266-4c12-41b6-a2f0-28ee931d0f21 None admin] PATH_INFO: `/v3/users` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:46.590908 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d765266-4c12-41b6-a2f0-28ee931d0f21 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:46.591215 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d765266-4c12-41b6-a2f0-28ee931d0f21 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:46.592685 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d765266-4c12-41b6-a2f0-28ee931d0f21 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:46.610581 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 528/1067] 10.222.0.20 () {56 vars in 1133 bytes} [Wed Mar 30 07:03:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:46.618386 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aab1f5b-115b-4144-8369-3e821dcf0b8d None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:46.625796 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a28755-0560-4707-8936-bc0745c48c63 None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:46.626071 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a28755-0560-4707-8936-bc0745c48c63 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:46.626370 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a28755-0560-4707-8936-bc0745c48c63 None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:46.628349 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 529/1068] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:03:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 30 07:03:46.633135 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22be85b-6ef4-4a6b-bf7a-87b438af96c2 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:46.633398 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22be85b-6ef4-4a6b-bf7a-87b438af96c2 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:46.633793 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22be85b-6ef4-4a6b-bf7a-87b438af96c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:46.651112 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-c22be85b-6ef4-4a6b-bf7a-87b438af96c2 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:03:46.652242 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-c22be85b-6ef4-4a6b-bf7a-87b438af96c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:03:46.717346 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 530/1069] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:03:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 30 07:03:46.718287 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aab1f5b-115b-4144-8369-3e821dcf0b8d None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:46.740124 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22be85b-6ef4-4a6b-bf7a-87b438af96c2 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:46.751621 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b212ba-d0e8-4fdf-83ab-79f270892278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:46.752459 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b212ba-d0e8-4fdf-83ab-79f270892278 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:46.752742 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b212ba-d0e8-4fdf-83ab-79f270892278 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:46.753013 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b212ba-d0e8-4fdf-83ab-79f270892278 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:46.763359 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b212ba-d0e8-4fdf-83ab-79f270892278 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:46.765092 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b212ba-d0e8-4fdf-83ab-79f270892278 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:46.782133 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-56b212ba-d0e8-4fdf-83ab-79f270892278 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 07:03:46.783485 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 540/1070] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:03:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 07:03:46.788998 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b212ba-d0e8-4fdf-83ab-79f270892278 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:46.833892 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22be85b-6ef4-4a6b-bf7a-87b438af96c2 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:46.867322 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6b7945-5371-4e3b-8665-95b486ed6fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:46.868164 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b7945-5371-4e3b-8665-95b486ed6fc8 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:46.868442 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b7945-5371-4e3b-8665-95b486ed6fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:46.868706 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b7945-5371-4e3b-8665-95b486ed6fc8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:46.878775 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6b7945-5371-4e3b-8665-95b486ed6fc8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 07:03:46.885417 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b212ba-d0e8-4fdf-83ab-79f270892278 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:46.885756 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-8d6b7945-5371-4e3b-8665-95b486ed6fc8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 30 07:03:46.887117 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 531/1071] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Mar 30 07:03:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 07:03:46.892907 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6b7945-5371-4e3b-8665-95b486ed6fc8 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:46.919520 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a1410a-24c5-4aa8-b1d3-173b1bab9b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:46.920129 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a1410a-24c5-4aa8-b1d3-173b1bab9b35 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:46.920443 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a1410a-24c5-4aa8-b1d3-173b1bab9b35 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:46.920722 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a1410a-24c5-4aa8-b1d3-173b1bab9b35 None admin] PATH_INFO: `/v3/domains` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:46.921466 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a1410a-24c5-4aa8-b1d3-173b1bab9b35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:46.921748 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a1410a-24c5-4aa8-b1d3-173b1bab9b35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:46.923126 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a1410a-24c5-4aa8-b1d3-173b1bab9b35 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:46.934889 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 541/1072] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Mar 30 07:03:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:46.940414 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a1410a-24c5-4aa8-b1d3-173b1bab9b35 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:46.992495 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6b7945-5371-4e3b-8665-95b486ed6fc8 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:47.025460 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51cc856-a23b-4f5d-9d13-2885ad66499b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:47.026125 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51cc856-a23b-4f5d-9d13-2885ad66499b None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:47.026406 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51cc856-a23b-4f5d-9d13-2885ad66499b None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:47.026681 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51cc856-a23b-4f5d-9d13-2885ad66499b None admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:47.027420 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51cc856-a23b-4f5d-9d13-2885ad66499b None admin] RBAC: Adding query filter params (name=admin) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:47.027715 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51cc856-a23b-4f5d-9d13-2885ad66499b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:47.029116 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51cc856-a23b-4f5d-9d13-2885ad66499b None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:47.037576 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 532/1073] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Mar 30 07:03:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:03:47.041019 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a1410a-24c5-4aa8-b1d3-173b1bab9b35 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:47.043659 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51cc856-a23b-4f5d-9d13-2885ad66499b None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:47.074656 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6be68c-9122-41b8-bd95-03e1e97496f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:47.075460 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6be68c-9122-41b8-bd95-03e1e97496f1 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:47.075733 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6be68c-9122-41b8-bd95-03e1e97496f1 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:47.076039 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6be68c-9122-41b8-bd95-03e1e97496f1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:47.082527 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6be68c-9122-41b8-bd95-03e1e97496f1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:47.083997 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6be68c-9122-41b8-bd95-03e1e97496f1 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:47.097063 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-4b6be68c-9122-41b8-bd95-03e1e97496f1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 30 07:03:47.098409 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 542/1074] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Mar 30 07:03:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 07:03:47.104077 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6be68c-9122-41b8-bd95-03e1e97496f1 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:47.139845 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51cc856-a23b-4f5d-9d13-2885ad66499b None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:47.173557 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163793b5-8ea3-42fb-b586-9b92836d421e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:47.174351 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163793b5-8ea3-42fb-b586-9b92836d421e None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:47.174632 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163793b5-8ea3-42fb-b586-9b92836d421e None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:47.174905 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163793b5-8ea3-42fb-b586-9b92836d421e None admin] PATH_INFO: `/v3/users/8027eb1d1170442cb3f289eace573bd9` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:47.176140 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163793b5-8ea3-42fb-b586-9b92836d421e None admin] RBAC: Authorizing `identity:get_user(user_id=8027eb1d1170442cb3f289eace573bd9)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:47.177579 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163793b5-8ea3-42fb-b586-9b92836d421e None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:47.179197 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 533/1075] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Mar 30 07:03:47 2022] GET /identity/v3/users/8027eb1d1170442cb3f289eace573bd9 => generated 285 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:03:47.184971 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163793b5-8ea3-42fb-b586-9b92836d421e None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:47.207546 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6be68c-9122-41b8-bd95-03e1e97496f1 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:47.240774 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c669e9-d783-4649-ad14-d0dd28a8492c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:47.241887 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c669e9-d783-4649-ad14-d0dd28a8492c None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:47.242565 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c669e9-d783-4649-ad14-d0dd28a8492c None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:47.243513 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c669e9-d783-4649-ad14-d0dd28a8492c None admin] PATH_INFO: `/v3/projects` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:47.244550 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c669e9-d783-4649-ad14-d0dd28a8492c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:47.245027 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c669e9-d783-4649-ad14-d0dd28a8492c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:47.246689 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c669e9-d783-4649-ad14-d0dd28a8492c None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:47.261188 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 543/1076] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Mar 30 07:03:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:03:47.267083 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c669e9-d783-4649-ad14-d0dd28a8492c None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:47.376203 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c669e9-d783-4649-ad14-d0dd28a8492c None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:47.409029 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa41f43f-5465-4b09-bf73-b09837a0dfa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:47.409926 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa41f43f-5465-4b09-bf73-b09837a0dfa4 None admin] REQUEST_METHOD: `PUT` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:47.410200 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa41f43f-5465-4b09-bf73-b09837a0dfa4 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:47.410476 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa41f43f-5465-4b09-bf73-b09837a0dfa4 None admin] PATH_INFO: `/v3/projects/7e4eda4c5cd84307b36a5b48642e816f/users/72b398c5ed14484d8b7a51fee900597b/roles/14814d9e7d1c442eb709661619f37b61` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:47.412691 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa41f43f-5465-4b09-bf73-b09837a0dfa4 None admin] RBAC: Authorizing `identity:create_grant(project_id=7e4eda4c5cd84307b36a5b48642e816f, user_id=72b398c5ed14484d8b7a51fee900597b, role_id=14814d9e7d1c442eb709661619f37b61)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:47.414153 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa41f43f-5465-4b09-bf73-b09837a0dfa4 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:47.415398 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163793b5-8ea3-42fb-b586-9b92836d421e None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:47.428305 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 544/1077] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Mar 30 07:03:47 2022] PUT /identity/v3/projects/7e4eda4c5cd84307b36a5b48642e816f/users/72b398c5ed14484d8b7a51fee900597b/roles/14814d9e7d1c442eb709661619f37b61 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 07:03:47.453143 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aa9f0e-0f2b-42dc-b5ae-9e0fb1b549d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:47.454027 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa9f0e-0f2b-42dc-b5ae-9e0fb1b549d3 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:47.454301 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa9f0e-0f2b-42dc-b5ae-9e0fb1b549d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:47.454567 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa9f0e-0f2b-42dc-b5ae-9e0fb1b549d3 None admin] PATH_INFO: `/v3/projects/060de596bda24515a5df064dd77052f0` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:47.455853 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aa9f0e-0f2b-42dc-b5ae-9e0fb1b549d3 None admin] RBAC: Authorizing `identity:get_project(project_id=060de596bda24515a5df064dd77052f0)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:47.457361 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aa9f0e-0f2b-42dc-b5ae-9e0fb1b549d3 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:47.459334 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 534/1078] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Mar 30 07:03:47 2022] GET /identity/v3/projects/060de596bda24515a5df064dd77052f0 => generated 311 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:03:47.465374 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa41f43f-5465-4b09-bf73-b09837a0dfa4 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:47.571220 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa41f43f-5465-4b09-bf73-b09837a0dfa4 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:47.607527 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e4e6c1-c763-42b0-8c2c-609600bd37cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:47.608478 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e4e6c1-c763-42b0-8c2c-609600bd37cb None admin] REQUEST_METHOD: `PUT` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:47.608753 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e4e6c1-c763-42b0-8c2c-609600bd37cb None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:47.609018 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e4e6c1-c763-42b0-8c2c-609600bd37cb None admin] PATH_INFO: `/v3/projects/060de596bda24515a5df064dd77052f0/users/8027eb1d1170442cb3f289eace573bd9/roles/1c39b9ab8cfd4c0ea71845831920a845` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:47.611433 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e4e6c1-c763-42b0-8c2c-609600bd37cb None admin] RBAC: Authorizing `identity:create_grant(project_id=060de596bda24515a5df064dd77052f0, user_id=8027eb1d1170442cb3f289eace573bd9, role_id=1c39b9ab8cfd4c0ea71845831920a845)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:47.612898 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e4e6c1-c763-42b0-8c2c-609600bd37cb None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:47.630458 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 545/1079] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Mar 30 07:03:47 2022] PUT /identity/v3/projects/060de596bda24515a5df064dd77052f0/users/8027eb1d1170442cb3f289eace573bd9/roles/1c39b9ab8cfd4c0ea71845831920a845 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 07:03:47.728894 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fa35ec-e37d-4cb6-911f-a6d13ca2c99f None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:47.729087 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fa35ec-e37d-4cb6-911f-a6d13ca2c99f None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:47.729343 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fa35ec-e37d-4cb6-911f-a6d13ca2c99f None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:47.731432 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 535/1080] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:03:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:03:47.737490 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab87573-d005-4285-834b-736eb8f979a3 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:47.737821 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab87573-d005-4285-834b-736eb8f979a3 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:47.738021 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab87573-d005-4285-834b-736eb8f979a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:47.756210 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-0ab87573-d005-4285-834b-736eb8f979a3 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:03:47.757411 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-0ab87573-d005-4285-834b-736eb8f979a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:03:47.829348 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 546/1081] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:03:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 30 07:03:47.852377 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fa35ec-e37d-4cb6-911f-a6d13ca2c99f None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:47.956314 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fa35ec-e37d-4cb6-911f-a6d13ca2c99f None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:47.990698 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba92bc2-3f40-4cc5-8105-fbed6a4b38f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:47.991621 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba92bc2-3f40-4cc5-8105-fbed6a4b38f3 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:47.992145 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba92bc2-3f40-4cc5-8105-fbed6a4b38f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:47.992565 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba92bc2-3f40-4cc5-8105-fbed6a4b38f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:48.063571 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba92bc2-3f40-4cc5-8105-fbed6a4b38f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:48.065344 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba92bc2-3f40-4cc5-8105-fbed6a4b38f3 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:48.164334 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 536/1082] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Mar 30 07:03:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 30 07:03:48.170106 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab87573-d005-4285-834b-736eb8f979a3 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:48.271187 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab87573-d005-4285-834b-736eb8f979a3 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:48.305708 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b0b613-0fdf-48ad-bcf2-cfc2deaa00c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:48.306514 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b0b613-0fdf-48ad-bcf2-cfc2deaa00c7 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:48.306787 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b0b613-0fdf-48ad-bcf2-cfc2deaa00c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:48.307059 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b0b613-0fdf-48ad-bcf2-cfc2deaa00c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:48.317420 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b0b613-0fdf-48ad-bcf2-cfc2deaa00c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:48.318877 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b0b613-0fdf-48ad-bcf2-cfc2deaa00c7 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:48.335994 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-a8b0b613-0fdf-48ad-bcf2-cfc2deaa00c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 07:03:48.337420 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 547/1083] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:03:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 07:03:48.343666 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba92bc2-3f40-4cc5-8105-fbed6a4b38f3 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:48.444373 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba92bc2-3f40-4cc5-8105-fbed6a4b38f3 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:48.479056 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3cce04-f0d8-4340-8668-9a6da87d9054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:48.479720 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3cce04-f0d8-4340-8668-9a6da87d9054 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:48.480046 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3cce04-f0d8-4340-8668-9a6da87d9054 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:48.480321 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3cce04-f0d8-4340-8668-9a6da87d9054 None admin] PATH_INFO: `/v3/domains` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:48.481027 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3cce04-f0d8-4340-8668-9a6da87d9054 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:48.481328 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3cce04-f0d8-4340-8668-9a6da87d9054 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:48.482698 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3cce04-f0d8-4340-8668-9a6da87d9054 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:48.500358 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 537/1084] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Mar 30 07:03:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:49.738301 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa97fb8-0b0c-4f1b-b6ff-17a6d445735f None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:49.738864 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa97fb8-0b0c-4f1b-b6ff-17a6d445735f None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:49.738864 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa97fb8-0b0c-4f1b-b6ff-17a6d445735f None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:49.740642 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 548/1085] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:03:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:03:49.746430 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b98b48-cfd5-4d26-ba70-e65e7382f245 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:49.746836 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b98b48-cfd5-4d26-ba70-e65e7382f245 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:49.746990 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b98b48-cfd5-4d26-ba70-e65e7382f245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:49.764873 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-84b98b48-cfd5-4d26-ba70-e65e7382f245 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:03:49.766034 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-84b98b48-cfd5-4d26-ba70-e65e7382f245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:03:49.832113 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 538/1086] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:03:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 30 07:03:49.855405 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa97fb8-0b0c-4f1b-b6ff-17a6d445735f None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:49.891163 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48524657-60ef-46ed-bdab-934cff5d42bd None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:49.891549 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48524657-60ef-46ed-bdab-934cff5d42bd None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:49.892000 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48524657-60ef-46ed-bdab-934cff5d42bd None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:49.894022 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 539/1087] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:03:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 30 07:03:49.899252 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b39472-6ca3-46ee-bd65-4ff741f26b2d None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:49.899526 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b39472-6ca3-46ee-bd65-4ff741f26b2d None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:49.899795 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b39472-6ca3-46ee-bd65-4ff741f26b2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:49.916583 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-c7b39472-6ca3-46ee-bd65-4ff741f26b2d None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:03:49.917743 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-c7b39472-6ca3-46ee-bd65-4ff741f26b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:03:49.961956 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa97fb8-0b0c-4f1b-b6ff-17a6d445735f None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:49.983392 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 540/1088] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:03:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 30 07:03:49.996359 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e98561-da95-4f09-b93f-7fe4b167f98e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:49.997123 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e98561-da95-4f09-b93f-7fe4b167f98e None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:49.997402 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e98561-da95-4f09-b93f-7fe4b167f98e None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:49.997678 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e98561-da95-4f09-b93f-7fe4b167f98e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:50.007738 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e98561-da95-4f09-b93f-7fe4b167f98e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 07:03:50.008111 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b39472-6ca3-46ee-bd65-4ff741f26b2d None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:50.015210 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-01e98561-da95-4f09-b93f-7fe4b167f98e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Mar 30 07:03:50.021238 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 549/1089] 10.222.0.20 () {56 vars in 1120 bytes} [Wed Mar 30 07:03:49 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:03:50.022178 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e98561-da95-4f09-b93f-7fe4b167f98e None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:50.106401 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b39472-6ca3-46ee-bd65-4ff741f26b2d None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:50.120866 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e98561-da95-4f09-b93f-7fe4b167f98e None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:50.141121 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6626be0a-20d2-41f2-90d4-84711f92a7a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:50.141917 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6626be0a-20d2-41f2-90d4-84711f92a7a8 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:50.142190 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6626be0a-20d2-41f2-90d4-84711f92a7a8 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:50.142460 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6626be0a-20d2-41f2-90d4-84711f92a7a8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:50.152357 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6626be0a-20d2-41f2-90d4-84711f92a7a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 07:03:50.154066 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d88c2a-33d9-4978-ac1a-ec9f8caac40b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:50.154738 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d88c2a-33d9-4978-ac1a-ec9f8caac40b None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:50.155025 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d88c2a-33d9-4978-ac1a-ec9f8caac40b None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:50.155323 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d88c2a-33d9-4978-ac1a-ec9f8caac40b None admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:50.156095 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d88c2a-33d9-4978-ac1a-ec9f8caac40b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:50.156402 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d88c2a-33d9-4978-ac1a-ec9f8caac40b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:50.157790 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d88c2a-33d9-4978-ac1a-ec9f8caac40b None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:50.159150 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-6626be0a-20d2-41f2-90d4-84711f92a7a8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 30 07:03:50.160354 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 541/1090] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Mar 30 07:03:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:03:50.166161 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 550/1091] 10.222.0.20 () {56 vars in 1115 bytes} [Wed Mar 30 07:03:50 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:50.166707 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6626be0a-20d2-41f2-90d4-84711f92a7a8 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:50.171562 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d88c2a-33d9-4978-ac1a-ec9f8caac40b None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:50.265710 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6626be0a-20d2-41f2-90d4-84711f92a7a8 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:50.270641 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d88c2a-33d9-4978-ac1a-ec9f8caac40b None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:50.297788 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8c41d7-8a3c-4f94-9a7c-e3e994cfd13e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:50.298452 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c41d7-8a3c-4f94-9a7c-e3e994cfd13e None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:50.298728 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c41d7-8a3c-4f94-9a7c-e3e994cfd13e None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:50.298994 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c41d7-8a3c-4f94-9a7c-e3e994cfd13e None admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:50.299729 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8c41d7-8a3c-4f94-9a7c-e3e994cfd13e None admin] RBAC: Adding query filter params (name=admin) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:50.300054 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8c41d7-8a3c-4f94-9a7c-e3e994cfd13e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:50.301419 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8c41d7-8a3c-4f94-9a7c-e3e994cfd13e None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:50.303487 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa3c4e7-ab3d-4264-b25b-e9abf7a8567e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:50.304306 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa3c4e7-ab3d-4264-b25b-e9abf7a8567e None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:50.304627 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa3c4e7-ab3d-4264-b25b-e9abf7a8567e None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:50.305031 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa3c4e7-ab3d-4264-b25b-e9abf7a8567e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:50.309648 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 542/1092] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Mar 30 07:03:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:03:50.315384 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa3c4e7-ab3d-4264-b25b-e9abf7a8567e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:50.315510 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8c41d7-8a3c-4f94-9a7c-e3e994cfd13e None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:50.316834 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa3c4e7-ab3d-4264-b25b-e9abf7a8567e None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:50.332986 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-efa3c4e7-ab3d-4264-b25b-e9abf7a8567e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 07:03:50.334211 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 551/1093] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:03:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:03:50.339757 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa3c4e7-ab3d-4264-b25b-e9abf7a8567e None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:50.414227 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8c41d7-8a3c-4f94-9a7c-e3e994cfd13e None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:50.437663 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa3c4e7-ab3d-4264-b25b-e9abf7a8567e None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:50.447919 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84070ca5-d98a-45f2-8ef6-0de141651e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:50.448783 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84070ca5-d98a-45f2-8ef6-0de141651e8c None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:50.449070 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84070ca5-d98a-45f2-8ef6-0de141651e8c None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:50.449356 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84070ca5-d98a-45f2-8ef6-0de141651e8c None admin] PATH_INFO: `/v3/users/8027eb1d1170442cb3f289eace573bd9` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:50.450553 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84070ca5-d98a-45f2-8ef6-0de141651e8c None admin] RBAC: Authorizing `identity:get_user(user_id=8027eb1d1170442cb3f289eace573bd9)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:50.452017 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84070ca5-d98a-45f2-8ef6-0de141651e8c None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:50.453642 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 543/1094] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Mar 30 07:03:50 2022] GET /identity/v3/users/8027eb1d1170442cb3f289eace573bd9 => generated 285 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:03:50.459449 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84070ca5-d98a-45f2-8ef6-0de141651e8c None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:50.473691 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09811ab-e19d-4528-b1ce-2ca0a72decac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:50.474354 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09811ab-e19d-4528-b1ce-2ca0a72decac None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:50.474629 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09811ab-e19d-4528-b1ce-2ca0a72decac None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:50.474900 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09811ab-e19d-4528-b1ce-2ca0a72decac None admin] PATH_INFO: `/v3/domains` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:50.475619 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09811ab-e19d-4528-b1ce-2ca0a72decac None admin] RBAC: Adding query filter params (name=Default) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:50.475953 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09811ab-e19d-4528-b1ce-2ca0a72decac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:50.477359 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09811ab-e19d-4528-b1ce-2ca0a72decac None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:50.490104 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 552/1095] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Mar 30 07:03:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:03:50.496049 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09811ab-e19d-4528-b1ce-2ca0a72decac None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:50.569434 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84070ca5-d98a-45f2-8ef6-0de141651e8c None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:50.599258 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09811ab-e19d-4528-b1ce-2ca0a72decac None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:50.607667 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6f4c6c-f239-462f-aa5f-a1f961b9db39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:50.608309 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6f4c6c-f239-462f-aa5f-a1f961b9db39 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:50.608582 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6f4c6c-f239-462f-aa5f-a1f961b9db39 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:50.608850 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6f4c6c-f239-462f-aa5f-a1f961b9db39 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:50.633657 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250bb5bb-4b3c-40de-b70d-073be3dd6ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:50.634450 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250bb5bb-4b3c-40de-b70d-073be3dd6ff8 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:50.634730 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250bb5bb-4b3c-40de-b70d-073be3dd6ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:50.635004 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250bb5bb-4b3c-40de-b70d-073be3dd6ff8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:50.641890 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250bb5bb-4b3c-40de-b70d-073be3dd6ff8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:50.643436 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250bb5bb-4b3c-40de-b70d-073be3dd6ff8 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:50.657196 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-250bb5bb-4b3c-40de-b70d-073be3dd6ff8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 30 07:03:50.658386 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 553/1096] 10.222.0.20 () {56 vars in 1093 bytes} [Wed Mar 30 07:03:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 07:03:50.664203 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250bb5bb-4b3c-40de-b70d-073be3dd6ff8 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:50.673652 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6f4c6c-f239-462f-aa5f-a1f961b9db39 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:50.675103 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6f4c6c-f239-462f-aa5f-a1f961b9db39 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:50.763512 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250bb5bb-4b3c-40de-b70d-073be3dd6ff8 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:50.769907 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 544/1097] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Mar 30 07:03:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 30 07:03:50.776214 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6f4c6c-f239-462f-aa5f-a1f961b9db39 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:50.795991 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b58f0da-34c0-4f25-a081-27fee20e7d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:50.796670 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b58f0da-34c0-4f25-a081-27fee20e7d1e None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:50.796948 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b58f0da-34c0-4f25-a081-27fee20e7d1e None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:50.797221 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b58f0da-34c0-4f25-a081-27fee20e7d1e None admin] PATH_INFO: `/v3/users` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:50.798059 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b58f0da-34c0-4f25-a081-27fee20e7d1e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:50.798363 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b58f0da-34c0-4f25-a081-27fee20e7d1e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:50.799859 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b58f0da-34c0-4f25-a081-27fee20e7d1e None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:50.816749 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 554/1098] 10.222.0.20 () {56 vars in 1133 bytes} [Wed Mar 30 07:03:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:50.822535 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b58f0da-34c0-4f25-a081-27fee20e7d1e None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:50.871184 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6f4c6c-f239-462f-aa5f-a1f961b9db39 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:50.903632 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91009e91-91b9-4603-8691-5ec6f73d5e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:50.904587 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91009e91-91b9-4603-8691-5ec6f73d5e88 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:50.904859 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91009e91-91b9-4603-8691-5ec6f73d5e88 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:50.905129 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91009e91-91b9-4603-8691-5ec6f73d5e88 None admin] PATH_INFO: `/v3/projects/060de596bda24515a5df064dd77052f0` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:50.906288 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91009e91-91b9-4603-8691-5ec6f73d5e88 None admin] RBAC: Authorizing `identity:get_project(project_id=060de596bda24515a5df064dd77052f0)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:50.907715 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91009e91-91b9-4603-8691-5ec6f73d5e88 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:50.909407 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 545/1099] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Mar 30 07:03:50 2022] GET /identity/v3/projects/060de596bda24515a5df064dd77052f0 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:03:50.915635 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91009e91-91b9-4603-8691-5ec6f73d5e88 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:50.919612 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b58f0da-34c0-4f25-a081-27fee20e7d1e None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:50.952041 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ed63a0-65d3-49ec-ae81-4053dc4de741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:50.952680 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed63a0-65d3-49ec-ae81-4053dc4de741 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:50.952956 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed63a0-65d3-49ec-ae81-4053dc4de741 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:50.953235 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed63a0-65d3-49ec-ae81-4053dc4de741 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:51.009528 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91009e91-91b9-4603-8691-5ec6f73d5e88 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:51.016427 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ed63a0-65d3-49ec-ae81-4053dc4de741 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:51.017872 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ed63a0-65d3-49ec-ae81-4053dc4de741 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:51.041830 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83f0246-aac2-4f8d-b6e6-8914c37501c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:51.042478 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f0246-aac2-4f8d-b6e6-8914c37501c2 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:51.042758 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f0246-aac2-4f8d-b6e6-8914c37501c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:51.043030 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f0246-aac2-4f8d-b6e6-8914c37501c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:51.043840 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83f0246-aac2-4f8d-b6e6-8914c37501c2 None admin] RBAC: Adding query filter params (role.id=1c39b9ab8cfd4c0ea71845831920a845, scope.project.id=060de596bda24515a5df064dd77052f0, user.id=8027eb1d1170442cb3f289eace573bd9) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:51.044163 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83f0246-aac2-4f8d-b6e6-8914c37501c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:51.045597 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83f0246-aac2-4f8d-b6e6-8914c37501c2 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:51.051432 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 546/1100] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Mar 30 07:03:50 2022] GET /identity/v3/role_assignments?user.id=8027eb1d1170442cb3f289eace573bd9&scope.project.id=060de596bda24515a5df064dd77052f0&role.id=1c39b9ab8cfd4c0ea71845831920a845 => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:03:51.120191 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 555/1101] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Mar 30 07:03:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Mar 30 07:03:51.126108 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83f0246-aac2-4f8d-b6e6-8914c37501c2 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:51.235976 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83f0246-aac2-4f8d-b6e6-8914c37501c2 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:51.269320 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1b8e73-3a02-4cd4-967f-a4228dab184e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:51.270110 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1b8e73-3a02-4cd4-967f-a4228dab184e None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:51.270388 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1b8e73-3a02-4cd4-967f-a4228dab184e None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:51.270655 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1b8e73-3a02-4cd4-967f-a4228dab184e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:51.280589 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1b8e73-3a02-4cd4-967f-a4228dab184e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:51.282025 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1b8e73-3a02-4cd4-967f-a4228dab184e None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:51.298454 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-1a1b8e73-3a02-4cd4-967f-a4228dab184e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 07:03:51.299637 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 547/1102] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:03:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:03:51.305925 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ed63a0-65d3-49ec-ae81-4053dc4de741 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:51.405832 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ed63a0-65d3-49ec-ae81-4053dc4de741 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:51.440026 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef4bd53-d4dc-47bd-a9f7-e92b70429501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:51.440688 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef4bd53-d4dc-47bd-a9f7-e92b70429501 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:51.440970 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef4bd53-d4dc-47bd-a9f7-e92b70429501 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:51.441240 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef4bd53-d4dc-47bd-a9f7-e92b70429501 None admin] PATH_INFO: `/v3/domains` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:51.441952 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef4bd53-d4dc-47bd-a9f7-e92b70429501 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:51.442253 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef4bd53-d4dc-47bd-a9f7-e92b70429501 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:51.443621 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef4bd53-d4dc-47bd-a9f7-e92b70429501 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:51.454874 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 556/1103] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Mar 30 07:03:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:51.460840 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1b8e73-3a02-4cd4-967f-a4228dab184e None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:51.563989 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1b8e73-3a02-4cd4-967f-a4228dab184e None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:51.598274 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417aa51c-99a8-4253-aa7c-e8ae1481b0b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:51.599062 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417aa51c-99a8-4253-aa7c-e8ae1481b0b7 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:51.599337 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417aa51c-99a8-4253-aa7c-e8ae1481b0b7 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:51.599600 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417aa51c-99a8-4253-aa7c-e8ae1481b0b7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:51.606329 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417aa51c-99a8-4253-aa7c-e8ae1481b0b7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:51.607764 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417aa51c-99a8-4253-aa7c-e8ae1481b0b7 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:51.621247 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-417aa51c-99a8-4253-aa7c-e8ae1481b0b7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 30 07:03:51.622390 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 548/1104] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Mar 30 07:03:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:03:51.628546 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef4bd53-d4dc-47bd-a9f7-e92b70429501 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:51.728274 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef4bd53-d4dc-47bd-a9f7-e92b70429501 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:51.764683 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b681bc3-226a-4865-bc9f-39c2cb396bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:51.765352 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b681bc3-226a-4865-bc9f-39c2cb396bba None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:51.765612 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b681bc3-226a-4865-bc9f-39c2cb396bba None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:51.765880 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b681bc3-226a-4865-bc9f-39c2cb396bba None admin] PATH_INFO: `/v3/projects` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:51.766665 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b681bc3-226a-4865-bc9f-39c2cb396bba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:51.766966 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b681bc3-226a-4865-bc9f-39c2cb396bba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:51.768433 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b681bc3-226a-4865-bc9f-39c2cb396bba None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:51.781537 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 557/1105] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Mar 30 07:03:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:51.787844 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417aa51c-99a8-4253-aa7c-e8ae1481b0b7 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:51.892077 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417aa51c-99a8-4253-aa7c-e8ae1481b0b7 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:51.925869 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2359806d-4c66-4831-a666-033ba90db52f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:51.926516 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2359806d-4c66-4831-a666-033ba90db52f None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:51.926798 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2359806d-4c66-4831-a666-033ba90db52f None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:51.927069 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2359806d-4c66-4831-a666-033ba90db52f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:51.927986 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2359806d-4c66-4831-a666-033ba90db52f None admin] RBAC: Adding query filter params (role.id=14814d9e7d1c442eb709661619f37b61, scope.project.id=7e4eda4c5cd84307b36a5b48642e816f, user.id=72b398c5ed14484d8b7a51fee900597b) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:51.928295 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2359806d-4c66-4831-a666-033ba90db52f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:51.929916 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2359806d-4c66-4831-a666-033ba90db52f None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:51.935836 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 549/1106] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Mar 30 07:03:51 2022] GET /identity/v3/role_assignments?user.id=72b398c5ed14484d8b7a51fee900597b&scope.project.id=7e4eda4c5cd84307b36a5b48642e816f&role.id=14814d9e7d1c442eb709661619f37b61 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:53.358770 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1bfc3c-de8c-455f-91b8-d7be7a46b7d8 None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:53.359325 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1bfc3c-de8c-455f-91b8-d7be7a46b7d8 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:53.359325 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1bfc3c-de8c-455f-91b8-d7be7a46b7d8 None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:53.361525 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 558/1107] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:03:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:03:53.367827 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ae6836-e438-4eeb-8eee-98cdd9db8693 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:53.368247 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ae6836-e438-4eeb-8eee-98cdd9db8693 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:53.368354 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ae6836-e438-4eeb-8eee-98cdd9db8693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:53.386367 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-05ae6836-e438-4eeb-8eee-98cdd9db8693 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:03:53.387542 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-05ae6836-e438-4eeb-8eee-98cdd9db8693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:03:53.455379 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 550/1108] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:03:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 30 07:03:53.480675 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1bfc3c-de8c-455f-91b8-d7be7a46b7d8 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:53.589771 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1bfc3c-de8c-455f-91b8-d7be7a46b7d8 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:53.624151 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f162a586-ee5e-4fd9-bb74-c0d876f8dcfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:53.624937 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f162a586-ee5e-4fd9-bb74-c0d876f8dcfe None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:53.625215 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f162a586-ee5e-4fd9-bb74-c0d876f8dcfe None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:53.625482 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f162a586-ee5e-4fd9-bb74-c0d876f8dcfe None admin] PATH_INFO: `/v3/domains/default` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:53.626754 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f162a586-ee5e-4fd9-bb74-c0d876f8dcfe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:53.628237 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f162a586-ee5e-4fd9-bb74-c0d876f8dcfe None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:53.629859 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 559/1109] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:03:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:53.635935 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ae6836-e438-4eeb-8eee-98cdd9db8693 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:53.731218 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ae6836-e438-4eeb-8eee-98cdd9db8693 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:53.765020 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4aac59-7ecf-454f-9b0f-c647cc879063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:53.765669 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4aac59-7ecf-454f-9b0f-c647cc879063 None admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:53.765944 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4aac59-7ecf-454f-9b0f-c647cc879063 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:53.766210 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4aac59-7ecf-454f-9b0f-c647cc879063 None admin] PATH_INFO: `/v3/users` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:53.766902 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4aac59-7ecf-454f-9b0f-c647cc879063 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:53.768361 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4aac59-7ecf-454f-9b0f-c647cc879063 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:53.790896 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 551/1110] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Mar 30 07:03:53 2022] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:03:56.113779 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220959ab-13f6-42aa-be25-b82e3a2b98d5 None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:56.114376 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220959ab-13f6-42aa-be25-b82e3a2b98d5 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:56.114376 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220959ab-13f6-42aa-be25-b82e3a2b98d5 None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:56.116155 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 560/1111] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:03:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:03:56.122644 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b07a433-6b1b-44c1-b3f0-1e852c4ee437 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:56.123390 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b07a433-6b1b-44c1-b3f0-1e852c4ee437 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:56.123526 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b07a433-6b1b-44c1-b3f0-1e852c4ee437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:56.145077 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-8b07a433-6b1b-44c1-b3f0-1e852c4ee437 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:03:56.146254 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-8b07a433-6b1b-44c1-b3f0-1e852c4ee437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:03:56.225554 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 552/1112] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:03:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 30 07:03:56.260962 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220959ab-13f6-42aa-be25-b82e3a2b98d5 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:56.362759 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220959ab-13f6-42aa-be25-b82e3a2b98d5 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:56.396356 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c016f01-bbe8-48b5-b50d-f4058197883b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:56.397138 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c016f01-bbe8-48b5-b50d-f4058197883b None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:56.397413 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c016f01-bbe8-48b5-b50d-f4058197883b None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:56.397667 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c016f01-bbe8-48b5-b50d-f4058197883b None admin] PATH_INFO: `/v3/roles/075d8bdffff942c29baa73114127d3fa` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:56.399255 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c016f01-bbe8-48b5-b50d-f4058197883b None admin] RBAC: Authorizing `identity:get_role(role_id=075d8bdffff942c29baa73114127d3fa)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:56.400642 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c016f01-bbe8-48b5-b50d-f4058197883b None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:56.401982 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 561/1113] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Mar 30 07:03:56 2022] GET /identity/v3/roles/075d8bdffff942c29baa73114127d3fa => generated 223 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:56.407934 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b07a433-6b1b-44c1-b3f0-1e852c4ee437 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:56.503426 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b07a433-6b1b-44c1-b3f0-1e852c4ee437 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:56.539989 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2842520d-b19b-429a-8443-5b9e0c21b3d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:56.540845 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2842520d-b19b-429a-8443-5b9e0c21b3d3 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:56.541112 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2842520d-b19b-429a-8443-5b9e0c21b3d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:56.541360 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2842520d-b19b-429a-8443-5b9e0c21b3d3 None admin] PATH_INFO: `/v3/users/b55c1d9caac041b1aa0b2a445f025e22` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:56.554360 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2842520d-b19b-429a-8443-5b9e0c21b3d3 None admin] RBAC: Authorizing `identity:get_user(user_id=b55c1d9caac041b1aa0b2a445f025e22)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:56.556651 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2842520d-b19b-429a-8443-5b9e0c21b3d3 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:56.559600 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 553/1114] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Mar 30 07:03:56 2022] GET /identity/v3/users/b55c1d9caac041b1aa0b2a445f025e22 => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:56.567184 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c016f01-bbe8-48b5-b50d-f4058197883b None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:56.684550 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c016f01-bbe8-48b5-b50d-f4058197883b None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:56.718885 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d9e650-4f56-40df-92be-349b921202a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:56.719526 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d9e650-4f56-40df-92be-349b921202a9 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:56.719801 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d9e650-4f56-40df-92be-349b921202a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:56.720106 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d9e650-4f56-40df-92be-349b921202a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:56.787312 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d9e650-4f56-40df-92be-349b921202a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:56.788981 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d9e650-4f56-40df-92be-349b921202a9 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:56.894019 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 562/1115] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Mar 30 07:03:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 30 07:03:56.904313 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2842520d-b19b-429a-8443-5b9e0c21b3d3 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:57.005816 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2842520d-b19b-429a-8443-5b9e0c21b3d3 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:57.038788 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b36f5b-34ca-4fe0-b00a-ea0cd8c6fe62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:57.039627 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b36f5b-34ca-4fe0-b00a-ea0cd8c6fe62 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:57.039927 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b36f5b-34ca-4fe0-b00a-ea0cd8c6fe62 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:57.040191 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b36f5b-34ca-4fe0-b00a-ea0cd8c6fe62 None admin] PATH_INFO: `/v3/projects/060de596bda24515a5df064dd77052f0` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:57.041381 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b36f5b-34ca-4fe0-b00a-ea0cd8c6fe62 None admin] RBAC: Authorizing `identity:get_project(project_id=060de596bda24515a5df064dd77052f0)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:57.042811 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b36f5b-34ca-4fe0-b00a-ea0cd8c6fe62 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:57.044476 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 554/1116] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Mar 30 07:03:56 2022] GET /identity/v3/projects/060de596bda24515a5df064dd77052f0 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:57.051040 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d9e650-4f56-40df-92be-349b921202a9 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:57.154446 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d9e650-4f56-40df-92be-349b921202a9 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:57.188989 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e01b5e6-712e-4a3b-9ada-2a4a86ee543f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:57.189632 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e01b5e6-712e-4a3b-9ada-2a4a86ee543f None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:57.189906 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e01b5e6-712e-4a3b-9ada-2a4a86ee543f None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:57.190184 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e01b5e6-712e-4a3b-9ada-2a4a86ee543f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:57.191003 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e01b5e6-712e-4a3b-9ada-2a4a86ee543f None admin] RBAC: Adding query filter params (role.id=075d8bdffff942c29baa73114127d3fa, scope.project.id=060de596bda24515a5df064dd77052f0, user.id=b55c1d9caac041b1aa0b2a445f025e22) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:03:57.191309 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e01b5e6-712e-4a3b-9ada-2a4a86ee543f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:57.192773 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e01b5e6-712e-4a3b-9ada-2a4a86ee543f None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:57.198478 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 563/1117] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Mar 30 07:03:57 2022] GET /identity/v3/role_assignments?user.id=b55c1d9caac041b1aa0b2a445f025e22&scope.project.id=060de596bda24515a5df064dd77052f0&role.id=075d8bdffff942c29baa73114127d3fa => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:59.443108 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b1550e-7c7c-4e2b-88f1-54f3ceeef161 None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:59.444011 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b1550e-7c7c-4e2b-88f1-54f3ceeef161 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:59.444175 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b1550e-7c7c-4e2b-88f1-54f3ceeef161 None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:59.447403 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 555/1118] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:03:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:03:59.452900 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b89566-6ae3-41ad-a6d8-f2e83483d446 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:59.453317 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b89566-6ae3-41ad-a6d8-f2e83483d446 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:59.453406 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b89566-6ae3-41ad-a6d8-f2e83483d446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:59.473140 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-a8b89566-6ae3-41ad-a6d8-f2e83483d446 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:03:59.474244 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-a8b89566-6ae3-41ad-a6d8-f2e83483d446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:03:59.545558 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 564/1119] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:03:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 30 07:03:59.568905 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b1550e-7c7c-4e2b-88f1-54f3ceeef161 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:59.672560 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b1550e-7c7c-4e2b-88f1-54f3ceeef161 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:59.706289 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd2c38c-fcfc-4680-a212-56e15a92d2b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:59.707129 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd2c38c-fcfc-4680-a212-56e15a92d2b5 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:59.707398 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd2c38c-fcfc-4680-a212-56e15a92d2b5 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:59.707664 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd2c38c-fcfc-4680-a212-56e15a92d2b5 None admin] PATH_INFO: `/v3/roles/075d8bdffff942c29baa73114127d3fa` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:59.709256 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd2c38c-fcfc-4680-a212-56e15a92d2b5 None admin] RBAC: Authorizing `identity:get_role(role_id=075d8bdffff942c29baa73114127d3fa)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:59.710743 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd2c38c-fcfc-4680-a212-56e15a92d2b5 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:59.712129 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 556/1120] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Mar 30 07:03:59 2022] GET /identity/v3/roles/075d8bdffff942c29baa73114127d3fa => generated 223 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:03:59.718216 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b89566-6ae3-41ad-a6d8-f2e83483d446 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:59.816872 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b89566-6ae3-41ad-a6d8-f2e83483d446 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:59.851151 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0f77ae-7c84-405e-b5c2-34e6712a4fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:03:59.852056 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0f77ae-7c84-405e-b5c2-34e6712a4fc3 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:03:59.852330 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0f77ae-7c84-405e-b5c2-34e6712a4fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:03:59.852596 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0f77ae-7c84-405e-b5c2-34e6712a4fc3 None admin] PATH_INFO: `/v3/users/b55c1d9caac041b1aa0b2a445f025e22` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:03:59.853872 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0f77ae-7c84-405e-b5c2-34e6712a4fc3 None admin] RBAC: Authorizing `identity:get_user(user_id=b55c1d9caac041b1aa0b2a445f025e22)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:03:59.855296 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0f77ae-7c84-405e-b5c2-34e6712a4fc3 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:03:59.856913 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 565/1121] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Mar 30 07:03:59 2022] GET /identity/v3/users/b55c1d9caac041b1aa0b2a445f025e22 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:03:59.863296 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd2c38c-fcfc-4680-a212-56e15a92d2b5 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:03:59.963458 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd2c38c-fcfc-4680-a212-56e15a92d2b5 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:03:59.999497 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c64beb-dfbc-4788-bc02-fa82888fa49b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:04:00.000374 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c64beb-dfbc-4788-bc02-fa82888fa49b None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:04:00.000649 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c64beb-dfbc-4788-bc02-fa82888fa49b None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:04:00.000920 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c64beb-dfbc-4788-bc02-fa82888fa49b None admin] PATH_INFO: `/v3/projects/060de596bda24515a5df064dd77052f0` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:04:00.002203 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c64beb-dfbc-4788-bc02-fa82888fa49b None admin] RBAC: Authorizing `identity:get_project(project_id=060de596bda24515a5df064dd77052f0)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:04:00.003626 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c64beb-dfbc-4788-bc02-fa82888fa49b None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:04:00.005324 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 557/1122] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Mar 30 07:03:59 2022] GET /identity/v3/projects/060de596bda24515a5df064dd77052f0 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:04:00.012436 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0f77ae-7c84-405e-b5c2-34e6712a4fc3 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:04:00.121917 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0f77ae-7c84-405e-b5c2-34e6712a4fc3 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:04:00.155535 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf5792b-afef-4089-bf23-3d374eb61171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:04:00.156428 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf5792b-afef-4089-bf23-3d374eb61171 None admin] REQUEST_METHOD: `PUT` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:04:00.156704 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf5792b-afef-4089-bf23-3d374eb61171 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:04:00.156973 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf5792b-afef-4089-bf23-3d374eb61171 None admin] PATH_INFO: `/v3/projects/060de596bda24515a5df064dd77052f0/users/b55c1d9caac041b1aa0b2a445f025e22/roles/075d8bdffff942c29baa73114127d3fa` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:04:00.159509 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf5792b-afef-4089-bf23-3d374eb61171 None admin] RBAC: Authorizing `identity:create_grant(project_id=060de596bda24515a5df064dd77052f0, user_id=b55c1d9caac041b1aa0b2a445f025e22, role_id=075d8bdffff942c29baa73114127d3fa)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:04:00.160979 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf5792b-afef-4089-bf23-3d374eb61171 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:04:00.180596 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 566/1123] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Mar 30 07:04:00 2022] PUT /identity/v3/projects/060de596bda24515a5df064dd77052f0/users/b55c1d9caac041b1aa0b2a445f025e22/roles/075d8bdffff942c29baa73114127d3fa => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:04:02.538315 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a73cadf-5438-41a0-abe9-517c67fb40ab None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:04:02.538865 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a73cadf-5438-41a0-abe9-517c67fb40ab None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:04:02.538865 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a73cadf-5438-41a0-abe9-517c67fb40ab None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:04:02.540771 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 558/1124] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:04:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:04:02.547127 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef77df0b-5134-4f74-b580-cefe13d77c10 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:04:02.547882 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef77df0b-5134-4f74-b580-cefe13d77c10 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:04:02.548003 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef77df0b-5134-4f74-b580-cefe13d77c10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:04:02.569253 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-ef77df0b-5134-4f74-b580-cefe13d77c10 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:04:02.570589 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-ef77df0b-5134-4f74-b580-cefe13d77c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:04:02.642835 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 567/1125] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:04:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 30 07:04:02.668943 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a73cadf-5438-41a0-abe9-517c67fb40ab None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:04:02.782423 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a73cadf-5438-41a0-abe9-517c67fb40ab None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:04:02.816542 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab012546-d45f-4cfc-8367-fc2e66d8be14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:04:02.817389 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab012546-d45f-4cfc-8367-fc2e66d8be14 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:04:02.817665 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab012546-d45f-4cfc-8367-fc2e66d8be14 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:04:02.817940 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab012546-d45f-4cfc-8367-fc2e66d8be14 None admin] PATH_INFO: `/v3/roles/075d8bdffff942c29baa73114127d3fa` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:04:02.819522 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab012546-d45f-4cfc-8367-fc2e66d8be14 None admin] RBAC: Authorizing `identity:get_role(role_id=075d8bdffff942c29baa73114127d3fa)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:04:02.821050 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab012546-d45f-4cfc-8367-fc2e66d8be14 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:04:02.822396 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 559/1126] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Mar 30 07:04:02 2022] GET /identity/v3/roles/075d8bdffff942c29baa73114127d3fa => generated 223 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:04:02.831148 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef77df0b-5134-4f74-b580-cefe13d77c10 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:04:02.932832 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef77df0b-5134-4f74-b580-cefe13d77c10 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:04:02.966123 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ca053e-9afd-4fc6-b2b7-4d90aba13dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:04:02.966970 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca053e-9afd-4fc6-b2b7-4d90aba13dab None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:04:02.967243 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca053e-9afd-4fc6-b2b7-4d90aba13dab None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:04:02.967505 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca053e-9afd-4fc6-b2b7-4d90aba13dab None admin] PATH_INFO: `/v3/users/b55c1d9caac041b1aa0b2a445f025e22` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:04:02.968747 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ca053e-9afd-4fc6-b2b7-4d90aba13dab None admin] RBAC: Authorizing `identity:get_user(user_id=b55c1d9caac041b1aa0b2a445f025e22)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:04:02.970168 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ca053e-9afd-4fc6-b2b7-4d90aba13dab None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:04:02.971757 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 568/1127] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Mar 30 07:04:02 2022] GET /identity/v3/users/b55c1d9caac041b1aa0b2a445f025e22 => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:04:02.978550 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab012546-d45f-4cfc-8367-fc2e66d8be14 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:04:03.087326 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab012546-d45f-4cfc-8367-fc2e66d8be14 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:04:03.121433 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdff7acc-d713-4538-9ef8-91ccab605fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:04:03.122065 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff7acc-d713-4538-9ef8-91ccab605fb5 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:04:03.122342 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff7acc-d713-4538-9ef8-91ccab605fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:04:03.122612 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff7acc-d713-4538-9ef8-91ccab605fb5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:04:03.191127 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdff7acc-d713-4538-9ef8-91ccab605fb5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:04:03.192603 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdff7acc-d713-4538-9ef8-91ccab605fb5 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:04:03.292572 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 560/1128] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Mar 30 07:04:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 30 07:04:03.300501 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ca053e-9afd-4fc6-b2b7-4d90aba13dab None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:04:03.407423 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ca053e-9afd-4fc6-b2b7-4d90aba13dab None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:04:03.441677 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5427049a-0eaa-4811-b819-71e610e06d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:04:03.442519 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5427049a-0eaa-4811-b819-71e610e06d35 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:04:03.442798 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5427049a-0eaa-4811-b819-71e610e06d35 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:04:03.443070 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5427049a-0eaa-4811-b819-71e610e06d35 None admin] PATH_INFO: `/v3/projects/060de596bda24515a5df064dd77052f0` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:04:03.444308 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5427049a-0eaa-4811-b819-71e610e06d35 None admin] RBAC: Authorizing `identity:get_project(project_id=060de596bda24515a5df064dd77052f0)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:04:03.445873 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5427049a-0eaa-4811-b819-71e610e06d35 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:04:03.447583 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 569/1129] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Mar 30 07:04:03 2022] GET /identity/v3/projects/060de596bda24515a5df064dd77052f0 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:04:03.454603 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdff7acc-d713-4538-9ef8-91ccab605fb5 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:04:03.558889 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdff7acc-d713-4538-9ef8-91ccab605fb5 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:04:03.595337 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5089812c-80e2-45e7-98ed-7fa477804e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:04:03.596007 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5089812c-80e2-45e7-98ed-7fa477804e5b None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:04:03.596280 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5089812c-80e2-45e7-98ed-7fa477804e5b None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:04:03.596551 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5089812c-80e2-45e7-98ed-7fa477804e5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:04:03.597361 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5089812c-80e2-45e7-98ed-7fa477804e5b None admin] RBAC: Adding query filter params (role.id=075d8bdffff942c29baa73114127d3fa, scope.project.id=060de596bda24515a5df064dd77052f0, user.id=b55c1d9caac041b1aa0b2a445f025e22) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:04:03.597667 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5089812c-80e2-45e7-98ed-7fa477804e5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:04:03.599095 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5089812c-80e2-45e7-98ed-7fa477804e5b None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:04:03.605194 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 561/1130] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Mar 30 07:04:03 2022] GET /identity/v3/role_assignments?user.id=b55c1d9caac041b1aa0b2a445f025e22&scope.project.id=060de596bda24515a5df064dd77052f0&role.id=075d8bdffff942c29baa73114127d3fa => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:04:05.906072 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2850c4-9850-4d93-b42c-86e8982b839f None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:04:05.906944 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2850c4-9850-4d93-b42c-86e8982b839f None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:04:05.906944 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2850c4-9850-4d93-b42c-86e8982b839f None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:04:05.909823 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 570/1131] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:04:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:04:05.915432 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75931320-e440-438d-aad5-24633467f068 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:04:05.915871 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75931320-e440-438d-aad5-24633467f068 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:04:05.915984 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75931320-e440-438d-aad5-24633467f068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:04:05.934097 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-75931320-e440-438d-aad5-24633467f068 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:04:05.935270 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-75931320-e440-438d-aad5-24633467f068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:04:06.008152 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 562/1132] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:04:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 30 07:04:06.043540 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2850c4-9850-4d93-b42c-86e8982b839f None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:04:06.157059 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2850c4-9850-4d93-b42c-86e8982b839f None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:04:06.190729 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0bdbee-676d-4460-83be-974f39ebc699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:04:06.191520 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0bdbee-676d-4460-83be-974f39ebc699 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:04:06.191797 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0bdbee-676d-4460-83be-974f39ebc699 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:04:06.192100 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0bdbee-676d-4460-83be-974f39ebc699 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:04:06.193304 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0bdbee-676d-4460-83be-974f39ebc699 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:04:06.194809 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0bdbee-676d-4460-83be-974f39ebc699 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:04:06.196458 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 571/1133] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:04:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:04:06.202731 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75931320-e440-438d-aad5-24633467f068 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:04:06.302602 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75931320-e440-438d-aad5-24633467f068 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:04:06.340354 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c00ea7-4074-4556-be06-a04d48dfbd10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:04:06.341020 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c00ea7-4074-4556-be06-a04d48dfbd10 None admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:04:06.341304 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c00ea7-4074-4556-be06-a04d48dfbd10 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:04:06.341575 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c00ea7-4074-4556-be06-a04d48dfbd10 None admin] PATH_INFO: `/v3/projects` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:04:06.342294 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c00ea7-4074-4556-be06-a04d48dfbd10 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:04:06.343876 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c00ea7-4074-4556-be06-a04d48dfbd10 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:04:06.373662 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 563/1134] 10.222.0.20 () {60 vars in 1141 bytes} [Wed Mar 30 07:04:06 2022] POST /identity/v3/projects => generated 311 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:04:08.688095 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e1d930-1e00-42cb-9ff1-908c2c7adc79 None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:04:08.688952 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e1d930-1e00-42cb-9ff1-908c2c7adc79 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:04:08.688952 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e1d930-1e00-42cb-9ff1-908c2c7adc79 None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:04:08.691889 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 572/1135] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:04:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:04:08.698536 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a70fb2-98ca-4778-be88-89672e6d3748 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:04:08.699287 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a70fb2-98ca-4778-be88-89672e6d3748 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:04:08.699416 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a70fb2-98ca-4778-be88-89672e6d3748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:04:08.720987 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-30a70fb2-98ca-4778-be88-89672e6d3748 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:04:08.722156 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-30a70fb2-98ca-4778-be88-89672e6d3748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:04:08.795249 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 564/1136] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:04:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 30 07:04:08.821528 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e1d930-1e00-42cb-9ff1-908c2c7adc79 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:04:08.933246 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e1d930-1e00-42cb-9ff1-908c2c7adc79 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:04:08.969571 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eef6389-26d6-46cd-b5fc-eae35b2ca9e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:04:08.970283 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eef6389-26d6-46cd-b5fc-eae35b2ca9e0 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:04:08.970559 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eef6389-26d6-46cd-b5fc-eae35b2ca9e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:04:08.970830 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eef6389-26d6-46cd-b5fc-eae35b2ca9e0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:04:08.972065 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eef6389-26d6-46cd-b5fc-eae35b2ca9e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:04:08.973496 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eef6389-26d6-46cd-b5fc-eae35b2ca9e0 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:04:08.975074 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 573/1137] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:04:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:04:08.984418 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a70fb2-98ca-4778-be88-89672e6d3748 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:04:09.092322 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a70fb2-98ca-4778-be88-89672e6d3748 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:04:09.124073 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1270fa3f-d94a-4ba2-b46b-30dc36cab84a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:04:09.124727 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1270fa3f-d94a-4ba2-b46b-30dc36cab84a None admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:04:09.125006 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1270fa3f-d94a-4ba2-b46b-30dc36cab84a None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:04:09.125272 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1270fa3f-d94a-4ba2-b46b-30dc36cab84a None admin] PATH_INFO: `/v3/users` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:04:09.125966 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1270fa3f-d94a-4ba2-b46b-30dc36cab84a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:04:09.127393 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1270fa3f-d94a-4ba2-b46b-30dc36cab84a None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:04:09.153551 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 565/1138] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Mar 30 07:04:08 2022] POST /identity/v3/users => generated 286 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:04:11.454976 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605ad1ad-1bdd-427a-b698-5887a8d03ee1 None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:04:11.455536 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605ad1ad-1bdd-427a-b698-5887a8d03ee1 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:04:11.455536 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605ad1ad-1bdd-427a-b698-5887a8d03ee1 None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:04:11.457345 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 574/1139] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:04:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:04:11.463694 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e3ec14-536d-4cea-9778-4a6348b441f0 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:04:11.464147 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e3ec14-536d-4cea-9778-4a6348b441f0 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:04:11.464254 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e3ec14-536d-4cea-9778-4a6348b441f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:04:11.492568 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-c9e3ec14-536d-4cea-9778-4a6348b441f0 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:04:11.493769 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-c9e3ec14-536d-4cea-9778-4a6348b441f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:04:11.560504 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 566/1140] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:04:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 30 07:04:11.585545 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605ad1ad-1bdd-427a-b698-5887a8d03ee1 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:04:11.705622 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605ad1ad-1bdd-427a-b698-5887a8d03ee1 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:04:11.739989 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388e84db-8cb5-420a-893c-0a62f0c823b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:04:11.740701 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388e84db-8cb5-420a-893c-0a62f0c823b9 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:04:11.740978 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388e84db-8cb5-420a-893c-0a62f0c823b9 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:04:11.741305 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388e84db-8cb5-420a-893c-0a62f0c823b9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:04:11.752285 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388e84db-8cb5-420a-893c-0a62f0c823b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 07:04:11.759099 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-388e84db-8cb5-420a-893c-0a62f0c823b9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 30 07:04:11.760348 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 575/1141] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Mar 30 07:04:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:04:11.770366 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e3ec14-536d-4cea-9778-4a6348b441f0 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:04:11.876212 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e3ec14-536d-4cea-9778-4a6348b441f0 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:04:11.910355 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed78beda-b7c6-4b9e-b1be-f13c32004a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:04:11.911001 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed78beda-b7c6-4b9e-b1be-f13c32004a8a None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:04:11.911276 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed78beda-b7c6-4b9e-b1be-f13c32004a8a None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:04:11.911545 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed78beda-b7c6-4b9e-b1be-f13c32004a8a None admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:04:11.912320 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed78beda-b7c6-4b9e-b1be-f13c32004a8a None admin] RBAC: Adding query filter params (name=admin) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:04:11.912621 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed78beda-b7c6-4b9e-b1be-f13c32004a8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:04:11.914296 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed78beda-b7c6-4b9e-b1be-f13c32004a8a None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:04:11.922077 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 567/1142] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Mar 30 07:04:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:04:11.928503 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388e84db-8cb5-420a-893c-0a62f0c823b9 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:04:12.030763 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388e84db-8cb5-420a-893c-0a62f0c823b9 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:04:12.065061 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2679db56-4f58-41a4-b8a4-2e08a6c6b52a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:04:12.065939 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2679db56-4f58-41a4-b8a4-2e08a6c6b52a None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:04:12.066216 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2679db56-4f58-41a4-b8a4-2e08a6c6b52a None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:04:12.066483 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2679db56-4f58-41a4-b8a4-2e08a6c6b52a None admin] PATH_INFO: `/v3/users/034a8b2820574b9894546ddaacd042d5` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:04:12.080597 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2679db56-4f58-41a4-b8a4-2e08a6c6b52a None admin] RBAC: Authorizing `identity:get_user(user_id=034a8b2820574b9894546ddaacd042d5)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:04:12.082047 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2679db56-4f58-41a4-b8a4-2e08a6c6b52a None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:04:12.083703 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 576/1143] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Mar 30 07:04:11 2022] GET /identity/v3/users/034a8b2820574b9894546ddaacd042d5 => generated 286 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:04:12.090124 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed78beda-b7c6-4b9e-b1be-f13c32004a8a None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:04:12.198886 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed78beda-b7c6-4b9e-b1be-f13c32004a8a None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:04:12.232645 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeb2ee4-44e9-4428-910b-a05fac8504cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:04:12.233286 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeb2ee4-44e9-4428-910b-a05fac8504cc None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:04:12.233566 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeb2ee4-44e9-4428-910b-a05fac8504cc None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:04:12.233837 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeb2ee4-44e9-4428-910b-a05fac8504cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:04:12.302959 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caeb2ee4-44e9-4428-910b-a05fac8504cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:04:12.304430 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caeb2ee4-44e9-4428-910b-a05fac8504cc None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:04:12.405553 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 568/1144] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Mar 30 07:04:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 30 07:04:12.414567 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2679db56-4f58-41a4-b8a4-2e08a6c6b52a None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:04:12.513521 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2679db56-4f58-41a4-b8a4-2e08a6c6b52a None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:04:12.547446 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e08a74-8e43-4650-b508-52a27cb918c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:04:12.548319 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e08a74-8e43-4650-b508-52a27cb918c7 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:04:12.548595 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e08a74-8e43-4650-b508-52a27cb918c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:04:12.548868 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e08a74-8e43-4650-b508-52a27cb918c7 None admin] PATH_INFO: `/v3/projects/1c5d8555b90a45fea07a41a88cae0376` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:04:12.550158 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e08a74-8e43-4650-b508-52a27cb918c7 None admin] RBAC: Authorizing `identity:get_project(project_id=1c5d8555b90a45fea07a41a88cae0376)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:04:12.551593 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e08a74-8e43-4650-b508-52a27cb918c7 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:04:12.553390 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 577/1145] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Mar 30 07:04:12 2022] GET /identity/v3/projects/1c5d8555b90a45fea07a41a88cae0376 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:04:12.560516 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeb2ee4-44e9-4428-910b-a05fac8504cc None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:04:12.662387 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeb2ee4-44e9-4428-910b-a05fac8504cc None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:04:12.706592 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26060558-e36d-4510-be0a-0ae85f4f136c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:04:12.707581 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26060558-e36d-4510-be0a-0ae85f4f136c None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:04:12.708064 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26060558-e36d-4510-be0a-0ae85f4f136c None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:04:12.708501 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26060558-e36d-4510-be0a-0ae85f4f136c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:04:12.709874 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26060558-e36d-4510-be0a-0ae85f4f136c None admin] RBAC: Adding query filter params (role.id=1c39b9ab8cfd4c0ea71845831920a845, scope.project.id=1c5d8555b90a45fea07a41a88cae0376, user.id=034a8b2820574b9894546ddaacd042d5) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:04:12.710257 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26060558-e36d-4510-be0a-0ae85f4f136c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:04:12.712797 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26060558-e36d-4510-be0a-0ae85f4f136c None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:04:12.721718 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 569/1146] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Mar 30 07:04:12 2022] GET /identity/v3/role_assignments?user.id=034a8b2820574b9894546ddaacd042d5&scope.project.id=1c5d8555b90a45fea07a41a88cae0376&role.id=1c39b9ab8cfd4c0ea71845831920a845 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:04:15.003603 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a09f6b-a40e-4140-ba34-9621cc104960 None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:04:15.004692 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a09f6b-a40e-4140-ba34-9621cc104960 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:04:15.004692 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a09f6b-a40e-4140-ba34-9621cc104960 None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:04:15.007363 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 578/1147] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:04:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:04:15.012997 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1cb790-022e-45fc-8dfc-1005ab58bfcc None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:04:15.013413 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1cb790-022e-45fc-8dfc-1005ab58bfcc None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:04:15.013521 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1cb790-022e-45fc-8dfc-1005ab58bfcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:04:15.031236 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-1b1cb790-022e-45fc-8dfc-1005ab58bfcc None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:04:15.032451 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-1b1cb790-022e-45fc-8dfc-1005ab58bfcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:04:15.099487 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 570/1148] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:04:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 30 07:04:15.123080 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a09f6b-a40e-4140-ba34-9621cc104960 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:04:15.244846 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a09f6b-a40e-4140-ba34-9621cc104960 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:04:15.285973 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23051d9-7445-4f35-9aa8-40caa21f07c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:04:15.286678 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23051d9-7445-4f35-9aa8-40caa21f07c4 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:04:15.286953 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23051d9-7445-4f35-9aa8-40caa21f07c4 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:04:15.287217 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23051d9-7445-4f35-9aa8-40caa21f07c4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:04:15.298624 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23051d9-7445-4f35-9aa8-40caa21f07c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 07:04:15.305581 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-b23051d9-7445-4f35-9aa8-40caa21f07c4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 30 07:04:15.306765 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 579/1149] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Mar 30 07:04:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:04:15.313847 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1cb790-022e-45fc-8dfc-1005ab58bfcc None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:04:15.418441 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1cb790-022e-45fc-8dfc-1005ab58bfcc None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:04:15.453392 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec8ae14-b0aa-4fc9-9858-aeb7238e0bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:04:15.454046 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec8ae14-b0aa-4fc9-9858-aeb7238e0bfc None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:04:15.454321 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec8ae14-b0aa-4fc9-9858-aeb7238e0bfc None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:04:15.454596 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec8ae14-b0aa-4fc9-9858-aeb7238e0bfc None admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:04:15.455342 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec8ae14-b0aa-4fc9-9858-aeb7238e0bfc None admin] RBAC: Adding query filter params (name=admin) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:04:15.455650 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec8ae14-b0aa-4fc9-9858-aeb7238e0bfc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:04:15.457061 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec8ae14-b0aa-4fc9-9858-aeb7238e0bfc None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:04:15.465104 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 571/1150] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Mar 30 07:04:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:04:15.474568 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23051d9-7445-4f35-9aa8-40caa21f07c4 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:04:15.585438 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23051d9-7445-4f35-9aa8-40caa21f07c4 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:04:15.626813 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6036d3a8-af8d-448a-84a7-a4c9d132c3d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:04:15.627673 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6036d3a8-af8d-448a-84a7-a4c9d132c3d8 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:04:15.627985 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6036d3a8-af8d-448a-84a7-a4c9d132c3d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:04:15.628255 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6036d3a8-af8d-448a-84a7-a4c9d132c3d8 None admin] PATH_INFO: `/v3/users/034a8b2820574b9894546ddaacd042d5` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:04:15.629567 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6036d3a8-af8d-448a-84a7-a4c9d132c3d8 None admin] RBAC: Authorizing `identity:get_user(user_id=034a8b2820574b9894546ddaacd042d5)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:04:15.631011 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6036d3a8-af8d-448a-84a7-a4c9d132c3d8 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:04:15.632774 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 580/1151] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Mar 30 07:04:15 2022] GET /identity/v3/users/034a8b2820574b9894546ddaacd042d5 => generated 286 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:04:15.638860 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec8ae14-b0aa-4fc9-9858-aeb7238e0bfc None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:04:15.748490 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec8ae14-b0aa-4fc9-9858-aeb7238e0bfc None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:04:15.781749 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d815c96-a047-4b00-9451-eead3e94e586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:04:15.782597 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d815c96-a047-4b00-9451-eead3e94e586 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:04:15.782876 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d815c96-a047-4b00-9451-eead3e94e586 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:04:15.783149 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d815c96-a047-4b00-9451-eead3e94e586 None admin] PATH_INFO: `/v3/projects/1c5d8555b90a45fea07a41a88cae0376` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:04:15.784392 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d815c96-a047-4b00-9451-eead3e94e586 None admin] RBAC: Authorizing `identity:get_project(project_id=1c5d8555b90a45fea07a41a88cae0376)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:04:15.785829 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d815c96-a047-4b00-9451-eead3e94e586 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:04:15.787486 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 572/1152] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Mar 30 07:04:15 2022] GET /identity/v3/projects/1c5d8555b90a45fea07a41a88cae0376 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:04:15.797212 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6036d3a8-af8d-448a-84a7-a4c9d132c3d8 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:04:15.907451 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6036d3a8-af8d-448a-84a7-a4c9d132c3d8 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:04:15.943033 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74af4052-635e-4678-ace9-2139c1761dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:04:15.943949 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74af4052-635e-4678-ace9-2139c1761dff None admin] REQUEST_METHOD: `PUT` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:04:15.944227 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74af4052-635e-4678-ace9-2139c1761dff None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:04:15.944524 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74af4052-635e-4678-ace9-2139c1761dff None admin] PATH_INFO: `/v3/projects/1c5d8555b90a45fea07a41a88cae0376/users/034a8b2820574b9894546ddaacd042d5/roles/1c39b9ab8cfd4c0ea71845831920a845` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:04:15.946711 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74af4052-635e-4678-ace9-2139c1761dff None admin] RBAC: Authorizing `identity:create_grant(project_id=1c5d8555b90a45fea07a41a88cae0376, user_id=034a8b2820574b9894546ddaacd042d5, role_id=1c39b9ab8cfd4c0ea71845831920a845)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:04:15.948173 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74af4052-635e-4678-ace9-2139c1761dff None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:04:15.965996 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 581/1153] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Mar 30 07:04:15 2022] PUT /identity/v3/projects/1c5d8555b90a45fea07a41a88cae0376/users/034a8b2820574b9894546ddaacd042d5/roles/1c39b9ab8cfd4c0ea71845831920a845 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:04:18.214760 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40f46f1-9424-4adc-aa84-8cd97e4e920a None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:04:18.215251 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40f46f1-9424-4adc-aa84-8cd97e4e920a None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:04:18.215348 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40f46f1-9424-4adc-aa84-8cd97e4e920a None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:04:18.217154 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 573/1154] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:04:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:04:18.223210 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e871d78-67eb-485e-a113-660eb3ca6f1f None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:04:18.223667 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e871d78-67eb-485e-a113-660eb3ca6f1f None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:04:18.223774 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e871d78-67eb-485e-a113-660eb3ca6f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:04:18.247704 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-2e871d78-67eb-485e-a113-660eb3ca6f1f None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:04:18.248921 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-2e871d78-67eb-485e-a113-660eb3ca6f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:04:18.314967 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 582/1155] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:04:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 30 07:04:18.339202 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40f46f1-9424-4adc-aa84-8cd97e4e920a None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:04:18.450515 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40f46f1-9424-4adc-aa84-8cd97e4e920a None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:04:18.485415 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c72ebb-ad4e-4121-aef7-3f1514397e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:04:18.486123 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c72ebb-ad4e-4121-aef7-3f1514397e95 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:04:18.486399 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c72ebb-ad4e-4121-aef7-3f1514397e95 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:04:18.486662 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c72ebb-ad4e-4121-aef7-3f1514397e95 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:04:18.497486 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c72ebb-ad4e-4121-aef7-3f1514397e95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 07:04:18.504307 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-c2c72ebb-ad4e-4121-aef7-3f1514397e95 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 30 07:04:18.505484 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 574/1156] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Mar 30 07:04:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:04:18.512148 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e871d78-67eb-485e-a113-660eb3ca6f1f None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:04:18.628923 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e871d78-67eb-485e-a113-660eb3ca6f1f None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:04:18.663848 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d608c83-06ad-48f4-a62f-8ec18bbff56a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:04:18.664530 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d608c83-06ad-48f4-a62f-8ec18bbff56a None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:04:18.664808 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d608c83-06ad-48f4-a62f-8ec18bbff56a None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:04:18.665083 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d608c83-06ad-48f4-a62f-8ec18bbff56a None admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:04:18.665827 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d608c83-06ad-48f4-a62f-8ec18bbff56a None admin] RBAC: Adding query filter params (name=admin) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:04:18.666130 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d608c83-06ad-48f4-a62f-8ec18bbff56a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:04:18.667498 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d608c83-06ad-48f4-a62f-8ec18bbff56a None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:04:18.675518 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 583/1157] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Mar 30 07:04:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:04:18.684172 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c72ebb-ad4e-4121-aef7-3f1514397e95 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:04:18.792829 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c72ebb-ad4e-4121-aef7-3f1514397e95 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:04:18.838040 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7918f3-64dd-443d-96bf-5407f726ce40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:04:18.838894 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7918f3-64dd-443d-96bf-5407f726ce40 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:04:18.839163 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7918f3-64dd-443d-96bf-5407f726ce40 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:04:18.839428 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7918f3-64dd-443d-96bf-5407f726ce40 None admin] PATH_INFO: `/v3/users/034a8b2820574b9894546ddaacd042d5` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:04:18.840729 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7918f3-64dd-443d-96bf-5407f726ce40 None admin] RBAC: Authorizing `identity:get_user(user_id=034a8b2820574b9894546ddaacd042d5)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:04:18.842160 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7918f3-64dd-443d-96bf-5407f726ce40 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:04:18.843778 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 575/1158] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Mar 30 07:04:18 2022] GET /identity/v3/users/034a8b2820574b9894546ddaacd042d5 => generated 286 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:04:18.850081 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d608c83-06ad-48f4-a62f-8ec18bbff56a None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:04:18.956295 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d608c83-06ad-48f4-a62f-8ec18bbff56a None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:04:18.990627 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dea694-90fc-4194-ba3b-664c8e66a65b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:04:18.991379 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dea694-90fc-4194-ba3b-664c8e66a65b None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:04:18.991617 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dea694-90fc-4194-ba3b-664c8e66a65b None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:04:18.991920 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dea694-90fc-4194-ba3b-664c8e66a65b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:04:19.058334 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dea694-90fc-4194-ba3b-664c8e66a65b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:04:19.059713 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dea694-90fc-4194-ba3b-664c8e66a65b None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:04:19.163046 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 584/1159] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Mar 30 07:04:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 30 07:04:19.169915 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7918f3-64dd-443d-96bf-5407f726ce40 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:04:19.270819 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7918f3-64dd-443d-96bf-5407f726ce40 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:04:19.304364 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ca0134-6b9a-495e-9e76-2fb06fc297cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:04:19.305208 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ca0134-6b9a-495e-9e76-2fb06fc297cb None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:04:19.305487 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ca0134-6b9a-495e-9e76-2fb06fc297cb None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:04:19.305756 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ca0134-6b9a-495e-9e76-2fb06fc297cb None admin] PATH_INFO: `/v3/projects/1c5d8555b90a45fea07a41a88cae0376` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:04:19.306939 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ca0134-6b9a-495e-9e76-2fb06fc297cb None admin] RBAC: Authorizing `identity:get_project(project_id=1c5d8555b90a45fea07a41a88cae0376)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:04:19.308469 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ca0134-6b9a-495e-9e76-2fb06fc297cb None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:04:19.310081 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 576/1160] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Mar 30 07:04:19 2022] GET /identity/v3/projects/1c5d8555b90a45fea07a41a88cae0376 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:04:19.316576 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dea694-90fc-4194-ba3b-664c8e66a65b None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:04:19.411248 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dea694-90fc-4194-ba3b-664c8e66a65b None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:04:19.444256 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11a05ea-ab3d-45d3-881e-2c2ed6489ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:04:19.445025 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11a05ea-ab3d-45d3-881e-2c2ed6489ab5 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:04:19.445304 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11a05ea-ab3d-45d3-881e-2c2ed6489ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:04:19.445569 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11a05ea-ab3d-45d3-881e-2c2ed6489ab5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:04:19.446386 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11a05ea-ab3d-45d3-881e-2c2ed6489ab5 None admin] RBAC: Adding query filter params (role.id=1c39b9ab8cfd4c0ea71845831920a845, scope.project.id=1c5d8555b90a45fea07a41a88cae0376, user.id=034a8b2820574b9894546ddaacd042d5) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:04:19.446688 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11a05ea-ab3d-45d3-881e-2c2ed6489ab5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:04:19.449928 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11a05ea-ab3d-45d3-881e-2c2ed6489ab5 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:04:19.457423 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 585/1161] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Mar 30 07:04:19 2022] GET /identity/v3/role_assignments?user.id=034a8b2820574b9894546ddaacd042d5&scope.project.id=1c5d8555b90a45fea07a41a88cae0376&role.id=1c39b9ab8cfd4c0ea71845831920a845 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:04:21.730828 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f81b6-0379-4914-a356-7a35e24eb52d None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:04:21.731697 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f81b6-0379-4914-a356-7a35e24eb52d None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:04:21.731697 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f81b6-0379-4914-a356-7a35e24eb52d None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:04:21.734947 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 577/1162] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:04:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:04:21.743864 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c11b4-8f23-461c-b5dd-297ab226b904 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:04:21.744560 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c11b4-8f23-461c-b5dd-297ab226b904 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:04:21.744819 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c11b4-8f23-461c-b5dd-297ab226b904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:04:21.767647 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-046c11b4-8f23-461c-b5dd-297ab226b904 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:04:21.768880 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-046c11b4-8f23-461c-b5dd-297ab226b904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:04:21.847870 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 586/1163] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:04:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 30 07:04:21.872405 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947f81b6-0379-4914-a356-7a35e24eb52d None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:04:21.983395 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947f81b6-0379-4914-a356-7a35e24eb52d None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:04:22.017402 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0036cab-9ba4-4ae7-abdb-e53876ace179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:04:22.018030 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0036cab-9ba4-4ae7-abdb-e53876ace179 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:04:22.018306 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0036cab-9ba4-4ae7-abdb-e53876ace179 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:04:22.018574 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0036cab-9ba4-4ae7-abdb-e53876ace179 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:04:22.083987 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0036cab-9ba4-4ae7-abdb-e53876ace179 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:04:22.085559 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0036cab-9ba4-4ae7-abdb-e53876ace179 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:04:22.187021 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 578/1164] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Mar 30 07:04:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 30 07:04:22.196359 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046c11b4-8f23-461c-b5dd-297ab226b904 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:04:22.294190 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046c11b4-8f23-461c-b5dd-297ab226b904 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:04:22.327985 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb3d0f7-6436-4d78-8ffa-6e09cbced826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:04:22.328769 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb3d0f7-6436-4d78-8ffa-6e09cbced826 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:04:22.329048 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb3d0f7-6436-4d78-8ffa-6e09cbced826 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:04:22.329315 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb3d0f7-6436-4d78-8ffa-6e09cbced826 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:04:22.336532 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb3d0f7-6436-4d78-8ffa-6e09cbced826 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:04:22.337978 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb3d0f7-6436-4d78-8ffa-6e09cbced826 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:04:22.351949 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-bfb3d0f7-6436-4d78-8ffa-6e09cbced826 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Mar 30 07:04:22.353096 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 587/1165] 10.222.0.20 () {56 vars in 1117 bytes} [Wed Mar 30 07:04:22 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 07:04:22.363099 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0036cab-9ba4-4ae7-abdb-e53876ace179 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:04:22.473254 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0036cab-9ba4-4ae7-abdb-e53876ace179 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:04:22.507521 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656d1647-fd36-4d9f-8362-e667add69a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:04:22.508204 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656d1647-fd36-4d9f-8362-e667add69a53 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:04:22.508475 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656d1647-fd36-4d9f-8362-e667add69a53 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:04:22.508743 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656d1647-fd36-4d9f-8362-e667add69a53 None admin] PATH_INFO: `/v3/domains` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:04:22.509466 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656d1647-fd36-4d9f-8362-e667add69a53 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:04:22.509769 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656d1647-fd36-4d9f-8362-e667add69a53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:04:22.511144 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656d1647-fd36-4d9f-8362-e667add69a53 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:04:22.518311 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 579/1166] 10.222.0.20 () {56 vars in 1115 bytes} [Wed Mar 30 07:04:22 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:04:24.803758 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c94f0-43d7-4802-9bac-78a3bd25b49f None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:04:24.804389 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c94f0-43d7-4802-9bac-78a3bd25b49f None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:04:24.804493 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c94f0-43d7-4802-9bac-78a3bd25b49f None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:04:24.806264 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 588/1167] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:04:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:04:24.812789 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8734f619-3189-49a7-935f-d961ff2bb22c None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:04:24.813486 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8734f619-3189-49a7-935f-d961ff2bb22c None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:04:24.813653 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8734f619-3189-49a7-935f-d961ff2bb22c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:04:24.835012 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-8734f619-3189-49a7-935f-d961ff2bb22c None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:04:24.836229 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-8734f619-3189-49a7-935f-d961ff2bb22c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:04:24.906544 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 580/1168] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:04:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 30 07:04:24.938460 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283c94f0-43d7-4802-9bac-78a3bd25b49f None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:04:25.043966 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283c94f0-43d7-4802-9bac-78a3bd25b49f None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:04:25.088264 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f1430f-6371-4d74-9dd3-fe40a14df8ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:04:25.088902 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f1430f-6371-4d74-9dd3-fe40a14df8ae None admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:04:25.089179 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f1430f-6371-4d74-9dd3-fe40a14df8ae None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:04:25.089447 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f1430f-6371-4d74-9dd3-fe40a14df8ae None admin] PATH_INFO: `/v3/domains` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:04:25.090171 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f1430f-6371-4d74-9dd3-fe40a14df8ae None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:04:25.091528 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f1430f-6371-4d74-9dd3-fe40a14df8ae None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:04:25.112203 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 589/1169] 10.222.0.20 () {60 vars in 1138 bytes} [Wed Mar 30 07:04:24 2022] POST /identity/v3/domains => generated 267 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:04:27.457024 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2545cda-2b99-4691-8fb4-1407280f3ee2 None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:04:27.457604 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2545cda-2b99-4691-8fb4-1407280f3ee2 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:04:27.457604 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2545cda-2b99-4691-8fb4-1407280f3ee2 None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:04:27.459519 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 581/1170] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:04:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:04:27.465822 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a9f8a-f60c-4913-8a60-bbec65f1b908 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:04:27.466568 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a9f8a-f60c-4913-8a60-bbec65f1b908 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:04:27.466693 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a9f8a-f60c-4913-8a60-bbec65f1b908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:04:27.494422 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-745a9f8a-f60c-4913-8a60-bbec65f1b908 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:04:27.495586 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-745a9f8a-f60c-4913-8a60-bbec65f1b908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:04:27.563447 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 590/1171] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:04:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 30 07:04:27.589500 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2545cda-2b99-4691-8fb4-1407280f3ee2 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:04:27.701196 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2545cda-2b99-4691-8fb4-1407280f3ee2 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:04:27.737465 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53af661-bd8f-4d28-87d6-d9dfad8740aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:04:27.738244 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53af661-bd8f-4d28-87d6-d9dfad8740aa None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:04:27.738516 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53af661-bd8f-4d28-87d6-d9dfad8740aa None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:04:27.738779 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53af661-bd8f-4d28-87d6-d9dfad8740aa None admin] PATH_INFO: `/v3/domains/07a58ca072de44f6a26d615576a40208` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:04:27.749644 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53af661-bd8f-4d28-87d6-d9dfad8740aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=07a58ca072de44f6a26d615576a40208)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:04:27.751080 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53af661-bd8f-4d28-87d6-d9dfad8740aa None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:04:27.752740 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 582/1172] 10.222.0.20 () {56 vars in 1183 bytes} [Wed Mar 30 07:04:27 2022] GET /identity/v3/domains/07a58ca072de44f6a26d615576a40208 => generated 267 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:04:27.759053 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745a9f8a-f60c-4913-8a60-bbec65f1b908 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:04:27.869246 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745a9f8a-f60c-4913-8a60-bbec65f1b908 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:04:27.903249 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd36085-a527-4acc-a4ce-cae5771f5ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:04:27.903919 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd36085-a527-4acc-a4ce-cae5771f5ce7 None admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:04:27.904206 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd36085-a527-4acc-a4ce-cae5771f5ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:04:27.904475 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd36085-a527-4acc-a4ce-cae5771f5ce7 None admin] PATH_INFO: `/v3/projects` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:04:27.905177 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd36085-a527-4acc-a4ce-cae5771f5ce7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:04:27.906612 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd36085-a527-4acc-a4ce-cae5771f5ce7 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:04:27.935886 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 591/1173] 10.222.0.20 () {60 vars in 1141 bytes} [Wed Mar 30 07:04:27 2022] POST /identity/v3/projects => generated 361 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:04:30.234042 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a60bdaf-536a-4184-a0ad-84ea57948cc8 None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:04:30.235178 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a60bdaf-536a-4184-a0ad-84ea57948cc8 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:04:30.235325 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a60bdaf-536a-4184-a0ad-84ea57948cc8 None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:04:30.238124 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 583/1174] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:04:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:04:30.243607 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd03d5b5-a1b6-4c1e-8a98-84e6662fcf7e None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:04:30.244080 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd03d5b5-a1b6-4c1e-8a98-84e6662fcf7e None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:04:30.244172 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd03d5b5-a1b6-4c1e-8a98-84e6662fcf7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:04:30.262972 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-dd03d5b5-a1b6-4c1e-8a98-84e6662fcf7e None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:04:30.264177 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-dd03d5b5-a1b6-4c1e-8a98-84e6662fcf7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:04:30.334171 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 592/1175] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:04:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 30 07:04:30.358691 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a60bdaf-536a-4184-a0ad-84ea57948cc8 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:04:30.477482 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a60bdaf-536a-4184-a0ad-84ea57948cc8 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:04:30.511595 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd5965c-74b5-4470-97b4-78399fb04ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:04:30.512468 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd5965c-74b5-4470-97b4-78399fb04ba0 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:04:30.512739 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd5965c-74b5-4470-97b4-78399fb04ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:04:30.513010 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd5965c-74b5-4470-97b4-78399fb04ba0 None admin] PATH_INFO: `/v3/domains/07a58ca072de44f6a26d615576a40208` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:04:30.514210 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd5965c-74b5-4470-97b4-78399fb04ba0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=07a58ca072de44f6a26d615576a40208)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:04:30.515634 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd5965c-74b5-4470-97b4-78399fb04ba0 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:04:30.517245 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 584/1176] 10.222.0.20 () {56 vars in 1183 bytes} [Wed Mar 30 07:04:30 2022] GET /identity/v3/domains/07a58ca072de44f6a26d615576a40208 => generated 267 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:04:30.523134 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd03d5b5-a1b6-4c1e-8a98-84e6662fcf7e None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:04:30.634004 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd03d5b5-a1b6-4c1e-8a98-84e6662fcf7e None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:04:30.668452 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2dce7b-8858-4b56-88d4-54358b548f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:04:30.669119 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2dce7b-8858-4b56-88d4-54358b548f53 None admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:04:30.669402 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2dce7b-8858-4b56-88d4-54358b548f53 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:04:30.669674 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2dce7b-8858-4b56-88d4-54358b548f53 None admin] PATH_INFO: `/v3/users` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:04:30.670391 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2dce7b-8858-4b56-88d4-54358b548f53 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:04:30.671842 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2dce7b-8858-4b56-88d4-54358b548f53 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:04:30.694217 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 593/1177] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Mar 30 07:04:30 2022] POST /identity/v3/users => generated 311 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:04:33.029746 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfd157e-cb1e-404b-8610-afec0d4265ff None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:04:33.030316 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfd157e-cb1e-404b-8610-afec0d4265ff None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:04:33.030316 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfd157e-cb1e-404b-8610-afec0d4265ff None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:04:33.032100 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 585/1178] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:04:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:04:33.039572 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd946d-0996-4242-a64e-41f7558968fc None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:04:33.040041 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd946d-0996-4242-a64e-41f7558968fc None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:04:33.040134 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd946d-0996-4242-a64e-41f7558968fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:04:33.058751 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-d0fd946d-0996-4242-a64e-41f7558968fc None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:04:33.059958 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-d0fd946d-0996-4242-a64e-41f7558968fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:04:33.131372 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 594/1179] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:04:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 30 07:04:33.161127 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfd157e-cb1e-404b-8610-afec0d4265ff None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:04:33.273455 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfd157e-cb1e-404b-8610-afec0d4265ff None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:04:33.309447 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfa36e8-2adc-4a14-bff7-9d3eb6876ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:04:33.310171 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfa36e8-2adc-4a14-bff7-9d3eb6876ee2 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:04:33.310445 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfa36e8-2adc-4a14-bff7-9d3eb6876ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:04:33.310713 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfa36e8-2adc-4a14-bff7-9d3eb6876ee2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:04:33.322206 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfa36e8-2adc-4a14-bff7-9d3eb6876ee2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 07:04:33.328971 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-acfa36e8-2adc-4a14-bff7-9d3eb6876ee2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 30 07:04:33.330151 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 586/1180] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Mar 30 07:04:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:04:33.336645 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fd946d-0996-4242-a64e-41f7558968fc None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:04:33.435972 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fd946d-0996-4242-a64e-41f7558968fc None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:04:33.469296 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2616ce29-200a-492e-8675-f793155a64d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:04:33.469942 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2616ce29-200a-492e-8675-f793155a64d2 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:04:33.470215 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2616ce29-200a-492e-8675-f793155a64d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:04:33.470480 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2616ce29-200a-492e-8675-f793155a64d2 None admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:04:33.471219 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2616ce29-200a-492e-8675-f793155a64d2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:04:33.471523 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2616ce29-200a-492e-8675-f793155a64d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:04:33.472933 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2616ce29-200a-492e-8675-f793155a64d2 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:04:33.480937 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 595/1181] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Mar 30 07:04:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:04:33.487714 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfa36e8-2adc-4a14-bff7-9d3eb6876ee2 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:04:33.610945 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfa36e8-2adc-4a14-bff7-9d3eb6876ee2 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:04:33.644231 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d8890d-8bb2-407c-8311-6646e14e33df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:04:33.645091 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d8890d-8bb2-407c-8311-6646e14e33df None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:04:33.645367 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d8890d-8bb2-407c-8311-6646e14e33df None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:04:33.645636 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d8890d-8bb2-407c-8311-6646e14e33df None admin] PATH_INFO: `/v3/users/32d1c524baa2454f83145a53d29d5d80` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:04:33.658482 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d8890d-8bb2-407c-8311-6646e14e33df None admin] RBAC: Authorizing `identity:get_user(user_id=32d1c524baa2454f83145a53d29d5d80)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:04:33.659956 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d8890d-8bb2-407c-8311-6646e14e33df None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:04:33.661603 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 587/1182] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Mar 30 07:04:33 2022] GET /identity/v3/users/32d1c524baa2454f83145a53d29d5d80 => generated 311 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:04:33.668396 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2616ce29-200a-492e-8675-f793155a64d2 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:04:33.777931 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2616ce29-200a-492e-8675-f793155a64d2 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:04:33.814723 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52df5e07-37a2-4085-a850-627645481187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:04:33.815345 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52df5e07-37a2-4085-a850-627645481187 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:04:33.815627 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52df5e07-37a2-4085-a850-627645481187 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:04:33.815921 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52df5e07-37a2-4085-a850-627645481187 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:04:33.880516 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52df5e07-37a2-4085-a850-627645481187 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:04:33.881921 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52df5e07-37a2-4085-a850-627645481187 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:04:33.977118 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 596/1183] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Mar 30 07:04:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 30 07:04:33.983328 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d8890d-8bb2-407c-8311-6646e14e33df None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:04:34.083277 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d8890d-8bb2-407c-8311-6646e14e33df None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:04:34.118037 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeb711e-966a-4807-a09d-67e705c90955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:04:34.118882 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb711e-966a-4807-a09d-67e705c90955 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:04:34.119151 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb711e-966a-4807-a09d-67e705c90955 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:04:34.119417 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb711e-966a-4807-a09d-67e705c90955 None admin] PATH_INFO: `/v3/projects/7740af15b5d042159d47baa78485efd6` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:04:34.120697 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeb711e-966a-4807-a09d-67e705c90955 None admin] RBAC: Authorizing `identity:get_project(project_id=7740af15b5d042159d47baa78485efd6)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:04:34.122122 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeb711e-966a-4807-a09d-67e705c90955 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:04:34.123784 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 588/1184] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Mar 30 07:04:33 2022] GET /identity/v3/projects/7740af15b5d042159d47baa78485efd6 => generated 361 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:04:34.130200 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52df5e07-37a2-4085-a850-627645481187 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:04:34.232564 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52df5e07-37a2-4085-a850-627645481187 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:04:34.268104 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607c0db6-0778-406e-9787-e660ae1819fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:04:34.268749 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c0db6-0778-406e-9787-e660ae1819fd None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:04:34.269029 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c0db6-0778-406e-9787-e660ae1819fd None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:04:34.269282 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c0db6-0778-406e-9787-e660ae1819fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:04:34.270125 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607c0db6-0778-406e-9787-e660ae1819fd None admin] RBAC: Adding query filter params (role.id=1c39b9ab8cfd4c0ea71845831920a845, scope.project.id=7740af15b5d042159d47baa78485efd6, user.id=32d1c524baa2454f83145a53d29d5d80) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:04:34.270427 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607c0db6-0778-406e-9787-e660ae1819fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:04:34.272056 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607c0db6-0778-406e-9787-e660ae1819fd None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:04:34.277730 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 597/1185] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Mar 30 07:04:34 2022] GET /identity/v3/role_assignments?user.id=32d1c524baa2454f83145a53d29d5d80&scope.project.id=7740af15b5d042159d47baa78485efd6&role.id=1c39b9ab8cfd4c0ea71845831920a845 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:04:36.530625 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24314886-5a99-48ac-8b63-8e36f2500bd1 None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:04:36.531437 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24314886-5a99-48ac-8b63-8e36f2500bd1 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:04:36.531437 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24314886-5a99-48ac-8b63-8e36f2500bd1 None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:04:36.534195 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 589/1186] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:04:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:04:36.540840 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a917f30-795e-4316-85c2-d570ea2c74bf None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:04:36.541295 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a917f30-795e-4316-85c2-d570ea2c74bf None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:04:36.541389 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a917f30-795e-4316-85c2-d570ea2c74bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:04:36.569365 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-7a917f30-795e-4316-85c2-d570ea2c74bf None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:04:36.570527 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-7a917f30-795e-4316-85c2-d570ea2c74bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:04:36.640848 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 598/1187] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:04:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 30 07:04:36.664956 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24314886-5a99-48ac-8b63-8e36f2500bd1 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:04:36.778937 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24314886-5a99-48ac-8b63-8e36f2500bd1 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:04:36.816127 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddf2b55-959a-4708-9349-283d595353f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:04:36.816906 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf2b55-959a-4708-9349-283d595353f2 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:04:36.817179 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf2b55-959a-4708-9349-283d595353f2 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:04:36.817449 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf2b55-959a-4708-9349-283d595353f2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:04:36.831598 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddf2b55-959a-4708-9349-283d595353f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 07:04:36.838588 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-4ddf2b55-959a-4708-9349-283d595353f2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 30 07:04:36.839779 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 590/1188] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Mar 30 07:04:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:04:36.846642 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a917f30-795e-4316-85c2-d570ea2c74bf None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:04:36.949159 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a917f30-795e-4316-85c2-d570ea2c74bf None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:04:36.983638 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0365fad-3b08-49e1-91c4-f7f233d4ffdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:04:36.984320 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0365fad-3b08-49e1-91c4-f7f233d4ffdb None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:04:36.984948 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0365fad-3b08-49e1-91c4-f7f233d4ffdb None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:04:36.985235 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0365fad-3b08-49e1-91c4-f7f233d4ffdb None admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:04:36.985978 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0365fad-3b08-49e1-91c4-f7f233d4ffdb None admin] RBAC: Adding query filter params (name=admin) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:04:36.986287 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0365fad-3b08-49e1-91c4-f7f233d4ffdb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:04:36.987666 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0365fad-3b08-49e1-91c4-f7f233d4ffdb None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:04:36.995824 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 599/1189] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Mar 30 07:04:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:04:37.005237 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddf2b55-959a-4708-9349-283d595353f2 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:04:37.122245 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddf2b55-959a-4708-9349-283d595353f2 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:04:37.156320 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc1fd57-f3f8-48ce-8f95-61bab6af9e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:04:37.157172 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc1fd57-f3f8-48ce-8f95-61bab6af9e10 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:04:37.157442 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc1fd57-f3f8-48ce-8f95-61bab6af9e10 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:04:37.157702 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc1fd57-f3f8-48ce-8f95-61bab6af9e10 None admin] PATH_INFO: `/v3/users/32d1c524baa2454f83145a53d29d5d80` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:04:37.158900 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc1fd57-f3f8-48ce-8f95-61bab6af9e10 None admin] RBAC: Authorizing `identity:get_user(user_id=32d1c524baa2454f83145a53d29d5d80)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:04:37.160363 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc1fd57-f3f8-48ce-8f95-61bab6af9e10 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:04:37.161944 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 591/1190] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Mar 30 07:04:37 2022] GET /identity/v3/users/32d1c524baa2454f83145a53d29d5d80 => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:04:37.168037 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0365fad-3b08-49e1-91c4-f7f233d4ffdb None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:04:37.275963 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0365fad-3b08-49e1-91c4-f7f233d4ffdb None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:04:37.311516 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399c67b6-12cf-4bf9-9e95-b2ca6221ac84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:04:37.312824 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399c67b6-12cf-4bf9-9e95-b2ca6221ac84 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:04:37.313165 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399c67b6-12cf-4bf9-9e95-b2ca6221ac84 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:04:37.313486 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399c67b6-12cf-4bf9-9e95-b2ca6221ac84 None admin] PATH_INFO: `/v3/projects/7740af15b5d042159d47baa78485efd6` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:04:37.315563 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399c67b6-12cf-4bf9-9e95-b2ca6221ac84 None admin] RBAC: Authorizing `identity:get_project(project_id=7740af15b5d042159d47baa78485efd6)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:04:37.317853 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399c67b6-12cf-4bf9-9e95-b2ca6221ac84 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:04:37.319897 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 600/1191] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Mar 30 07:04:37 2022] GET /identity/v3/projects/7740af15b5d042159d47baa78485efd6 => generated 361 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:04:37.326614 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc1fd57-f3f8-48ce-8f95-61bab6af9e10 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:04:37.434273 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc1fd57-f3f8-48ce-8f95-61bab6af9e10 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:04:37.467800 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4928f5-30c6-4520-86a9-6277b944e8a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:04:37.468702 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4928f5-30c6-4520-86a9-6277b944e8a2 None admin] REQUEST_METHOD: `PUT` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:04:37.468977 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4928f5-30c6-4520-86a9-6277b944e8a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:04:37.469247 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4928f5-30c6-4520-86a9-6277b944e8a2 None admin] PATH_INFO: `/v3/projects/7740af15b5d042159d47baa78485efd6/users/32d1c524baa2454f83145a53d29d5d80/roles/1c39b9ab8cfd4c0ea71845831920a845` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:04:37.471405 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4928f5-30c6-4520-86a9-6277b944e8a2 None admin] RBAC: Authorizing `identity:create_grant(project_id=7740af15b5d042159d47baa78485efd6, user_id=32d1c524baa2454f83145a53d29d5d80, role_id=1c39b9ab8cfd4c0ea71845831920a845)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:04:37.472860 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4928f5-30c6-4520-86a9-6277b944e8a2 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:04:37.488968 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 592/1192] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Mar 30 07:04:37 2022] PUT /identity/v3/projects/7740af15b5d042159d47baa78485efd6/users/32d1c524baa2454f83145a53d29d5d80/roles/1c39b9ab8cfd4c0ea71845831920a845 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:04:39.715783 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347cf513-feb2-4d7b-8490-7914137f33eb None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:04:39.716748 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347cf513-feb2-4d7b-8490-7914137f33eb None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:04:39.716748 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347cf513-feb2-4d7b-8490-7914137f33eb None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:04:39.719712 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 601/1193] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:04:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:04:39.727351 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c7b164-2c81-4ce5-8dc4-91a9217de83b None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:04:39.727793 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c7b164-2c81-4ce5-8dc4-91a9217de83b None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:04:39.727928 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c7b164-2c81-4ce5-8dc4-91a9217de83b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:04:39.747484 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-a7c7b164-2c81-4ce5-8dc4-91a9217de83b None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:04:39.748709 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-a7c7b164-2c81-4ce5-8dc4-91a9217de83b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:04:39.822585 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 593/1194] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:04:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 30 07:04:39.846503 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347cf513-feb2-4d7b-8490-7914137f33eb None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:04:39.952327 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347cf513-feb2-4d7b-8490-7914137f33eb None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:04:39.989339 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dff6dd6-57c2-403e-ab10-0a24ce1effd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:04:39.990280 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff6dd6-57c2-403e-ab10-0a24ce1effd0 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:04:39.990426 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff6dd6-57c2-403e-ab10-0a24ce1effd0 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:04:39.990631 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff6dd6-57c2-403e-ab10-0a24ce1effd0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:04:40.129433 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dff6dd6-57c2-403e-ab10-0a24ce1effd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 07:04:40.136423 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-2dff6dd6-57c2-403e-ab10-0a24ce1effd0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 30 07:04:40.137653 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 602/1195] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Mar 30 07:04:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:04:40.144879 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c7b164-2c81-4ce5-8dc4-91a9217de83b None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:04:40.260272 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c7b164-2c81-4ce5-8dc4-91a9217de83b None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:04:40.295634 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20857b3-d16d-4dc3-9853-fadfc1f6ac3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:04:40.296320 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20857b3-d16d-4dc3-9853-fadfc1f6ac3e None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:04:40.296591 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20857b3-d16d-4dc3-9853-fadfc1f6ac3e None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:04:40.296858 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20857b3-d16d-4dc3-9853-fadfc1f6ac3e None admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:04:40.297592 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20857b3-d16d-4dc3-9853-fadfc1f6ac3e None admin] RBAC: Adding query filter params (name=admin) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:04:40.297891 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20857b3-d16d-4dc3-9853-fadfc1f6ac3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:04:40.299264 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20857b3-d16d-4dc3-9853-fadfc1f6ac3e None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:04:40.307926 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 594/1196] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Mar 30 07:04:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:04:40.316895 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dff6dd6-57c2-403e-ab10-0a24ce1effd0 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:04:40.431451 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dff6dd6-57c2-403e-ab10-0a24ce1effd0 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:04:40.466392 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eaba4e-2e50-4f6c-a1d5-0d6aae121f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:04:40.467262 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eaba4e-2e50-4f6c-a1d5-0d6aae121f27 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:04:40.467537 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eaba4e-2e50-4f6c-a1d5-0d6aae121f27 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:04:40.467835 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eaba4e-2e50-4f6c-a1d5-0d6aae121f27 None admin] PATH_INFO: `/v3/users/32d1c524baa2454f83145a53d29d5d80` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:04:40.469286 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eaba4e-2e50-4f6c-a1d5-0d6aae121f27 None admin] RBAC: Authorizing `identity:get_user(user_id=32d1c524baa2454f83145a53d29d5d80)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:04:40.470724 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eaba4e-2e50-4f6c-a1d5-0d6aae121f27 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:04:40.472402 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 603/1197] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Mar 30 07:04:40 2022] GET /identity/v3/users/32d1c524baa2454f83145a53d29d5d80 => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:04:40.479363 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20857b3-d16d-4dc3-9853-fadfc1f6ac3e None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:04:40.604392 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20857b3-d16d-4dc3-9853-fadfc1f6ac3e None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:04:40.639226 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cac497-f5db-4ef2-a613-b8a3a362089b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:04:40.639855 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cac497-f5db-4ef2-a613-b8a3a362089b None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:04:40.640147 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cac497-f5db-4ef2-a613-b8a3a362089b None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:04:40.640481 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cac497-f5db-4ef2-a613-b8a3a362089b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:04:40.706585 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cac497-f5db-4ef2-a613-b8a3a362089b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:04:40.708034 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cac497-f5db-4ef2-a613-b8a3a362089b None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:04:40.805846 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 595/1198] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Mar 30 07:04:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 30 07:04:40.812371 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eaba4e-2e50-4f6c-a1d5-0d6aae121f27 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:04:40.920516 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eaba4e-2e50-4f6c-a1d5-0d6aae121f27 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:04:40.958594 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2599bed0-8b23-4df2-abeb-866ba5d0ce14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:04:40.959613 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2599bed0-8b23-4df2-abeb-866ba5d0ce14 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:04:40.959916 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2599bed0-8b23-4df2-abeb-866ba5d0ce14 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:04:40.960181 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2599bed0-8b23-4df2-abeb-866ba5d0ce14 None admin] PATH_INFO: `/v3/projects/7740af15b5d042159d47baa78485efd6` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:04:40.961415 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2599bed0-8b23-4df2-abeb-866ba5d0ce14 None admin] RBAC: Authorizing `identity:get_project(project_id=7740af15b5d042159d47baa78485efd6)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:04:40.962832 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2599bed0-8b23-4df2-abeb-866ba5d0ce14 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:04:40.964524 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 604/1199] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Mar 30 07:04:40 2022] GET /identity/v3/projects/7740af15b5d042159d47baa78485efd6 => generated 361 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:04:40.970979 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cac497-f5db-4ef2-a613-b8a3a362089b None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:04:41.068726 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cac497-f5db-4ef2-a613-b8a3a362089b None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:04:41.102560 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0de42d-8ca7-474b-827b-2cca1ad82e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:04:41.103190 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0de42d-8ca7-474b-827b-2cca1ad82e9b None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:04:41.103472 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0de42d-8ca7-474b-827b-2cca1ad82e9b None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:04:41.103738 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0de42d-8ca7-474b-827b-2cca1ad82e9b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:04:41.104584 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0de42d-8ca7-474b-827b-2cca1ad82e9b None admin] RBAC: Adding query filter params (role.id=1c39b9ab8cfd4c0ea71845831920a845, scope.project.id=7740af15b5d042159d47baa78485efd6, user.id=32d1c524baa2454f83145a53d29d5d80) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:04:41.104886 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0de42d-8ca7-474b-827b-2cca1ad82e9b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:04:41.106303 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0de42d-8ca7-474b-827b-2cca1ad82e9b None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:04:41.112454 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 596/1200] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Mar 30 07:04:40 2022] GET /identity/v3/role_assignments?user.id=32d1c524baa2454f83145a53d29d5d80&scope.project.id=7740af15b5d042159d47baa78485efd6&role.id=1c39b9ab8cfd4c0ea71845831920a845 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:05:42.754538 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c4673-69c7-47cd-b445-10abf2419896 None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:05:42.754538 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c4673-69c7-47cd-b445-10abf2419896 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:05:42.754538 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c4673-69c7-47cd-b445-10abf2419896 None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:05:42.754538 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 605/1201] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:05:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:05:42.761808 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbdab4b-a93c-4d1b-bc8b-30c8a900a054 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:05:42.762336 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbdab4b-a93c-4d1b-bc8b-30c8a900a054 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:05:42.762472 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbdab4b-a93c-4d1b-bc8b-30c8a900a054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:05:42.784290 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-dcbdab4b-a93c-4d1b-bc8b-30c8a900a054 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:05:42.785752 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-dcbdab4b-a93c-4d1b-bc8b-30c8a900a054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:05:42.865884 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 597/1202] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:05:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 30 07:05:42.890252 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4c4673-69c7-47cd-b445-10abf2419896 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:05:43.007345 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4c4673-69c7-47cd-b445-10abf2419896 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:05:43.049827 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e782f07-5134-4ad7-b8d6-672ec4ce9366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:05:43.050778 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e782f07-5134-4ad7-b8d6-672ec4ce9366 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:05:43.051118 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e782f07-5134-4ad7-b8d6-672ec4ce9366 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:05:43.051464 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e782f07-5134-4ad7-b8d6-672ec4ce9366 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:05:43.062824 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e782f07-5134-4ad7-b8d6-672ec4ce9366 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:05:43.064521 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e782f07-5134-4ad7-b8d6-672ec4ce9366 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:05:43.083547 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-4e782f07-5134-4ad7-b8d6-672ec4ce9366 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 07:05:43.084902 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 606/1203] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:05:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 07:05:43.091446 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbdab4b-a93c-4d1b-bc8b-30c8a900a054 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:05:43.211175 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbdab4b-a93c-4d1b-bc8b-30c8a900a054 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:05:43.249403 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fbfdf4-adc2-4318-9323-a061c890567e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:05:43.250005 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fbfdf4-adc2-4318-9323-a061c890567e None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:05:43.250319 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fbfdf4-adc2-4318-9323-a061c890567e None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:05:43.250623 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fbfdf4-adc2-4318-9323-a061c890567e None admin] PATH_INFO: `/v3/domains` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:05:43.251461 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fbfdf4-adc2-4318-9323-a061c890567e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:05:43.251763 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fbfdf4-adc2-4318-9323-a061c890567e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:05:43.253381 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fbfdf4-adc2-4318-9323-a061c890567e None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:05:43.271457 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 598/1204] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Mar 30 07:05:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:05:43.277305 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e782f07-5134-4ad7-b8d6-672ec4ce9366 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:05:43.387315 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e782f07-5134-4ad7-b8d6-672ec4ce9366 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:05:43.423285 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe83491-1718-4017-981d-d640d54d770a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:05:43.423996 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe83491-1718-4017-981d-d640d54d770a None admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:05:43.424305 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe83491-1718-4017-981d-d640d54d770a None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:05:43.424616 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe83491-1718-4017-981d-d640d54d770a None admin] PATH_INFO: `/v3/users` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:05:43.425750 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe83491-1718-4017-981d-d640d54d770a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:05:43.427284 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe83491-1718-4017-981d-d640d54d770a None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:05:43.453382 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 607/1205] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Mar 30 07:05:43 2022] POST /identity/v3/users => generated 251 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 07:05:45.892301 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596aaaf5-0106-4c39-8ca2-f60d158dbfa7 None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:05:45.892909 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596aaaf5-0106-4c39-8ca2-f60d158dbfa7 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:05:45.892909 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596aaaf5-0106-4c39-8ca2-f60d158dbfa7 None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:05:45.895245 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 599/1206] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:05:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:05:45.900759 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef4169d-b04d-4d07-bb14-b7674e3d5a33 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:05:45.901218 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef4169d-b04d-4d07-bb14-b7674e3d5a33 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:05:45.901327 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef4169d-b04d-4d07-bb14-b7674e3d5a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:05:45.920516 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-2ef4169d-b04d-4d07-bb14-b7674e3d5a33 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:05:45.921982 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-2ef4169d-b04d-4d07-bb14-b7674e3d5a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:05:45.998759 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 608/1207] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:05:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 30 07:05:46.024848 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596aaaf5-0106-4c39-8ca2-f60d158dbfa7 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:05:46.132691 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596aaaf5-0106-4c39-8ca2-f60d158dbfa7 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:05:46.171221 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb194aa-e0aa-4d47-89e2-d2b88cfdf95e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:05:46.171996 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb194aa-e0aa-4d47-89e2-d2b88cfdf95e None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:05:46.172334 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb194aa-e0aa-4d47-89e2-d2b88cfdf95e None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:05:46.172608 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb194aa-e0aa-4d47-89e2-d2b88cfdf95e None admin] PATH_INFO: `/v3/roles/service` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:05:46.183966 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb194aa-e0aa-4d47-89e2-d2b88cfdf95e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 07:05:46.191380 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-fdb194aa-e0aa-4d47-89e2-d2b88cfdf95e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 30 07:05:46.192877 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 600/1208] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Mar 30 07:05:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:05:46.198967 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef4169d-b04d-4d07-bb14-b7674e3d5a33 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:05:46.302853 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef4169d-b04d-4d07-bb14-b7674e3d5a33 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:05:46.339068 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5645ade8-78a9-4dbe-a0c1-683a3f1fc1ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:05:46.339746 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5645ade8-78a9-4dbe-a0c1-683a3f1fc1ce None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:05:46.340055 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5645ade8-78a9-4dbe-a0c1-683a3f1fc1ce None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:05:46.340325 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5645ade8-78a9-4dbe-a0c1-683a3f1fc1ce None admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:05:46.341080 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5645ade8-78a9-4dbe-a0c1-683a3f1fc1ce None admin] RBAC: Adding query filter params (name=service) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:05:46.341380 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5645ade8-78a9-4dbe-a0c1-683a3f1fc1ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:05:46.342750 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5645ade8-78a9-4dbe-a0c1-683a3f1fc1ce None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:05:46.352065 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 609/1209] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Mar 30 07:05:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:05:46.357850 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb194aa-e0aa-4d47-89e2-d2b88cfdf95e None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:05:46.474694 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb194aa-e0aa-4d47-89e2-d2b88cfdf95e None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:05:46.515277 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6489a889-d499-499f-8808-9d7ac6d9744a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:05:46.516232 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6489a889-d499-499f-8808-9d7ac6d9744a None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:05:46.516514 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6489a889-d499-499f-8808-9d7ac6d9744a None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:05:46.516879 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6489a889-d499-499f-8808-9d7ac6d9744a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:05:46.532226 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6489a889-d499-499f-8808-9d7ac6d9744a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:05:46.533735 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6489a889-d499-499f-8808-9d7ac6d9744a None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:05:46.552031 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-6489a889-d499-499f-8808-9d7ac6d9744a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 07:05:46.553347 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 601/1210] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:05:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:05:46.562467 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5645ade8-78a9-4dbe-a0c1-683a3f1fc1ce None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:05:46.667092 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5645ade8-78a9-4dbe-a0c1-683a3f1fc1ce None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:05:46.701991 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd83965-9d1c-4313-91bc-6171db176413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:05:46.702681 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd83965-9d1c-4313-91bc-6171db176413 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:05:46.703035 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd83965-9d1c-4313-91bc-6171db176413 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:05:46.703307 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd83965-9d1c-4313-91bc-6171db176413 None admin] PATH_INFO: `/v3/domains` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:05:46.704123 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd83965-9d1c-4313-91bc-6171db176413 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:05:46.704454 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd83965-9d1c-4313-91bc-6171db176413 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:05:46.707765 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd83965-9d1c-4313-91bc-6171db176413 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:05:46.720485 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 610/1211] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Mar 30 07:05:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:05:46.726583 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6489a889-d499-499f-8808-9d7ac6d9744a None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:05:46.834928 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6489a889-d499-499f-8808-9d7ac6d9744a None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:05:46.872361 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fda3973-2dbf-4aa1-ba22-d2a86480e08f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:05:46.873308 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fda3973-2dbf-4aa1-ba22-d2a86480e08f None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:05:46.873586 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fda3973-2dbf-4aa1-ba22-d2a86480e08f None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:05:46.873889 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fda3973-2dbf-4aa1-ba22-d2a86480e08f None admin] PATH_INFO: `/v3/users/placement` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:05:46.882704 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fda3973-2dbf-4aa1-ba22-d2a86480e08f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:05:46.884464 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fda3973-2dbf-4aa1-ba22-d2a86480e08f None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:05:46.900547 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-5fda3973-2dbf-4aa1-ba22-d2a86480e08f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Mar 30 07:05:46.901897 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 602/1212] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:05:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:05:46.907980 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd83965-9d1c-4313-91bc-6171db176413 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:05:47.018143 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd83965-9d1c-4313-91bc-6171db176413 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:05:47.053566 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7536bf97-b7b8-44d0-881b-95aac3c5d65c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:05:47.054560 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7536bf97-b7b8-44d0-881b-95aac3c5d65c None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:05:47.054865 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7536bf97-b7b8-44d0-881b-95aac3c5d65c None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:05:47.055155 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7536bf97-b7b8-44d0-881b-95aac3c5d65c None admin] PATH_INFO: `/v3/users` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:05:47.056099 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7536bf97-b7b8-44d0-881b-95aac3c5d65c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:05:47.056413 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7536bf97-b7b8-44d0-881b-95aac3c5d65c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:05:47.057976 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7536bf97-b7b8-44d0-881b-95aac3c5d65c None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:05:47.076787 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 611/1213] 10.222.0.20 () {56 vars in 1143 bytes} [Wed Mar 30 07:05:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:05:47.083050 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fda3973-2dbf-4aa1-ba22-d2a86480e08f None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:05:47.189042 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fda3973-2dbf-4aa1-ba22-d2a86480e08f None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:05:47.227014 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36b6676-e7a6-4970-a8f3-7fd1882078bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:05:47.227667 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36b6676-e7a6-4970-a8f3-7fd1882078bd None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:05:47.227977 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36b6676-e7a6-4970-a8f3-7fd1882078bd None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:05:47.228256 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36b6676-e7a6-4970-a8f3-7fd1882078bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:05:47.303610 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36b6676-e7a6-4970-a8f3-7fd1882078bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:05:47.305672 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36b6676-e7a6-4970-a8f3-7fd1882078bd None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:05:47.415952 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 603/1214] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Mar 30 07:05:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 30 07:05:47.422313 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7536bf97-b7b8-44d0-881b-95aac3c5d65c None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:05:47.531122 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7536bf97-b7b8-44d0-881b-95aac3c5d65c None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:05:47.569886 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2560928-4f73-452e-8b29-f16624bc5d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:05:47.569886 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2560928-4f73-452e-8b29-f16624bc5d55 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:05:47.569886 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2560928-4f73-452e-8b29-f16624bc5d55 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:05:47.570269 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2560928-4f73-452e-8b29-f16624bc5d55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:05:47.581095 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2560928-4f73-452e-8b29-f16624bc5d55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:05:47.583151 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2560928-4f73-452e-8b29-f16624bc5d55 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:05:47.603156 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-f2560928-4f73-452e-8b29-f16624bc5d55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 07:05:47.604747 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 612/1215] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:05:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:05:47.615662 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36b6676-e7a6-4970-a8f3-7fd1882078bd None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:05:47.725792 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36b6676-e7a6-4970-a8f3-7fd1882078bd None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:05:47.766752 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7022e88b-f5f7-4468-b294-2e32daf270d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:05:47.767483 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022e88b-f5f7-4468-b294-2e32daf270d4 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:05:47.767749 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022e88b-f5f7-4468-b294-2e32daf270d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:05:47.768051 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022e88b-f5f7-4468-b294-2e32daf270d4 None admin] PATH_INFO: `/v3/domains` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:05:47.768911 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7022e88b-f5f7-4468-b294-2e32daf270d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:05:47.769198 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7022e88b-f5f7-4468-b294-2e32daf270d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:05:47.770659 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7022e88b-f5f7-4468-b294-2e32daf270d4 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:05:47.783344 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 604/1216] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Mar 30 07:05:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:05:47.789605 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2560928-4f73-452e-8b29-f16624bc5d55 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:05:47.916986 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2560928-4f73-452e-8b29-f16624bc5d55 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:05:47.953305 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a57fcb-2085-4a17-b13c-993ae55f3ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:05:47.954162 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a57fcb-2085-4a17-b13c-993ae55f3ee3 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:05:47.954513 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a57fcb-2085-4a17-b13c-993ae55f3ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:05:47.955056 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a57fcb-2085-4a17-b13c-993ae55f3ee3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:05:47.962684 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a57fcb-2085-4a17-b13c-993ae55f3ee3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:05:47.964303 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a57fcb-2085-4a17-b13c-993ae55f3ee3 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:05:47.979534 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-68a57fcb-2085-4a17-b13c-993ae55f3ee3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 30 07:05:47.980917 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 613/1217] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Mar 30 07:05:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 07:05:47.988491 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7022e88b-f5f7-4468-b294-2e32daf270d4 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:05:48.099119 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7022e88b-f5f7-4468-b294-2e32daf270d4 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:05:48.136351 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f05019-9c7e-47cc-8a1b-4296702859dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:05:48.137552 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f05019-9c7e-47cc-8a1b-4296702859dd None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:05:48.137881 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f05019-9c7e-47cc-8a1b-4296702859dd None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:05:48.138151 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f05019-9c7e-47cc-8a1b-4296702859dd None admin] PATH_INFO: `/v3/projects` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:05:48.139016 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f05019-9c7e-47cc-8a1b-4296702859dd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:05:48.139318 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f05019-9c7e-47cc-8a1b-4296702859dd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:05:48.141063 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f05019-9c7e-47cc-8a1b-4296702859dd None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:05:48.156280 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 605/1218] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Mar 30 07:05:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:05:48.163735 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a57fcb-2085-4a17-b13c-993ae55f3ee3 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:05:48.274381 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a57fcb-2085-4a17-b13c-993ae55f3ee3 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:05:48.311983 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d7c5ca-726e-4dd1-864d-b1d1829c5c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:05:48.312649 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d7c5ca-726e-4dd1-864d-b1d1829c5c4a None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:05:48.312928 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d7c5ca-726e-4dd1-864d-b1d1829c5c4a None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:05:48.313199 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d7c5ca-726e-4dd1-864d-b1d1829c5c4a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:05:48.314054 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d7c5ca-726e-4dd1-864d-b1d1829c5c4a None admin] RBAC: Adding query filter params (role.id=4848e2a52e0b428997632ab8a8d36e91, scope.project.id=7e4eda4c5cd84307b36a5b48642e816f, user.id=d634743546e8456fac2f6ab1aaee09ef) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:05:48.314358 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d7c5ca-726e-4dd1-864d-b1d1829c5c4a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:05:48.316094 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d7c5ca-726e-4dd1-864d-b1d1829c5c4a None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:05:48.321567 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 614/1219] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Mar 30 07:05:48 2022] GET /identity/v3/role_assignments?user.id=d634743546e8456fac2f6ab1aaee09ef&scope.project.id=7e4eda4c5cd84307b36a5b48642e816f&role.id=4848e2a52e0b428997632ab8a8d36e91 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:05:50.743257 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f7a969-9bef-459f-9ee5-aa71c206a2a6 None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:05:50.744075 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f7a969-9bef-459f-9ee5-aa71c206a2a6 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:05:50.744075 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f7a969-9bef-459f-9ee5-aa71c206a2a6 None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:05:50.745616 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 606/1220] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:05:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 30 07:05:50.751152 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b29a810-bef3-4789-b593-9c52a9901ad3 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:05:50.751622 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b29a810-bef3-4789-b593-9c52a9901ad3 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:05:50.751722 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b29a810-bef3-4789-b593-9c52a9901ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:05:50.769791 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-2b29a810-bef3-4789-b593-9c52a9901ad3 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:05:50.770996 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-2b29a810-bef3-4789-b593-9c52a9901ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:05:50.844305 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 615/1221] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:05:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 30 07:05:50.868261 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f7a969-9bef-459f-9ee5-aa71c206a2a6 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:05:50.981179 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f7a969-9bef-459f-9ee5-aa71c206a2a6 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:05:51.014491 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f591a7-8e59-4ae5-ae8a-7de6c4b8472a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:05:51.015216 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f591a7-8e59-4ae5-ae8a-7de6c4b8472a None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:05:51.015541 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f591a7-8e59-4ae5-ae8a-7de6c4b8472a None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:05:51.015765 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f591a7-8e59-4ae5-ae8a-7de6c4b8472a None admin] PATH_INFO: `/v3/roles/service` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:05:51.027519 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f591a7-8e59-4ae5-ae8a-7de6c4b8472a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 07:05:51.035530 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-03f591a7-8e59-4ae5-ae8a-7de6c4b8472a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 30 07:05:51.037007 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 607/1222] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Mar 30 07:05:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:05:51.043934 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b29a810-bef3-4789-b593-9c52a9901ad3 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:05:51.148488 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b29a810-bef3-4789-b593-9c52a9901ad3 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:05:51.187034 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3cdafa-5e9b-43a9-aa9b-c3ca4e535539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:05:51.188101 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3cdafa-5e9b-43a9-aa9b-c3ca4e535539 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:05:51.188441 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3cdafa-5e9b-43a9-aa9b-c3ca4e535539 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:05:51.188785 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3cdafa-5e9b-43a9-aa9b-c3ca4e535539 None admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:05:51.189952 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3cdafa-5e9b-43a9-aa9b-c3ca4e535539 None admin] RBAC: Adding query filter params (name=service) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:05:51.190340 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3cdafa-5e9b-43a9-aa9b-c3ca4e535539 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:05:51.192973 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3cdafa-5e9b-43a9-aa9b-c3ca4e535539 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:05:51.203695 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 616/1223] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Mar 30 07:05:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:05:51.209932 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f591a7-8e59-4ae5-ae8a-7de6c4b8472a None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:05:51.317405 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f591a7-8e59-4ae5-ae8a-7de6c4b8472a None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:05:51.353216 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfdd706-65f4-4641-a214-a1c78effedeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:05:51.354304 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfdd706-65f4-4641-a214-a1c78effedeb None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:05:51.354580 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfdd706-65f4-4641-a214-a1c78effedeb None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:05:51.354852 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfdd706-65f4-4641-a214-a1c78effedeb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:05:51.366309 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfdd706-65f4-4641-a214-a1c78effedeb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:05:51.367764 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfdd706-65f4-4641-a214-a1c78effedeb None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:05:51.386065 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-2dfdd706-65f4-4641-a214-a1c78effedeb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 07:05:51.387294 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 608/1224] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:05:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 07:05:51.394730 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3cdafa-5e9b-43a9-aa9b-c3ca4e535539 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:05:51.503601 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3cdafa-5e9b-43a9-aa9b-c3ca4e535539 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:05:51.539618 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d19af8e-397d-4e25-a106-faffb52560e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:05:51.540465 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d19af8e-397d-4e25-a106-faffb52560e1 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:05:51.540741 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d19af8e-397d-4e25-a106-faffb52560e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:05:51.541011 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d19af8e-397d-4e25-a106-faffb52560e1 None admin] PATH_INFO: `/v3/domains` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:05:51.541984 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d19af8e-397d-4e25-a106-faffb52560e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:05:51.542401 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d19af8e-397d-4e25-a106-faffb52560e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:05:51.544319 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d19af8e-397d-4e25-a106-faffb52560e1 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:05:51.558823 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 617/1225] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Mar 30 07:05:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:05:51.564702 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfdd706-65f4-4641-a214-a1c78effedeb None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:05:51.679509 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfdd706-65f4-4641-a214-a1c78effedeb None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:05:51.718428 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f47eb9-89b9-4fb1-9429-427fdb684684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:05:51.719231 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f47eb9-89b9-4fb1-9429-427fdb684684 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:05:51.719502 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f47eb9-89b9-4fb1-9429-427fdb684684 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:05:51.719788 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f47eb9-89b9-4fb1-9429-427fdb684684 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:05:51.727964 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f47eb9-89b9-4fb1-9429-427fdb684684 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:05:51.729395 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f47eb9-89b9-4fb1-9429-427fdb684684 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:05:51.743953 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-69f47eb9-89b9-4fb1-9429-427fdb684684 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Mar 30 07:05:51.745219 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 609/1226] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:05:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 07:05:51.752087 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d19af8e-397d-4e25-a106-faffb52560e1 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:05:51.858919 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d19af8e-397d-4e25-a106-faffb52560e1 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:05:51.895578 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865747b5-84df-4a1e-941e-201414706ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:05:51.896444 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865747b5-84df-4a1e-941e-201414706ef6 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:05:51.896747 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865747b5-84df-4a1e-941e-201414706ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:05:51.897191 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865747b5-84df-4a1e-941e-201414706ef6 None admin] PATH_INFO: `/v3/users` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:05:51.898096 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865747b5-84df-4a1e-941e-201414706ef6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:05:51.898497 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865747b5-84df-4a1e-941e-201414706ef6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:05:51.900196 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865747b5-84df-4a1e-941e-201414706ef6 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:05:51.919027 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 618/1227] 10.222.0.20 () {56 vars in 1143 bytes} [Wed Mar 30 07:05:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:05:51.925057 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f47eb9-89b9-4fb1-9429-427fdb684684 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:05:52.043883 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f47eb9-89b9-4fb1-9429-427fdb684684 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:05:52.080891 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d19d3b-ab01-4fec-bed7-6c35f45adac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:05:52.082146 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d19d3b-ab01-4fec-bed7-6c35f45adac2 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:05:52.082433 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d19d3b-ab01-4fec-bed7-6c35f45adac2 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:05:52.082757 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d19d3b-ab01-4fec-bed7-6c35f45adac2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:05:52.093793 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d19d3b-ab01-4fec-bed7-6c35f45adac2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:05:52.095356 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d19d3b-ab01-4fec-bed7-6c35f45adac2 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:05:52.112943 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-a5d19d3b-ab01-4fec-bed7-6c35f45adac2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 07:05:52.114332 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 610/1228] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:05:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:05:52.120125 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865747b5-84df-4a1e-941e-201414706ef6 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:05:52.231573 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865747b5-84df-4a1e-941e-201414706ef6 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:05:52.268581 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a08739-4385-43ef-bf36-935f9ccb2803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:05:52.269382 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a08739-4385-43ef-bf36-935f9ccb2803 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:05:52.269772 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a08739-4385-43ef-bf36-935f9ccb2803 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:05:52.270159 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a08739-4385-43ef-bf36-935f9ccb2803 None admin] PATH_INFO: `/v3/domains` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:05:52.270901 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a08739-4385-43ef-bf36-935f9ccb2803 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:05:52.271291 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a08739-4385-43ef-bf36-935f9ccb2803 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:05:52.273197 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a08739-4385-43ef-bf36-935f9ccb2803 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:05:52.286525 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 619/1229] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Mar 30 07:05:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:05:52.292875 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d19d3b-ab01-4fec-bed7-6c35f45adac2 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:05:52.403195 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d19d3b-ab01-4fec-bed7-6c35f45adac2 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:05:52.443236 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c7589d-ddeb-4d38-8d92-e9cd2cb55884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:05:52.444279 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c7589d-ddeb-4d38-8d92-e9cd2cb55884 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:05:52.444562 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c7589d-ddeb-4d38-8d92-e9cd2cb55884 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:05:52.444899 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c7589d-ddeb-4d38-8d92-e9cd2cb55884 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:05:52.452243 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c7589d-ddeb-4d38-8d92-e9cd2cb55884 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:05:52.453702 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c7589d-ddeb-4d38-8d92-e9cd2cb55884 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:05:52.467674 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-e0c7589d-ddeb-4d38-8d92-e9cd2cb55884 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 30 07:05:52.469058 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 611/1230] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Mar 30 07:05:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:05:52.476159 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a08739-4385-43ef-bf36-935f9ccb2803 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:05:52.589192 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a08739-4385-43ef-bf36-935f9ccb2803 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:05:52.632694 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a112b0a2-c1d5-4106-8ae8-47319d11e862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:05:52.633731 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a112b0a2-c1d5-4106-8ae8-47319d11e862 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:05:52.634039 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a112b0a2-c1d5-4106-8ae8-47319d11e862 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:05:52.634607 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a112b0a2-c1d5-4106-8ae8-47319d11e862 None admin] PATH_INFO: `/v3/projects` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:05:52.635607 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a112b0a2-c1d5-4106-8ae8-47319d11e862 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:05:52.635957 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a112b0a2-c1d5-4106-8ae8-47319d11e862 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:05:52.637776 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a112b0a2-c1d5-4106-8ae8-47319d11e862 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:05:52.655354 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 620/1231] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Mar 30 07:05:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:05:52.661512 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c7589d-ddeb-4d38-8d92-e9cd2cb55884 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:05:52.772528 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c7589d-ddeb-4d38-8d92-e9cd2cb55884 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:05:52.810180 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c368db-430c-4911-b8e0-4dfade56d98a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:05:52.811076 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c368db-430c-4911-b8e0-4dfade56d98a None admin] REQUEST_METHOD: `PUT` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:05:52.811356 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c368db-430c-4911-b8e0-4dfade56d98a None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:05:52.811625 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c368db-430c-4911-b8e0-4dfade56d98a None admin] PATH_INFO: `/v3/projects/7e4eda4c5cd84307b36a5b48642e816f/users/d634743546e8456fac2f6ab1aaee09ef/roles/4848e2a52e0b428997632ab8a8d36e91` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:05:52.828110 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c368db-430c-4911-b8e0-4dfade56d98a None admin] RBAC: Authorizing `identity:create_grant(project_id=7e4eda4c5cd84307b36a5b48642e816f, user_id=d634743546e8456fac2f6ab1aaee09ef, role_id=4848e2a52e0b428997632ab8a8d36e91)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:05:52.829693 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c368db-430c-4911-b8e0-4dfade56d98a None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:05:52.842867 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 612/1232] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Mar 30 07:05:52 2022] PUT /identity/v3/projects/7e4eda4c5cd84307b36a5b48642e816f/users/d634743546e8456fac2f6ab1aaee09ef/roles/4848e2a52e0b428997632ab8a8d36e91 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:05:55.242083 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbef80ff-c694-452a-9d5e-5740bb6268c6 None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:05:55.242662 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbef80ff-c694-452a-9d5e-5740bb6268c6 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:05:55.242926 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbef80ff-c694-452a-9d5e-5740bb6268c6 None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:05:55.245272 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 621/1233] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:05:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:05:55.251540 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f040225-d519-498c-87b6-e1e9bdfc257f None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:05:55.252032 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f040225-d519-498c-87b6-e1e9bdfc257f None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:05:55.252140 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f040225-d519-498c-87b6-e1e9bdfc257f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:05:55.269368 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-5f040225-d519-498c-87b6-e1e9bdfc257f None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:05:55.270646 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-5f040225-d519-498c-87b6-e1e9bdfc257f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:05:55.339258 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 613/1234] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:05:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 30 07:05:55.364013 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbef80ff-c694-452a-9d5e-5740bb6268c6 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:05:55.474829 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbef80ff-c694-452a-9d5e-5740bb6268c6 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:05:55.509326 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f19656-43fc-45ad-87f7-17f8be4412c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:05:55.510138 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f19656-43fc-45ad-87f7-17f8be4412c6 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:05:55.510421 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f19656-43fc-45ad-87f7-17f8be4412c6 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:05:55.510702 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f19656-43fc-45ad-87f7-17f8be4412c6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:05:55.520851 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f19656-43fc-45ad-87f7-17f8be4412c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 07:05:55.527844 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-65f19656-43fc-45ad-87f7-17f8be4412c6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 30 07:05:55.529174 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 622/1235] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Mar 30 07:05:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 07:05:55.536025 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f040225-d519-498c-87b6-e1e9bdfc257f None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:05:55.648486 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f040225-d519-498c-87b6-e1e9bdfc257f None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:05:55.683590 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea5d85c-f819-4aa9-9b2d-5965833e8217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:05:55.684293 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea5d85c-f819-4aa9-9b2d-5965833e8217 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:05:55.684570 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea5d85c-f819-4aa9-9b2d-5965833e8217 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:05:55.684841 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea5d85c-f819-4aa9-9b2d-5965833e8217 None admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:05:55.685598 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea5d85c-f819-4aa9-9b2d-5965833e8217 None admin] RBAC: Adding query filter params (name=service) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:05:55.685887 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea5d85c-f819-4aa9-9b2d-5965833e8217 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:05:55.687263 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea5d85c-f819-4aa9-9b2d-5965833e8217 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:05:55.696344 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 614/1236] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Mar 30 07:05:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:05:55.702158 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f19656-43fc-45ad-87f7-17f8be4412c6 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:05:55.810785 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f19656-43fc-45ad-87f7-17f8be4412c6 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:05:55.847434 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a60368-e191-4f86-89b1-94e9cebd06c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:05:55.848414 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a60368-e191-4f86-89b1-94e9cebd06c9 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:05:55.848695 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a60368-e191-4f86-89b1-94e9cebd06c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:05:55.849045 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a60368-e191-4f86-89b1-94e9cebd06c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:05:55.861390 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a60368-e191-4f86-89b1-94e9cebd06c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:05:55.863199 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a60368-e191-4f86-89b1-94e9cebd06c9 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:05:55.880393 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-56a60368-e191-4f86-89b1-94e9cebd06c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 07:05:55.886417 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 623/1237] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:05:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:05:55.887737 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea5d85c-f819-4aa9-9b2d-5965833e8217 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:05:55.992329 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea5d85c-f819-4aa9-9b2d-5965833e8217 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:05:56.027486 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f675214-1254-43e5-bd54-d03dbe497a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:05:56.028257 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f675214-1254-43e5-bd54-d03dbe497a46 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:05:56.028533 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f675214-1254-43e5-bd54-d03dbe497a46 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:05:56.028802 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f675214-1254-43e5-bd54-d03dbe497a46 None admin] PATH_INFO: `/v3/domains` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:05:56.029514 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f675214-1254-43e5-bd54-d03dbe497a46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:05:56.029814 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f675214-1254-43e5-bd54-d03dbe497a46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:05:56.031305 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f675214-1254-43e5-bd54-d03dbe497a46 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:05:56.043783 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 615/1238] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Mar 30 07:05:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:05:56.050087 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a60368-e191-4f86-89b1-94e9cebd06c9 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:05:56.161557 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a60368-e191-4f86-89b1-94e9cebd06c9 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:05:56.197107 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922244b3-fde7-4b98-a1b4-e3d8ad17cf06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:05:56.198075 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922244b3-fde7-4b98-a1b4-e3d8ad17cf06 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:05:56.198387 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922244b3-fde7-4b98-a1b4-e3d8ad17cf06 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:05:56.198683 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922244b3-fde7-4b98-a1b4-e3d8ad17cf06 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:05:56.207132 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922244b3-fde7-4b98-a1b4-e3d8ad17cf06 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:05:56.208878 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922244b3-fde7-4b98-a1b4-e3d8ad17cf06 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:05:56.223526 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-922244b3-fde7-4b98-a1b4-e3d8ad17cf06 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Mar 30 07:05:56.224865 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 624/1239] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:05:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 07:05:56.231249 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f675214-1254-43e5-bd54-d03dbe497a46 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:05:56.334331 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f675214-1254-43e5-bd54-d03dbe497a46 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:05:56.370562 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080098df-fb84-4bef-9672-08a29bd4f8a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:05:56.371337 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080098df-fb84-4bef-9672-08a29bd4f8a8 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:05:56.371591 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080098df-fb84-4bef-9672-08a29bd4f8a8 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:05:56.372069 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080098df-fb84-4bef-9672-08a29bd4f8a8 None admin] PATH_INFO: `/v3/users` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:05:56.373023 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080098df-fb84-4bef-9672-08a29bd4f8a8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:05:56.373403 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080098df-fb84-4bef-9672-08a29bd4f8a8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:05:56.374918 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080098df-fb84-4bef-9672-08a29bd4f8a8 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:05:56.394539 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 616/1240] 10.222.0.20 () {56 vars in 1143 bytes} [Wed Mar 30 07:05:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:05:56.400891 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922244b3-fde7-4b98-a1b4-e3d8ad17cf06 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:05:56.506746 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922244b3-fde7-4b98-a1b4-e3d8ad17cf06 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:05:56.540540 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44a8e41-76e6-4e7f-96fe-b181c9f43ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:05:56.541190 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44a8e41-76e6-4e7f-96fe-b181c9f43ca4 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:05:56.541467 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44a8e41-76e6-4e7f-96fe-b181c9f43ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:05:56.541737 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44a8e41-76e6-4e7f-96fe-b181c9f43ca4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:05:56.614720 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44a8e41-76e6-4e7f-96fe-b181c9f43ca4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:05:56.616872 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44a8e41-76e6-4e7f-96fe-b181c9f43ca4 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:05:56.724582 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 625/1241] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Mar 30 07:05:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 30 07:05:56.731105 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080098df-fb84-4bef-9672-08a29bd4f8a8 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:05:56.836292 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080098df-fb84-4bef-9672-08a29bd4f8a8 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:05:56.870016 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7911b9a5-4ef6-4b24-adaf-d9f8ec0c9328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:05:56.870904 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7911b9a5-4ef6-4b24-adaf-d9f8ec0c9328 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:05:56.871183 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7911b9a5-4ef6-4b24-adaf-d9f8ec0c9328 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:05:56.871454 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7911b9a5-4ef6-4b24-adaf-d9f8ec0c9328 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:05:56.883151 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7911b9a5-4ef6-4b24-adaf-d9f8ec0c9328 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:05:56.884877 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7911b9a5-4ef6-4b24-adaf-d9f8ec0c9328 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:05:56.911361 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-7911b9a5-4ef6-4b24-adaf-d9f8ec0c9328 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 07:05:56.912836 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 617/1242] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:05:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 07:05:56.918740 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44a8e41-76e6-4e7f-96fe-b181c9f43ca4 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:05:57.025232 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44a8e41-76e6-4e7f-96fe-b181c9f43ca4 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:05:57.063825 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78f82c3-0a1e-4988-9685-1a1af40a0cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:05:57.064523 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f82c3-0a1e-4988-9685-1a1af40a0cca None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:05:57.064803 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f82c3-0a1e-4988-9685-1a1af40a0cca None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:05:57.065148 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f82c3-0a1e-4988-9685-1a1af40a0cca None admin] PATH_INFO: `/v3/domains` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:05:57.066338 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78f82c3-0a1e-4988-9685-1a1af40a0cca None admin] RBAC: Adding query filter params (name=Default) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:05:57.066818 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78f82c3-0a1e-4988-9685-1a1af40a0cca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:05:57.068576 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78f82c3-0a1e-4988-9685-1a1af40a0cca None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:05:57.082512 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 626/1243] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Mar 30 07:05:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:05:57.088702 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7911b9a5-4ef6-4b24-adaf-d9f8ec0c9328 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:05:57.197439 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7911b9a5-4ef6-4b24-adaf-d9f8ec0c9328 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:05:57.236511 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ff7e00-52bd-4a3e-a8f6-feb4c7e4e15b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:05:57.237646 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ff7e00-52bd-4a3e-a8f6-feb4c7e4e15b None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:05:57.237979 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ff7e00-52bd-4a3e-a8f6-feb4c7e4e15b None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:05:57.238321 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ff7e00-52bd-4a3e-a8f6-feb4c7e4e15b None admin] PATH_INFO: `/v3/projects/service` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:05:57.246506 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ff7e00-52bd-4a3e-a8f6-feb4c7e4e15b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:05:57.248127 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ff7e00-52bd-4a3e-a8f6-feb4c7e4e15b None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:05:57.262509 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-36ff7e00-52bd-4a3e-a8f6-feb4c7e4e15b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 30 07:05:57.263858 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 618/1244] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Mar 30 07:05:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:05:57.270187 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78f82c3-0a1e-4988-9685-1a1af40a0cca None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:05:57.377217 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78f82c3-0a1e-4988-9685-1a1af40a0cca None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:05:57.413842 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b75860-d72a-4115-9ba6-a4ca675fb67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:05:57.414566 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b75860-d72a-4115-9ba6-a4ca675fb67b None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:05:57.414810 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b75860-d72a-4115-9ba6-a4ca675fb67b None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:05:57.415120 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b75860-d72a-4115-9ba6-a4ca675fb67b None admin] PATH_INFO: `/v3/projects` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:05:57.415942 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b75860-d72a-4115-9ba6-a4ca675fb67b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:05:57.416287 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b75860-d72a-4115-9ba6-a4ca675fb67b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:05:57.417688 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b75860-d72a-4115-9ba6-a4ca675fb67b None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:05:57.429782 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 627/1245] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Mar 30 07:05:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:05:57.436067 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ff7e00-52bd-4a3e-a8f6-feb4c7e4e15b None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:05:57.546246 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ff7e00-52bd-4a3e-a8f6-feb4c7e4e15b None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:05:57.579185 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549da42b-38e9-4420-b7db-a61a85f4094c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:05:57.579873 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549da42b-38e9-4420-b7db-a61a85f4094c None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:05:57.580155 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549da42b-38e9-4420-b7db-a61a85f4094c None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:05:57.580430 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549da42b-38e9-4420-b7db-a61a85f4094c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:05:57.581295 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549da42b-38e9-4420-b7db-a61a85f4094c None admin] RBAC: Adding query filter params (role.id=4848e2a52e0b428997632ab8a8d36e91, scope.project.id=7e4eda4c5cd84307b36a5b48642e816f, user.id=d634743546e8456fac2f6ab1aaee09ef) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:05:57.581609 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549da42b-38e9-4420-b7db-a61a85f4094c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:05:57.583043 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549da42b-38e9-4420-b7db-a61a85f4094c None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:05:57.589610 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 619/1246] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Mar 30 07:05:57 2022] GET /identity/v3/role_assignments?user.id=d634743546e8456fac2f6ab1aaee09ef&scope.project.id=7e4eda4c5cd84307b36a5b48642e816f&role.id=4848e2a52e0b428997632ab8a8d36e91 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:06:00.071380 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4583837d-d1d1-419f-be08-267a073e6e7d None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:06:00.072003 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4583837d-d1d1-419f-be08-267a073e6e7d None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:06:00.072003 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4583837d-d1d1-419f-be08-267a073e6e7d None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:06:00.074196 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 628/1247] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:06:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:06:00.079939 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f7d156-410a-4384-9acf-13613cfc6575 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:06:00.080450 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f7d156-410a-4384-9acf-13613cfc6575 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:06:00.080586 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f7d156-410a-4384-9acf-13613cfc6575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:06:00.101449 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-77f7d156-410a-4384-9acf-13613cfc6575 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:06:00.102809 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-77f7d156-410a-4384-9acf-13613cfc6575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:06:00.180319 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 620/1248] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:06:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 30 07:06:00.208610 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4583837d-d1d1-419f-be08-267a073e6e7d None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:06:00.325165 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4583837d-d1d1-419f-be08-267a073e6e7d None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:06:00.366703 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c33cb5-1c37-4187-8b5f-de76ec50b4ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:06:00.367614 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c33cb5-1c37-4187-8b5f-de76ec50b4ce None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:06:00.367984 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c33cb5-1c37-4187-8b5f-de76ec50b4ce None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:06:00.368276 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c33cb5-1c37-4187-8b5f-de76ec50b4ce None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:06:00.380216 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c33cb5-1c37-4187-8b5f-de76ec50b4ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 07:06:00.387769 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-e2c33cb5-1c37-4187-8b5f-de76ec50b4ce None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 30 07:06:00.389914 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 629/1249] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Mar 30 07:06:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:06:00.396264 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f7d156-410a-4384-9acf-13613cfc6575 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:06:00.502635 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f7d156-410a-4384-9acf-13613cfc6575 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:06:00.538185 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84991c9-3a00-4532-961c-910d87a1b946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:06:00.538862 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84991c9-3a00-4532-961c-910d87a1b946 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:06:00.539141 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84991c9-3a00-4532-961c-910d87a1b946 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:06:00.539411 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84991c9-3a00-4532-961c-910d87a1b946 None admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:06:00.540210 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84991c9-3a00-4532-961c-910d87a1b946 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:06:00.540482 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84991c9-3a00-4532-961c-910d87a1b946 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:06:00.541860 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84991c9-3a00-4532-961c-910d87a1b946 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:06:00.549891 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 621/1250] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Mar 30 07:06:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:06:00.556132 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c33cb5-1c37-4187-8b5f-de76ec50b4ce None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:06:00.669087 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c33cb5-1c37-4187-8b5f-de76ec50b4ce None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:06:00.709668 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce653451-579b-4666-81f0-597a3db71e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:06:00.710977 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce653451-579b-4666-81f0-597a3db71e2c None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:06:00.711572 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce653451-579b-4666-81f0-597a3db71e2c None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:06:00.712024 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce653451-579b-4666-81f0-597a3db71e2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:06:00.725514 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce653451-579b-4666-81f0-597a3db71e2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:06:00.726953 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce653451-579b-4666-81f0-597a3db71e2c None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:06:00.746633 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-ce653451-579b-4666-81f0-597a3db71e2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 07:06:00.752670 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 630/1251] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:06:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:06:00.754123 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84991c9-3a00-4532-961c-910d87a1b946 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:06:00.869242 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84991c9-3a00-4532-961c-910d87a1b946 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:06:00.904341 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac48c00f-ac06-4520-b6cb-4dcb29a73ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:06:00.905074 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac48c00f-ac06-4520-b6cb-4dcb29a73ce2 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:06:00.905380 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac48c00f-ac06-4520-b6cb-4dcb29a73ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:06:00.905731 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac48c00f-ac06-4520-b6cb-4dcb29a73ce2 None admin] PATH_INFO: `/v3/domains` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:06:00.906528 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac48c00f-ac06-4520-b6cb-4dcb29a73ce2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:06:00.906851 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac48c00f-ac06-4520-b6cb-4dcb29a73ce2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:06:00.908563 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac48c00f-ac06-4520-b6cb-4dcb29a73ce2 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:06:00.921396 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 622/1252] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Mar 30 07:06:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:06:00.927892 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce653451-579b-4666-81f0-597a3db71e2c None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:06:01.036654 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce653451-579b-4666-81f0-597a3db71e2c None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:06:01.075155 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bd0635-b680-4311-834f-6d474997420f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:06:01.075992 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bd0635-b680-4311-834f-6d474997420f None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:06:01.076250 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bd0635-b680-4311-834f-6d474997420f None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:06:01.076536 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bd0635-b680-4311-834f-6d474997420f None admin] PATH_INFO: `/v3/users/placement` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:06:01.086121 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bd0635-b680-4311-834f-6d474997420f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:06:01.087719 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bd0635-b680-4311-834f-6d474997420f None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:06:01.102583 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-d0bd0635-b680-4311-834f-6d474997420f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Mar 30 07:06:01.104010 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 631/1253] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:06:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:06:01.111008 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac48c00f-ac06-4520-b6cb-4dcb29a73ce2 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:06:01.214974 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac48c00f-ac06-4520-b6cb-4dcb29a73ce2 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:06:01.252476 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef3829a-e756-4258-adba-42ff883d4d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:06:01.253460 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef3829a-e756-4258-adba-42ff883d4d9d None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:06:01.253770 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef3829a-e756-4258-adba-42ff883d4d9d None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:06:01.254045 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef3829a-e756-4258-adba-42ff883d4d9d None admin] PATH_INFO: `/v3/users` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:06:01.254879 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef3829a-e756-4258-adba-42ff883d4d9d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:06:01.255187 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef3829a-e756-4258-adba-42ff883d4d9d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:06:01.256653 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef3829a-e756-4258-adba-42ff883d4d9d None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:06:01.278191 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 623/1254] 10.222.0.20 () {56 vars in 1143 bytes} [Wed Mar 30 07:06:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:06:01.284823 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bd0635-b680-4311-834f-6d474997420f None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:06:01.394832 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bd0635-b680-4311-834f-6d474997420f None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:06:01.430962 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dfbd67-1c78-4d37-aebe-c4b5e72c10ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:06:01.431653 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dfbd67-1c78-4d37-aebe-c4b5e72c10ad None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:06:01.431975 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dfbd67-1c78-4d37-aebe-c4b5e72c10ad None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:06:01.432263 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dfbd67-1c78-4d37-aebe-c4b5e72c10ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:06:01.505702 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dfbd67-1c78-4d37-aebe-c4b5e72c10ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:06:01.507092 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dfbd67-1c78-4d37-aebe-c4b5e72c10ad None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:06:01.610501 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 632/1255] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Mar 30 07:06:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 30 07:06:01.618170 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef3829a-e756-4258-adba-42ff883d4d9d None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:06:01.729126 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef3829a-e756-4258-adba-42ff883d4d9d None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:06:01.766143 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1e06c3-a817-4391-940b-e3655380fbaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:06:01.766979 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e06c3-a817-4391-940b-e3655380fbaf None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:06:01.767252 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e06c3-a817-4391-940b-e3655380fbaf None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:06:01.767535 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e06c3-a817-4391-940b-e3655380fbaf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:06:01.781688 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1e06c3-a817-4391-940b-e3655380fbaf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:06:01.783973 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1e06c3-a817-4391-940b-e3655380fbaf None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:06:01.802010 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-4b1e06c3-a817-4391-940b-e3655380fbaf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 07:06:01.803261 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 624/1256] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:06:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:06:01.810242 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dfbd67-1c78-4d37-aebe-c4b5e72c10ad None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:06:01.920422 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dfbd67-1c78-4d37-aebe-c4b5e72c10ad None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:06:01.958560 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6332810b-dc6f-4b6c-9370-841f6065481b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:06:01.959290 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6332810b-dc6f-4b6c-9370-841f6065481b None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:06:01.959924 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6332810b-dc6f-4b6c-9370-841f6065481b None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:06:01.959924 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6332810b-dc6f-4b6c-9370-841f6065481b None admin] PATH_INFO: `/v3/domains` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:06:01.960553 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6332810b-dc6f-4b6c-9370-841f6065481b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:06:01.960858 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6332810b-dc6f-4b6c-9370-841f6065481b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:06:01.962234 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6332810b-dc6f-4b6c-9370-841f6065481b None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:06:01.974194 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 633/1257] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Mar 30 07:06:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:06:01.980579 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1e06c3-a817-4391-940b-e3655380fbaf None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:06:02.091057 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1e06c3-a817-4391-940b-e3655380fbaf None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:06:02.130382 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c14bf5-6ef0-4b10-b8ff-5de49d1a5dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:06:02.131184 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c14bf5-6ef0-4b10-b8ff-5de49d1a5dd6 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:06:02.131505 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c14bf5-6ef0-4b10-b8ff-5de49d1a5dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:06:02.131785 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c14bf5-6ef0-4b10-b8ff-5de49d1a5dd6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:06:02.140242 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c14bf5-6ef0-4b10-b8ff-5de49d1a5dd6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:06:02.142004 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c14bf5-6ef0-4b10-b8ff-5de49d1a5dd6 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:06:02.158213 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-c3c14bf5-6ef0-4b10-b8ff-5de49d1a5dd6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 30 07:06:02.160088 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 625/1258] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Mar 30 07:06:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:06:02.166379 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6332810b-dc6f-4b6c-9370-841f6065481b None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:06:02.273702 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6332810b-dc6f-4b6c-9370-841f6065481b None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:06:02.309067 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d66323-5b54-4a45-9a42-f193086c1368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:06:02.309733 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d66323-5b54-4a45-9a42-f193086c1368 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:06:02.310053 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d66323-5b54-4a45-9a42-f193086c1368 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:06:02.310353 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d66323-5b54-4a45-9a42-f193086c1368 None admin] PATH_INFO: `/v3/projects` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:06:02.311372 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d66323-5b54-4a45-9a42-f193086c1368 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:06:02.311729 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d66323-5b54-4a45-9a42-f193086c1368 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:06:02.313579 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d66323-5b54-4a45-9a42-f193086c1368 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:06:02.328059 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 634/1259] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Mar 30 07:06:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:06:02.334180 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c14bf5-6ef0-4b10-b8ff-5de49d1a5dd6 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:06:02.446354 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c14bf5-6ef0-4b10-b8ff-5de49d1a5dd6 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:06:02.480598 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616d9f52-d3c2-4c99-b83d-f39573a83563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:06:02.481423 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d9f52-d3c2-4c99-b83d-f39573a83563 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:06:02.481763 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d9f52-d3c2-4c99-b83d-f39573a83563 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:06:02.482085 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d9f52-d3c2-4c99-b83d-f39573a83563 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:06:02.483435 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616d9f52-d3c2-4c99-b83d-f39573a83563 None admin] RBAC: Adding query filter params (role.id=1c39b9ab8cfd4c0ea71845831920a845, scope.project.id=7e4eda4c5cd84307b36a5b48642e816f, user.id=d634743546e8456fac2f6ab1aaee09ef) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:06:02.483861 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616d9f52-d3c2-4c99-b83d-f39573a83563 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:06:02.485571 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616d9f52-d3c2-4c99-b83d-f39573a83563 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:06:02.492214 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 626/1260] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Mar 30 07:06:02 2022] GET /identity/v3/role_assignments?user.id=d634743546e8456fac2f6ab1aaee09ef&scope.project.id=7e4eda4c5cd84307b36a5b48642e816f&role.id=1c39b9ab8cfd4c0ea71845831920a845 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:06:04.877700 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d311af2f-ce93-464c-a740-7bccb8acd0b6 None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:06:04.878449 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d311af2f-ce93-464c-a740-7bccb8acd0b6 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:06:04.878449 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d311af2f-ce93-464c-a740-7bccb8acd0b6 None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:06:04.880074 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 635/1261] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:06:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 30 07:06:04.886330 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61f19a7-dc69-4726-a1f1-005563ed99da None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:06:04.887063 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61f19a7-dc69-4726-a1f1-005563ed99da None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:06:04.887217 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61f19a7-dc69-4726-a1f1-005563ed99da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:06:04.908280 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-f61f19a7-dc69-4726-a1f1-005563ed99da None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:06:04.909546 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-f61f19a7-dc69-4726-a1f1-005563ed99da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:06:04.981664 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 627/1262] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:06:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 30 07:06:05.005205 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d311af2f-ce93-464c-a740-7bccb8acd0b6 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:06:05.110424 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d311af2f-ce93-464c-a740-7bccb8acd0b6 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:06:05.144540 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b52bf90-76cb-498f-bd99-7bb7bdf42ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:06:05.145245 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b52bf90-76cb-498f-bd99-7bb7bdf42ad3 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:06:05.145526 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b52bf90-76cb-498f-bd99-7bb7bdf42ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:06:05.145796 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b52bf90-76cb-498f-bd99-7bb7bdf42ad3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:06:05.156913 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b52bf90-76cb-498f-bd99-7bb7bdf42ad3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 07:06:05.163751 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-7b52bf90-76cb-498f-bd99-7bb7bdf42ad3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 30 07:06:05.164966 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 636/1263] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Mar 30 07:06:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:06:05.171368 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61f19a7-dc69-4726-a1f1-005563ed99da None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:06:05.285776 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61f19a7-dc69-4726-a1f1-005563ed99da None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:06:05.319397 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd40883-6fc1-4ea1-a1df-5d980c9d89ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:06:05.320085 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd40883-6fc1-4ea1-a1df-5d980c9d89ab None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:06:05.320362 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd40883-6fc1-4ea1-a1df-5d980c9d89ab None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:06:05.320630 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd40883-6fc1-4ea1-a1df-5d980c9d89ab None admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:06:05.321364 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd40883-6fc1-4ea1-a1df-5d980c9d89ab None admin] RBAC: Adding query filter params (name=admin) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:06:05.321667 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd40883-6fc1-4ea1-a1df-5d980c9d89ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:06:05.323025 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd40883-6fc1-4ea1-a1df-5d980c9d89ab None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:06:05.331397 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 628/1264] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Mar 30 07:06:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:06:05.337652 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b52bf90-76cb-498f-bd99-7bb7bdf42ad3 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:06:05.442310 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b52bf90-76cb-498f-bd99-7bb7bdf42ad3 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:06:05.476905 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83216539-17ce-453d-ad00-55f82c31a6d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:06:05.477681 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83216539-17ce-453d-ad00-55f82c31a6d8 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:06:05.477955 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83216539-17ce-453d-ad00-55f82c31a6d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:06:05.478223 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83216539-17ce-453d-ad00-55f82c31a6d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:06:05.489689 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83216539-17ce-453d-ad00-55f82c31a6d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:06:05.491124 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83216539-17ce-453d-ad00-55f82c31a6d8 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:06:05.507748 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-83216539-17ce-453d-ad00-55f82c31a6d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 07:06:05.508935 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 637/1265] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:06:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:06:05.515199 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd40883-6fc1-4ea1-a1df-5d980c9d89ab None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:06:05.632611 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd40883-6fc1-4ea1-a1df-5d980c9d89ab None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:06:05.676588 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cef7c7-f259-4e75-abfa-dd217f8f2c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:06:05.677338 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cef7c7-f259-4e75-abfa-dd217f8f2c46 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:06:05.677656 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cef7c7-f259-4e75-abfa-dd217f8f2c46 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:06:05.678126 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cef7c7-f259-4e75-abfa-dd217f8f2c46 None admin] PATH_INFO: `/v3/domains` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:06:05.679274 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cef7c7-f259-4e75-abfa-dd217f8f2c46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:06:05.679614 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cef7c7-f259-4e75-abfa-dd217f8f2c46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:06:05.681557 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cef7c7-f259-4e75-abfa-dd217f8f2c46 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:06:05.695976 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 629/1266] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Mar 30 07:06:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:06:05.702966 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83216539-17ce-453d-ad00-55f82c31a6d8 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:06:05.809847 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83216539-17ce-453d-ad00-55f82c31a6d8 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:06:05.845700 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dd6fb0-3dfa-4daa-81ed-6dee913b40b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:06:05.846580 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dd6fb0-3dfa-4daa-81ed-6dee913b40b6 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:06:05.846859 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dd6fb0-3dfa-4daa-81ed-6dee913b40b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:06:05.847130 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dd6fb0-3dfa-4daa-81ed-6dee913b40b6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:06:05.854609 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dd6fb0-3dfa-4daa-81ed-6dee913b40b6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:06:05.856084 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dd6fb0-3dfa-4daa-81ed-6dee913b40b6 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:06:05.870014 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-e3dd6fb0-3dfa-4daa-81ed-6dee913b40b6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Mar 30 07:06:05.871160 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 638/1267] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:06:05 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 30 07:06:05.877246 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cef7c7-f259-4e75-abfa-dd217f8f2c46 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:06:05.978630 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cef7c7-f259-4e75-abfa-dd217f8f2c46 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:06:06.012918 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a746328e-c0c8-425f-b4a9-89733cf40722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:06:06.013598 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a746328e-c0c8-425f-b4a9-89733cf40722 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:06:06.013875 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a746328e-c0c8-425f-b4a9-89733cf40722 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:06:06.014150 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a746328e-c0c8-425f-b4a9-89733cf40722 None admin] PATH_INFO: `/v3/users` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:06:06.014976 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a746328e-c0c8-425f-b4a9-89733cf40722 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:06:06.015283 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a746328e-c0c8-425f-b4a9-89733cf40722 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:06:06.016749 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a746328e-c0c8-425f-b4a9-89733cf40722 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:06:06.033804 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 630/1268] 10.222.0.20 () {56 vars in 1143 bytes} [Wed Mar 30 07:06:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:06:06.039714 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dd6fb0-3dfa-4daa-81ed-6dee913b40b6 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:06:06.138705 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dd6fb0-3dfa-4daa-81ed-6dee913b40b6 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:06:06.172316 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eabf4d0-967d-4716-8da5-7496c5b4320b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:06:06.173102 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eabf4d0-967d-4716-8da5-7496c5b4320b None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:06:06.173382 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eabf4d0-967d-4716-8da5-7496c5b4320b None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:06:06.173657 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eabf4d0-967d-4716-8da5-7496c5b4320b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:06:06.184509 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eabf4d0-967d-4716-8da5-7496c5b4320b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:06:06.185967 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eabf4d0-967d-4716-8da5-7496c5b4320b None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:06:06.202214 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-0eabf4d0-967d-4716-8da5-7496c5b4320b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 07:06:06.203372 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 639/1269] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:06:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:06:06.209555 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a746328e-c0c8-425f-b4a9-89733cf40722 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:06:06.317555 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a746328e-c0c8-425f-b4a9-89733cf40722 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:06:06.351694 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa195e60-73a1-4d0a-8293-fc14c32b27a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:06:06.352381 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa195e60-73a1-4d0a-8293-fc14c32b27a2 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:06:06.352662 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa195e60-73a1-4d0a-8293-fc14c32b27a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:06:06.352933 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa195e60-73a1-4d0a-8293-fc14c32b27a2 None admin] PATH_INFO: `/v3/domains` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:06:06.353651 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa195e60-73a1-4d0a-8293-fc14c32b27a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:06:06.353956 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa195e60-73a1-4d0a-8293-fc14c32b27a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:06:06.355326 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa195e60-73a1-4d0a-8293-fc14c32b27a2 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:06:06.367081 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 631/1270] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Mar 30 07:06:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:06:06.376547 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eabf4d0-967d-4716-8da5-7496c5b4320b None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:06:06.484647 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eabf4d0-967d-4716-8da5-7496c5b4320b None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:06:06.519766 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ec26e5-6dc9-4745-a6a6-e86885ba3e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:06:06.520593 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ec26e5-6dc9-4745-a6a6-e86885ba3e99 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:06:06.521041 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ec26e5-6dc9-4745-a6a6-e86885ba3e99 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:06:06.521400 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ec26e5-6dc9-4745-a6a6-e86885ba3e99 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:06:06.529042 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ec26e5-6dc9-4745-a6a6-e86885ba3e99 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:06:06.530484 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ec26e5-6dc9-4745-a6a6-e86885ba3e99 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:06:06.544414 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-74ec26e5-6dc9-4745-a6a6-e86885ba3e99 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 30 07:06:06.545566 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 640/1271] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Mar 30 07:06:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:06:06.553525 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa195e60-73a1-4d0a-8293-fc14c32b27a2 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:06:06.665679 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa195e60-73a1-4d0a-8293-fc14c32b27a2 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:06:06.702791 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f686f7ed-016c-4caa-9006-70000325794d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:06:06.703777 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f686f7ed-016c-4caa-9006-70000325794d None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:06:06.704193 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f686f7ed-016c-4caa-9006-70000325794d None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:06:06.704581 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f686f7ed-016c-4caa-9006-70000325794d None admin] PATH_INFO: `/v3/projects` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:06:06.705668 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f686f7ed-016c-4caa-9006-70000325794d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:06:06.706120 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f686f7ed-016c-4caa-9006-70000325794d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:06:06.708364 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f686f7ed-016c-4caa-9006-70000325794d None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:06:06.725557 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 632/1272] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Mar 30 07:06:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:06:06.735400 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ec26e5-6dc9-4745-a6a6-e86885ba3e99 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:06:06.840143 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ec26e5-6dc9-4745-a6a6-e86885ba3e99 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:06:06.873776 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab7261c-9790-457d-a42a-276ccf1d0f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:06:06.874657 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab7261c-9790-457d-a42a-276ccf1d0f8d None admin] REQUEST_METHOD: `PUT` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:06:06.874936 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab7261c-9790-457d-a42a-276ccf1d0f8d None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:06:06.875214 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab7261c-9790-457d-a42a-276ccf1d0f8d None admin] PATH_INFO: `/v3/projects/7e4eda4c5cd84307b36a5b48642e816f/users/d634743546e8456fac2f6ab1aaee09ef/roles/1c39b9ab8cfd4c0ea71845831920a845` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:06:06.877188 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab7261c-9790-457d-a42a-276ccf1d0f8d None admin] RBAC: Authorizing `identity:create_grant(project_id=7e4eda4c5cd84307b36a5b48642e816f, user_id=d634743546e8456fac2f6ab1aaee09ef, role_id=1c39b9ab8cfd4c0ea71845831920a845)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:06:06.878618 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab7261c-9790-457d-a42a-276ccf1d0f8d None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:06:06.894279 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 641/1273] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Mar 30 07:06:06 2022] PUT /identity/v3/projects/7e4eda4c5cd84307b36a5b48642e816f/users/d634743546e8456fac2f6ab1aaee09ef/roles/1c39b9ab8cfd4c0ea71845831920a845 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:06:09.179161 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bdcdfe-d9eb-46c1-96da-240a13a9d48b None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:06:09.179775 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bdcdfe-d9eb-46c1-96da-240a13a9d48b None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:06:09.179775 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bdcdfe-d9eb-46c1-96da-240a13a9d48b None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:06:09.181549 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 633/1274] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:06:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:06:09.187864 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15ec863-3b57-4138-a073-046c355043b9 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:06:09.188571 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15ec863-3b57-4138-a073-046c355043b9 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:06:09.188761 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15ec863-3b57-4138-a073-046c355043b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:06:09.213410 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-b15ec863-3b57-4138-a073-046c355043b9 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:06:09.214607 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-b15ec863-3b57-4138-a073-046c355043b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:06:09.287367 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 642/1275] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:06:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 30 07:06:09.311036 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bdcdfe-d9eb-46c1-96da-240a13a9d48b None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:06:09.425644 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bdcdfe-d9eb-46c1-96da-240a13a9d48b None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:06:09.460854 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf626e7-c349-49a6-ace5-df1fe11a60a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:06:09.461565 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf626e7-c349-49a6-ace5-df1fe11a60a3 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:06:09.461846 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf626e7-c349-49a6-ace5-df1fe11a60a3 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:06:09.462118 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf626e7-c349-49a6-ace5-df1fe11a60a3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:06:09.472446 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf626e7-c349-49a6-ace5-df1fe11a60a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 30 07:06:09.479327 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-9bf626e7-c349-49a6-ace5-df1fe11a60a3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 30 07:06:09.480535 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 634/1276] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Mar 30 07:06:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:06:09.487746 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15ec863-3b57-4138-a073-046c355043b9 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:06:09.589796 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15ec863-3b57-4138-a073-046c355043b9 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:06:09.627425 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3a5708-ef95-4c0f-af59-59212cf4856e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:06:09.628529 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a5708-ef95-4c0f-af59-59212cf4856e None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:06:09.629094 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a5708-ef95-4c0f-af59-59212cf4856e None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:06:09.629581 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a5708-ef95-4c0f-af59-59212cf4856e None admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:06:09.630923 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3a5708-ef95-4c0f-af59-59212cf4856e None admin] RBAC: Adding query filter params (name=admin) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:06:09.631471 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3a5708-ef95-4c0f-af59-59212cf4856e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:06:09.632950 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3a5708-ef95-4c0f-af59-59212cf4856e None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:06:09.642241 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 643/1277] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Mar 30 07:06:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:06:09.648599 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf626e7-c349-49a6-ace5-df1fe11a60a3 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:06:09.752174 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf626e7-c349-49a6-ace5-df1fe11a60a3 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:06:09.786154 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba061431-94fc-4a71-a6b1-8376b2b87a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:06:09.786940 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba061431-94fc-4a71-a6b1-8376b2b87a99 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:06:09.787222 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba061431-94fc-4a71-a6b1-8376b2b87a99 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:06:09.787488 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba061431-94fc-4a71-a6b1-8376b2b87a99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:06:09.797375 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba061431-94fc-4a71-a6b1-8376b2b87a99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:06:09.798851 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba061431-94fc-4a71-a6b1-8376b2b87a99 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:06:09.815460 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-ba061431-94fc-4a71-a6b1-8376b2b87a99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 07:06:09.816724 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 635/1278] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:06:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:06:09.825871 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3a5708-ef95-4c0f-af59-59212cf4856e None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:06:09.926515 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3a5708-ef95-4c0f-af59-59212cf4856e None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:06:09.960078 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779484e9-6308-4595-b4ee-f1663b973c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:06:09.960741 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779484e9-6308-4595-b4ee-f1663b973c3b None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:06:09.961023 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779484e9-6308-4595-b4ee-f1663b973c3b None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:06:09.961300 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779484e9-6308-4595-b4ee-f1663b973c3b None admin] PATH_INFO: `/v3/domains` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:06:09.962005 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779484e9-6308-4595-b4ee-f1663b973c3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:06:09.962311 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779484e9-6308-4595-b4ee-f1663b973c3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:06:09.963683 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779484e9-6308-4595-b4ee-f1663b973c3b None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:06:09.975614 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 644/1279] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Mar 30 07:06:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:06:09.981782 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba061431-94fc-4a71-a6b1-8376b2b87a99 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:06:10.083762 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba061431-94fc-4a71-a6b1-8376b2b87a99 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:06:10.119549 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be289356-cd1e-401d-a62c-2619c647102e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:06:10.120364 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be289356-cd1e-401d-a62c-2619c647102e None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:06:10.120649 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be289356-cd1e-401d-a62c-2619c647102e None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:06:10.120924 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be289356-cd1e-401d-a62c-2619c647102e None admin] PATH_INFO: `/v3/users/placement` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:06:10.128917 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be289356-cd1e-401d-a62c-2619c647102e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:06:10.130373 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be289356-cd1e-401d-a62c-2619c647102e None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:06:10.144614 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-be289356-cd1e-401d-a62c-2619c647102e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Mar 30 07:06:10.145886 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 636/1280] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:06:09 2022] GET /identity/v3/users/placement => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:06:10.152687 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779484e9-6308-4595-b4ee-f1663b973c3b None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:06:10.262762 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779484e9-6308-4595-b4ee-f1663b973c3b None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:06:10.302482 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d180bca-d09c-462a-8c1e-3bc5e11d69c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:06:10.305526 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d180bca-d09c-462a-8c1e-3bc5e11d69c6 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:06:10.305805 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d180bca-d09c-462a-8c1e-3bc5e11d69c6 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:06:10.306068 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d180bca-d09c-462a-8c1e-3bc5e11d69c6 None admin] PATH_INFO: `/v3/users` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:06:10.306900 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d180bca-d09c-462a-8c1e-3bc5e11d69c6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:06:10.307204 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d180bca-d09c-462a-8c1e-3bc5e11d69c6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:06:10.308657 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d180bca-d09c-462a-8c1e-3bc5e11d69c6 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:06:10.326858 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 645/1281] 10.222.0.20 () {56 vars in 1143 bytes} [Wed Mar 30 07:06:10 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:06:10.336771 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be289356-cd1e-401d-a62c-2619c647102e None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:06:10.456398 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be289356-cd1e-401d-a62c-2619c647102e None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:06:10.490342 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0e0a7c-18ef-4cf9-93cc-4fe6063c0479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:06:10.490972 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0e0a7c-18ef-4cf9-93cc-4fe6063c0479 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:06:10.491251 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0e0a7c-18ef-4cf9-93cc-4fe6063c0479 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:06:10.491524 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0e0a7c-18ef-4cf9-93cc-4fe6063c0479 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:06:10.565581 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0e0a7c-18ef-4cf9-93cc-4fe6063c0479 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:06:10.567125 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0e0a7c-18ef-4cf9-93cc-4fe6063c0479 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:06:10.672844 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 637/1282] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Mar 30 07:06:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 30 07:06:10.682683 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d180bca-d09c-462a-8c1e-3bc5e11d69c6 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:06:10.787631 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d180bca-d09c-462a-8c1e-3bc5e11d69c6 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:06:10.823175 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419314db-74fe-4f8d-9982-0c2ad0c21bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:06:10.823985 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419314db-74fe-4f8d-9982-0c2ad0c21bf9 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:06:10.824270 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419314db-74fe-4f8d-9982-0c2ad0c21bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:06:10.824544 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419314db-74fe-4f8d-9982-0c2ad0c21bf9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:06:10.834922 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419314db-74fe-4f8d-9982-0c2ad0c21bf9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:06:10.836402 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419314db-74fe-4f8d-9982-0c2ad0c21bf9 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:06:10.854046 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-419314db-74fe-4f8d-9982-0c2ad0c21bf9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 30 07:06:10.855197 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 646/1283] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:06:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:06:10.861614 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0e0a7c-18ef-4cf9-93cc-4fe6063c0479 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:06:10.962136 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0e0a7c-18ef-4cf9-93cc-4fe6063c0479 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:06:10.996530 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9467d06-88f5-4a7a-ae9b-e5dae29cea6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:06:10.997170 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9467d06-88f5-4a7a-ae9b-e5dae29cea6a None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:06:10.997451 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9467d06-88f5-4a7a-ae9b-e5dae29cea6a None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:06:10.997715 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9467d06-88f5-4a7a-ae9b-e5dae29cea6a None admin] PATH_INFO: `/v3/domains` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:06:10.998423 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9467d06-88f5-4a7a-ae9b-e5dae29cea6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:06:10.998725 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9467d06-88f5-4a7a-ae9b-e5dae29cea6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:06:11.000153 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9467d06-88f5-4a7a-ae9b-e5dae29cea6a None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:06:11.011257 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 638/1284] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Mar 30 07:06:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:06:11.017172 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419314db-74fe-4f8d-9982-0c2ad0c21bf9 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:06:11.123192 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419314db-74fe-4f8d-9982-0c2ad0c21bf9 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:06:11.156570 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da47e38-38b9-44a7-8d22-2dcdecfa001e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:06:11.157342 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da47e38-38b9-44a7-8d22-2dcdecfa001e None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:06:11.157615 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da47e38-38b9-44a7-8d22-2dcdecfa001e None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:06:11.157883 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da47e38-38b9-44a7-8d22-2dcdecfa001e None admin] PATH_INFO: `/v3/projects/service` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:06:11.164828 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da47e38-38b9-44a7-8d22-2dcdecfa001e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:06:11.166260 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da47e38-38b9-44a7-8d22-2dcdecfa001e None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:06:11.179195 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING keystone.server.flask.application [None req-2da47e38-38b9-44a7-8d22-2dcdecfa001e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 30 07:06:11.180341 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 647/1285] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Mar 30 07:06:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:06:11.189663 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9467d06-88f5-4a7a-ae9b-e5dae29cea6a None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:06:11.296616 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9467d06-88f5-4a7a-ae9b-e5dae29cea6a None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:06:11.330425 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f9df67-1251-4967-afab-deddac12a97a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:06:11.331074 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f9df67-1251-4967-afab-deddac12a97a None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:06:11.331351 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f9df67-1251-4967-afab-deddac12a97a None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:06:11.331624 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f9df67-1251-4967-afab-deddac12a97a None admin] PATH_INFO: `/v3/projects` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:06:11.332745 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f9df67-1251-4967-afab-deddac12a97a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:06:11.333092 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f9df67-1251-4967-afab-deddac12a97a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:06:11.334535 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f9df67-1251-4967-afab-deddac12a97a None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:06:11.346272 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 639/1286] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Mar 30 07:06:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:06:11.353518 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da47e38-38b9-44a7-8d22-2dcdecfa001e None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:06:11.464681 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da47e38-38b9-44a7-8d22-2dcdecfa001e None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:06:11.501906 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de77605-0560-4392-a1f8-a6419297bd01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:06:11.502544 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de77605-0560-4392-a1f8-a6419297bd01 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:06:11.502827 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de77605-0560-4392-a1f8-a6419297bd01 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:06:11.503103 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de77605-0560-4392-a1f8-a6419297bd01 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:06:11.503987 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de77605-0560-4392-a1f8-a6419297bd01 None admin] RBAC: Adding query filter params (role.id=1c39b9ab8cfd4c0ea71845831920a845, scope.project.id=7e4eda4c5cd84307b36a5b48642e816f, user.id=d634743546e8456fac2f6ab1aaee09ef) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:06:11.504299 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de77605-0560-4392-a1f8-a6419297bd01 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:06:11.505738 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de77605-0560-4392-a1f8-a6419297bd01 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:06:11.511612 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 648/1287] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Mar 30 07:06:11 2022] GET /identity/v3/role_assignments?user.id=d634743546e8456fac2f6ab1aaee09ef&scope.project.id=7e4eda4c5cd84307b36a5b48642e816f&role.id=1c39b9ab8cfd4c0ea71845831920a845 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:06:13.846598 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00912812-5d8d-438c-91f8-9867c7df91c5 None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:06:13.847253 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00912812-5d8d-438c-91f8-9867c7df91c5 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:06:13.847253 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00912812-5d8d-438c-91f8-9867c7df91c5 None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:06:13.849748 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 640/1288] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:06:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:06:13.856894 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3643624d-24b9-4019-85ff-45b6bc59bed2 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:06:13.857604 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3643624d-24b9-4019-85ff-45b6bc59bed2 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:06:13.857699 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3643624d-24b9-4019-85ff-45b6bc59bed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:06:13.878409 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-3643624d-24b9-4019-85ff-45b6bc59bed2 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:06:13.879640 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-3643624d-24b9-4019-85ff-45b6bc59bed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:06:13.955676 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 649/1289] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:06:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 30 07:06:13.978384 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00912812-5d8d-438c-91f8-9867c7df91c5 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:06:14.083612 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00912812-5d8d-438c-91f8-9867c7df91c5 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:06:14.117987 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e266f978-59f7-4377-a5ff-a5c37ce1bcd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:06:14.118781 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e266f978-59f7-4377-a5ff-a5c37ce1bcd5 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:06:14.119064 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e266f978-59f7-4377-a5ff-a5c37ce1bcd5 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:06:14.119339 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e266f978-59f7-4377-a5ff-a5c37ce1bcd5 None admin] PATH_INFO: `/v3/services/placement` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:06:14.120018 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e266f978-59f7-4377-a5ff-a5c37ce1bcd5 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:06:14.121395 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e266f978-59f7-4377-a5ff-a5c37ce1bcd5 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:06:14.132602 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-e266f978-59f7-4377-a5ff-a5c37ce1bcd5 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Mar 30 07:06:14.133744 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 641/1290] 10.222.0.20 () {56 vars in 1117 bytes} [Wed Mar 30 07:06:13 2022] GET /identity/v3/services/placement => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:06:14.140255 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3643624d-24b9-4019-85ff-45b6bc59bed2 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:06:14.254846 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3643624d-24b9-4019-85ff-45b6bc59bed2 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:06:14.288829 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0bd40d-9770-4c61-a29d-61e3bb6ca726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:06:14.289482 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0bd40d-9770-4c61-a29d-61e3bb6ca726 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:06:14.289756 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0bd40d-9770-4c61-a29d-61e3bb6ca726 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:06:14.290030 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0bd40d-9770-4c61-a29d-61e3bb6ca726 None admin] PATH_INFO: `/v3/services` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:06:14.290728 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0bd40d-9770-4c61-a29d-61e3bb6ca726 None admin] RBAC: Adding query filter params (name=placement) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:06:14.291021 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0bd40d-9770-4c61-a29d-61e3bb6ca726 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:06:14.292430 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0bd40d-9770-4c61-a29d-61e3bb6ca726 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:06:14.297278 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 650/1291] 10.222.0.20 () {56 vars in 1116 bytes} [Wed Mar 30 07:06:14 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:06:14.303478 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e266f978-59f7-4377-a5ff-a5c37ce1bcd5 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:06:14.420652 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e266f978-59f7-4377-a5ff-a5c37ce1bcd5 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:06:14.454694 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce63d97c-e73b-4691-9b5d-7c5282033b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:06:14.455353 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce63d97c-e73b-4691-9b5d-7c5282033b59 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:06:14.455630 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce63d97c-e73b-4691-9b5d-7c5282033b59 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:06:14.455924 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce63d97c-e73b-4691-9b5d-7c5282033b59 None admin] PATH_INFO: `/v3/services` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:06:14.456633 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce63d97c-e73b-4691-9b5d-7c5282033b59 None admin] RBAC: Adding query filter params (type=placement) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:06:14.457016 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce63d97c-e73b-4691-9b5d-7c5282033b59 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:06:14.458726 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce63d97c-e73b-4691-9b5d-7c5282033b59 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:06:14.464133 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 642/1292] 10.222.0.20 () {56 vars in 1116 bytes} [Wed Mar 30 07:06:14 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:06:16.701702 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d48c565-d84e-44b6-94c1-85dbf815f088 None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:06:16.702266 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d48c565-d84e-44b6-94c1-85dbf815f088 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:06:16.702266 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d48c565-d84e-44b6-94c1-85dbf815f088 None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:06:16.704045 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 651/1293] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:06:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:06:16.710267 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e40110d-36a0-4be5-95c8-57baabf839a6 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:06:16.710986 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e40110d-36a0-4be5-95c8-57baabf839a6 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:06:16.711129 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e40110d-36a0-4be5-95c8-57baabf839a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:06:16.739255 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-0e40110d-36a0-4be5-95c8-57baabf839a6 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:06:16.740466 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-0e40110d-36a0-4be5-95c8-57baabf839a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:06:16.808824 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 643/1294] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:06:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 30 07:06:16.832632 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d48c565-d84e-44b6-94c1-85dbf815f088 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:06:16.958509 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d48c565-d84e-44b6-94c1-85dbf815f088 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:06:16.995506 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c630b5ea-2568-4c66-92fd-968d49f3fe4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:06:16.996190 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c630b5ea-2568-4c66-92fd-968d49f3fe4e None admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:06:16.996466 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c630b5ea-2568-4c66-92fd-968d49f3fe4e None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:06:16.996739 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c630b5ea-2568-4c66-92fd-968d49f3fe4e None admin] PATH_INFO: `/v3/services` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:06:16.997452 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c630b5ea-2568-4c66-92fd-968d49f3fe4e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:06:16.998823 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c630b5ea-2568-4c66-92fd-968d49f3fe4e None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:06:17.014920 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 652/1295] 10.222.0.20 () {60 vars in 1141 bytes} [Wed Mar 30 07:06:16 2022] POST /identity/v3/services => generated 246 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:06:19.273941 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13abb45b-30e9-44d0-aacd-61562fa8a8a2 None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:06:19.274802 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13abb45b-30e9-44d0-aacd-61562fa8a8a2 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:06:19.274802 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13abb45b-30e9-44d0-aacd-61562fa8a8a2 None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:06:19.277755 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 644/1296] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:06:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:06:19.283946 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2058e8d7-3267-486c-a2b9-7439f373cd8c None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:06:19.284658 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2058e8d7-3267-486c-a2b9-7439f373cd8c None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:06:19.284833 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2058e8d7-3267-486c-a2b9-7439f373cd8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:06:19.304613 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-2058e8d7-3267-486c-a2b9-7439f373cd8c None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:06:19.305805 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-2058e8d7-3267-486c-a2b9-7439f373cd8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:06:19.393216 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 653/1297] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:06:19 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 30 07:06:19.417344 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13abb45b-30e9-44d0-aacd-61562fa8a8a2 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:06:19.529464 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13abb45b-30e9-44d0-aacd-61562fa8a8a2 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:06:19.567370 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdcdb7a-bb78-4251-b356-07aa464c62b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:06:19.568182 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdcdb7a-bb78-4251-b356-07aa464c62b2 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:06:19.568461 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdcdb7a-bb78-4251-b356-07aa464c62b2 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:06:19.568732 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdcdb7a-bb78-4251-b356-07aa464c62b2 None admin] PATH_INFO: `/v3/services/placement` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:06:19.569378 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdcdb7a-bb78-4251-b356-07aa464c62b2 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:06:19.570729 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdcdb7a-bb78-4251-b356-07aa464c62b2 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:06:19.581944 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-2bdcdb7a-bb78-4251-b356-07aa464c62b2 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Mar 30 07:06:19.583100 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 645/1298] 10.222.0.20 () {56 vars in 1117 bytes} [Wed Mar 30 07:06:19 2022] GET /identity/v3/services/placement => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:06:19.592856 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2058e8d7-3267-486c-a2b9-7439f373cd8c None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:06:19.695839 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2058e8d7-3267-486c-a2b9-7439f373cd8c None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:06:19.729216 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdb01ac-2f69-4c9a-99a5-8e4841370a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:06:19.729859 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdb01ac-2f69-4c9a-99a5-8e4841370a60 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:06:19.730137 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdb01ac-2f69-4c9a-99a5-8e4841370a60 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:06:19.730405 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdb01ac-2f69-4c9a-99a5-8e4841370a60 None admin] PATH_INFO: `/v3/services` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:06:19.731098 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdb01ac-2f69-4c9a-99a5-8e4841370a60 None admin] RBAC: Adding query filter params (name=placement) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:06:19.731392 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdb01ac-2f69-4c9a-99a5-8e4841370a60 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:06:19.733131 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdb01ac-2f69-4c9a-99a5-8e4841370a60 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:06:19.738246 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 654/1299] 10.222.0.20 () {56 vars in 1116 bytes} [Wed Mar 30 07:06:19 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:06:19.744493 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdcdb7a-bb78-4251-b356-07aa464c62b2 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:06:19.845535 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdcdb7a-bb78-4251-b356-07aa464c62b2 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:06:19.879601 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d17023-cc0a-478b-8696-8732e1e12d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:06:19.880271 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d17023-cc0a-478b-8696-8732e1e12d8b None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:06:19.880548 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d17023-cc0a-478b-8696-8732e1e12d8b None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:06:19.880824 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d17023-cc0a-478b-8696-8732e1e12d8b None admin] PATH_INFO: `/v3/endpoints` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:06:19.881595 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d17023-cc0a-478b-8696-8732e1e12d8b None admin] RBAC: Adding query filter params (interface=public, service_id=9d9259169af54d2695afc8ed85d365db, region_id=RegionOne) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:06:19.881908 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d17023-cc0a-478b-8696-8732e1e12d8b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:06:19.883266 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d17023-cc0a-478b-8696-8732e1e12d8b None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:06:19.888420 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 646/1300] 10.222.0.20 () {56 vars in 1251 bytes} [Wed Mar 30 07:06:19 2022] GET /identity/v3/endpoints?service_id=9d9259169af54d2695afc8ed85d365db&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:06:19.895078 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdb01ac-2f69-4c9a-99a5-8e4841370a60 None admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:06:20.007847 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdb01ac-2f69-4c9a-99a5-8e4841370a60 None admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:06:20.041084 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8b638b-00fa-492b-8db0-edf26c7be4f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:06:20.041731 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b638b-00fa-492b-8db0-edf26c7be4f6 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:06:20.042007 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b638b-00fa-492b-8db0-edf26c7be4f6 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:06:20.042273 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b638b-00fa-492b-8db0-edf26c7be4f6 None admin] PATH_INFO: `/v3/services` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:06:20.042939 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8b638b-00fa-492b-8db0-edf26c7be4f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:06:20.044325 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8b638b-00fa-492b-8db0-edf26c7be4f6 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:06:20.050909 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 655/1301] 10.222.0.20 () {56 vars in 1087 bytes} [Wed Mar 30 07:06:19 2022] GET /identity/v3/services => generated 2191 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:06:22.317133 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312dd776-a606-433f-b689-3fa9d238c987 None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:06:22.317723 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312dd776-a606-433f-b689-3fa9d238c987 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:06:22.317723 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312dd776-a606-433f-b689-3fa9d238c987 None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:06:22.319469 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 647/1302] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:06:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:06:22.325892 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055b1474-52e2-459f-b24a-4ee1834dc7a1 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:06:22.326630 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055b1474-52e2-459f-b24a-4ee1834dc7a1 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:06:22.326769 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055b1474-52e2-459f-b24a-4ee1834dc7a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:06:22.346959 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-055b1474-52e2-459f-b24a-4ee1834dc7a1 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:06:22.348329 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-055b1474-52e2-459f-b24a-4ee1834dc7a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:06:22.415000 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 656/1303] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:06:22 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 30 07:06:22.438735 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312dd776-a606-433f-b689-3fa9d238c987 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:06:22.539891 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312dd776-a606-433f-b689-3fa9d238c987 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:06:22.573988 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4252637-3b81-4347-ae3d-f24cc963a5e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:06:22.574771 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4252637-3b81-4347-ae3d-f24cc963a5e7 None admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:06:22.575050 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4252637-3b81-4347-ae3d-f24cc963a5e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:06:22.575321 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4252637-3b81-4347-ae3d-f24cc963a5e7 None admin] PATH_INFO: `/v3/services/placement` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:06:22.576002 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4252637-3b81-4347-ae3d-f24cc963a5e7 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:06:22.577374 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4252637-3b81-4347-ae3d-f24cc963a5e7 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:06:22.588640 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING keystone.server.flask.application [None req-e4252637-3b81-4347-ae3d-f24cc963a5e7 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Mar 30 07:06:22.589784 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 648/1304] 10.222.0.20 () {56 vars in 1117 bytes} [Wed Mar 30 07:06:22 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 30 07:06:22.596049 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055b1474-52e2-459f-b24a-4ee1834dc7a1 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:06:22.703938 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055b1474-52e2-459f-b24a-4ee1834dc7a1 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:06:22.739183 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d9483d-b594-4090-baa7-86952c9f2d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:06:22.739846 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d9483d-b594-4090-baa7-86952c9f2d58 None admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:06:22.740147 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d9483d-b594-4090-baa7-86952c9f2d58 None admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:06:22.740418 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d9483d-b594-4090-baa7-86952c9f2d58 None admin] PATH_INFO: `/v3/services` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:06:22.741122 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d9483d-b594-4090-baa7-86952c9f2d58 None admin] RBAC: Adding query filter params (name=placement) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:06:22.741437 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d9483d-b594-4090-baa7-86952c9f2d58 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:06:22.742811 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d9483d-b594-4090-baa7-86952c9f2d58 None admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:06:22.748085 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 657/1305] 10.222.0.20 () {56 vars in 1116 bytes} [Wed Mar 30 07:06:22 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:06:22.754198 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4252637-3b81-4347-ae3d-f24cc963a5e7 None admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:06:22.862024 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4252637-3b81-4347-ae3d-f24cc963a5e7 None admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:06:22.895755 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786413ec-b5d7-4671-9f2b-85f135131dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:06:22.896430 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786413ec-b5d7-4671-9f2b-85f135131dd6 None admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:06:22.896711 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786413ec-b5d7-4671-9f2b-85f135131dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:06:22.896990 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786413ec-b5d7-4671-9f2b-85f135131dd6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:06:22.897733 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786413ec-b5d7-4671-9f2b-85f135131dd6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:06:22.899101 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786413ec-b5d7-4671-9f2b-85f135131dd6 None admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:06:22.921419 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 649/1306] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Mar 30 07:06:22 2022] POST /identity/v3/endpoints => generated 331 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:07:27.145459 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d889011e-a3a2-4b06-ab3a-c982b4689755 None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:07:27.146523 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d889011e-a3a2-4b06-ab3a-c982b4689755 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:07:27.147023 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d889011e-a3a2-4b06-ab3a-c982b4689755 None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:07:27.153071 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 658/1307] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:07:27 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:07:27.154519 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f220874-d2f3-4450-a163-004126baf194 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:07:27.154929 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f220874-d2f3-4450-a163-004126baf194 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:07:27.155131 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f220874-d2f3-4450-a163-004126baf194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:07:27.313733 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-5f220874-d2f3-4450-a163-004126baf194 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:07:27.315276 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-5f220874-d2f3-4450-a163-004126baf194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:07:27.418229 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 650/1308] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:07:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 07:07:27.484477 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3518bb7a-e50e-40c4-9d8f-9ec4760443d2 None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:07:27.484757 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3518bb7a-e50e-40c4-9d8f-9ec4760443d2 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:07:27.485217 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3518bb7a-e50e-40c4-9d8f-9ec4760443d2 None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:07:27.487305 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 659/1309] 10.222.0.20 () {54 vars in 963 bytes} [Wed Mar 30 07:07:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:07:27.494330 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80049ac9-1be6-45ce-b0e6-bac3ae5b989f None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:07:27.494611 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80049ac9-1be6-45ce-b0e6-bac3ae5b989f None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:07:27.495053 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80049ac9-1be6-45ce-b0e6-bac3ae5b989f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:07:27.610804 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-80049ac9-1be6-45ce-b0e6-bac3ae5b989f None None] MFA Rules not processed for user `54f3802cb341445f994b9204744060ae`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:07:27.615303 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-80049ac9-1be6-45ce-b0e6-bac3ae5b989f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:07:27.847157 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 651/1310] 10.222.0.20 () {58 vars in 1060 bytes} [Wed Mar 30 07:07:27 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:07:27.869939 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3518bb7a-e50e-40c4-9d8f-9ec4760443d2 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:07:27.872027 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-3518bb7a-e50e-40c4-9d8f-9ec4760443d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:07:28.011401 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3518bb7a-e50e-40c4-9d8f-9ec4760443d2 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:07:28.094205 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea859b35-99cc-4c9a-9667-4ba98a51df41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3802cb341445f994b9204744060ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:07:28.095271 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea859b35-99cc-4c9a-9667-4ba98a51df41 service neutron] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:07:28.095779 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea859b35-99cc-4c9a-9667-4ba98a51df41 service neutron] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:07:28.096286 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea859b35-99cc-4c9a-9667-4ba98a51df41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:07:28.098157 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-ea859b35-99cc-4c9a-9667-4ba98a51df41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:07:28.224244 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea859b35-99cc-4c9a-9667-4ba98a51df41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:07:28.226740 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea859b35-99cc-4c9a-9667-4ba98a51df41 service neutron] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:07:28.249323 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 660/1311] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:07:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:07:30.869242 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22e7a38-9330-4c1c-8ace-56137073854a None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:07:30.869799 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22e7a38-9330-4c1c-8ace-56137073854a None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:07:30.869799 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22e7a38-9330-4c1c-8ace-56137073854a None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:07:30.871597 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 652/1312] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:07:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 30 07:07:30.876842 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c5aac-a237-40af-9153-b68a1d6cd363 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:07:30.877262 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c5aac-a237-40af-9153-b68a1d6cd363 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:07:30.877374 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c5aac-a237-40af-9153-b68a1d6cd363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:07:30.957812 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-d30c5aac-a237-40af-9153-b68a1d6cd363 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:07:30.959069 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-d30c5aac-a237-40af-9153-b68a1d6cd363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:07:31.056116 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 661/1313] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:07:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:07:31.093552 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22e7a38-9330-4c1c-8ace-56137073854a None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:07:31.095193 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-a22e7a38-9330-4c1c-8ace-56137073854a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:07:31.199218 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22e7a38-9330-4c1c-8ace-56137073854a None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:07:31.279406 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ab80dd-3cd8-4f37-a929-62b64541942f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3802cb341445f994b9204744060ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:07:31.280088 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ab80dd-3cd8-4f37-a929-62b64541942f service neutron] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:07:31.280375 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ab80dd-3cd8-4f37-a929-62b64541942f service neutron] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:07:31.280642 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ab80dd-3cd8-4f37-a929-62b64541942f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:07:31.282266 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-01ab80dd-3cd8-4f37-a929-62b64541942f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:07:31.392720 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ab80dd-3cd8-4f37-a929-62b64541942f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:07:31.394224 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ab80dd-3cd8-4f37-a929-62b64541942f service neutron] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:07:31.412430 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 653/1314] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:07:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:07:34.015507 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acde4c60-31c8-4fa2-a934-6729bb8ff6d2 None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:07:34.016113 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acde4c60-31c8-4fa2-a934-6729bb8ff6d2 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:07:34.016113 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acde4c60-31c8-4fa2-a934-6729bb8ff6d2 None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:07:34.017896 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 662/1315] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:07:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:07:34.023526 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5764ba-a7c0-423b-9db3-afa75802c71f None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:07:34.023993 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5764ba-a7c0-423b-9db3-afa75802c71f None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:07:34.024082 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5764ba-a7c0-423b-9db3-afa75802c71f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:07:34.099692 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-6c5764ba-a7c0-423b-9db3-afa75802c71f None None] MFA Rules not processed for user `733e72413c1843f3a51be8e04c684d6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:07:34.100920 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-6c5764ba-a7c0-423b-9db3-afa75802c71f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:07:34.206935 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 654/1316] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:07:34 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:07:34.249727 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acde4c60-31c8-4fa2-a934-6729bb8ff6d2 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:07:34.251261 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-acde4c60-31c8-4fa2-a934-6729bb8ff6d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:07:34.361279 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acde4c60-31c8-4fa2-a934-6729bb8ff6d2 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:07:34.433540 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42a42bc-0819-4b6c-94fd-972b282d2ddc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3802cb341445f994b9204744060ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:07:34.434461 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a42bc-0819-4b6c-94fd-972b282d2ddc service neutron] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:07:34.434821 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a42bc-0819-4b6c-94fd-972b282d2ddc service neutron] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:07:34.435181 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a42bc-0819-4b6c-94fd-972b282d2ddc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:07:34.437865 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-f42a42bc-0819-4b6c-94fd-972b282d2ddc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:07:34.556292 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42a42bc-0819-4b6c-94fd-972b282d2ddc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:07:34.557746 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42a42bc-0819-4b6c-94fd-972b282d2ddc service neutron] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:07:34.577604 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 663/1317] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:07:34 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:07:37.433365 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0a5405-f522-42d8-b124-8ab6f6152825 None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:07:37.434191 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0a5405-f522-42d8-b124-8ab6f6152825 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:07:37.434191 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0a5405-f522-42d8-b124-8ab6f6152825 None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:07:37.437843 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 655/1318] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:07:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:07:37.445872 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b398944-faee-4169-b67d-591bfe363a56 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:07:37.446298 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b398944-faee-4169-b67d-591bfe363a56 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:07:37.446387 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b398944-faee-4169-b67d-591bfe363a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:07:37.513089 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-0b398944-faee-4169-b67d-591bfe363a56 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:07:37.514274 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-0b398944-faee-4169-b67d-591bfe363a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:07:37.615851 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 664/1319] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:07:37 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:07:37.679106 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fdd12a-e65d-46de-b56f-60bbbd77b070 None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:07:37.679355 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fdd12a-e65d-46de-b56f-60bbbd77b070 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:07:37.679659 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fdd12a-e65d-46de-b56f-60bbbd77b070 None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:07:37.681493 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 656/1320] 10.222.0.20 () {54 vars in 963 bytes} [Wed Mar 30 07:07:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:07:37.690532 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb7ba24-a572-478c-84f9-33f8ef1246c2 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:07:37.690756 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb7ba24-a572-478c-84f9-33f8ef1246c2 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:07:37.691026 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb7ba24-a572-478c-84f9-33f8ef1246c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:07:37.784088 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-2cb7ba24-a572-478c-84f9-33f8ef1246c2 None None] MFA Rules not processed for user `54f3802cb341445f994b9204744060ae`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:07:37.785297 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-2cb7ba24-a572-478c-84f9-33f8ef1246c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:07:37.865291 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 665/1321] 10.222.0.20 () {58 vars in 1060 bytes} [Wed Mar 30 07:07:37 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:07:37.875330 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fdd12a-e65d-46de-b56f-60bbbd77b070 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:07:37.877764 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-d9fdd12a-e65d-46de-b56f-60bbbd77b070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:07:37.989739 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fdd12a-e65d-46de-b56f-60bbbd77b070 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:07:38.061936 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f913f3ce-1a5c-4f97-8a9a-5d77394b27de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3802cb341445f994b9204744060ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:07:38.062565 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f913f3ce-1a5c-4f97-8a9a-5d77394b27de service neutron] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:07:38.062848 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f913f3ce-1a5c-4f97-8a9a-5d77394b27de service neutron] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:07:38.063119 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f913f3ce-1a5c-4f97-8a9a-5d77394b27de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:07:38.064769 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-f913f3ce-1a5c-4f97-8a9a-5d77394b27de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:07:38.181452 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f913f3ce-1a5c-4f97-8a9a-5d77394b27de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:07:38.182887 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f913f3ce-1a5c-4f97-8a9a-5d77394b27de service neutron] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:07:38.202314 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 657/1322] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:07:37 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:07:41.642609 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9388b4-cb6b-4c79-8961-519e7a16b3c6 None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:07:41.643337 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9388b4-cb6b-4c79-8961-519e7a16b3c6 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:07:41.643562 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9388b4-cb6b-4c79-8961-519e7a16b3c6 None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:07:41.645293 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 666/1323] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:07:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:07:41.650798 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e789421-8775-43e4-ac70-81e24703098f None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:07:41.651197 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e789421-8775-43e4-ac70-81e24703098f None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:07:41.651378 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e789421-8775-43e4-ac70-81e24703098f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:07:41.718687 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-7e789421-8775-43e4-ac70-81e24703098f None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:07:41.719909 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-7e789421-8775-43e4-ac70-81e24703098f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:07:41.815003 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 658/1324] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:07:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:07:41.851015 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9388b4-cb6b-4c79-8961-519e7a16b3c6 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:07:41.852577 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-cb9388b4-cb6b-4c79-8961-519e7a16b3c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:07:41.960789 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9388b4-cb6b-4c79-8961-519e7a16b3c6 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:07:42.037688 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59feafd5-71f9-4a2d-909d-01ed1499f557 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3802cb341445f994b9204744060ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:07:42.038376 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59feafd5-71f9-4a2d-909d-01ed1499f557 service neutron] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:07:42.038654 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59feafd5-71f9-4a2d-909d-01ed1499f557 service neutron] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:07:42.038924 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59feafd5-71f9-4a2d-909d-01ed1499f557 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:07:42.040619 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-59feafd5-71f9-4a2d-909d-01ed1499f557 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:07:42.154022 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59feafd5-71f9-4a2d-909d-01ed1499f557 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:07:42.155485 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59feafd5-71f9-4a2d-909d-01ed1499f557 service neutron] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:07:42.176756 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 667/1325] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:07:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:07:44.566675 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6981302-b4c1-4b75-8e15-2824c840781a None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:07:44.567227 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6981302-b4c1-4b75-8e15-2824c840781a None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:07:44.567334 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6981302-b4c1-4b75-8e15-2824c840781a None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:07:44.569121 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 659/1326] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:07:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:07:44.574509 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a5e526-c397-4f89-9026-c3f911b13095 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:07:44.574957 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a5e526-c397-4f89-9026-c3f911b13095 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:07:44.575064 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a5e526-c397-4f89-9026-c3f911b13095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:07:44.644000 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-b1a5e526-c397-4f89-9026-c3f911b13095 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:07:44.645206 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-b1a5e526-c397-4f89-9026-c3f911b13095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:07:44.744779 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 668/1327] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:07:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:07:44.780829 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6981302-b4c1-4b75-8e15-2824c840781a None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:07:44.782385 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-e6981302-b4c1-4b75-8e15-2824c840781a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:07:44.887723 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6981302-b4c1-4b75-8e15-2824c840781a None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:07:44.959937 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60958b1b-df2c-4988-aebc-6d34558ded32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3802cb341445f994b9204744060ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:07:44.960580 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60958b1b-df2c-4988-aebc-6d34558ded32 service neutron] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:07:44.960859 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60958b1b-df2c-4988-aebc-6d34558ded32 service neutron] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:07:44.961126 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60958b1b-df2c-4988-aebc-6d34558ded32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:07:44.962828 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-60958b1b-df2c-4988-aebc-6d34558ded32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:07:45.076169 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60958b1b-df2c-4988-aebc-6d34558ded32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:07:45.077613 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60958b1b-df2c-4988-aebc-6d34558ded32 service neutron] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:07:45.095797 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 660/1328] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:07:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:07:47.441946 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5dff06-21d5-45e4-a896-f76ba23ef80a None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:07:47.442522 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5dff06-21d5-45e4-a896-f76ba23ef80a None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:07:47.442522 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5dff06-21d5-45e4-a896-f76ba23ef80a None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:07:47.444442 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 669/1329] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:07:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:07:47.450162 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86847cd-eb5a-47d2-9265-4b060c60b376 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:07:47.450604 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86847cd-eb5a-47d2-9265-4b060c60b376 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:07:47.450706 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86847cd-eb5a-47d2-9265-4b060c60b376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:07:47.516791 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-d86847cd-eb5a-47d2-9265-4b060c60b376 None None] MFA Rules not processed for user `733e72413c1843f3a51be8e04c684d6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:07:47.518050 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-d86847cd-eb5a-47d2-9265-4b060c60b376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:07:47.616836 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 661/1330] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:07:47 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:07:47.655212 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5dff06-21d5-45e4-a896-f76ba23ef80a None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:07:47.656931 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-9b5dff06-21d5-45e4-a896-f76ba23ef80a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:07:47.765306 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5dff06-21d5-45e4-a896-f76ba23ef80a None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:07:47.836953 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d923b703-ad05-42a8-924f-2741e51f60aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3802cb341445f994b9204744060ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:07:47.837605 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d923b703-ad05-42a8-924f-2741e51f60aa service neutron] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:07:47.837886 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d923b703-ad05-42a8-924f-2741e51f60aa service neutron] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:07:47.838166 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d923b703-ad05-42a8-924f-2741e51f60aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:07:47.839787 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-d923b703-ad05-42a8-924f-2741e51f60aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:07:47.949731 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d923b703-ad05-42a8-924f-2741e51f60aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:07:47.951188 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d923b703-ad05-42a8-924f-2741e51f60aa service neutron] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:07:47.969795 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 670/1331] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:07:47 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:07:50.490231 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558973ea-7f40-4658-b1f7-386b4f71f087 None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:07:50.490768 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558973ea-7f40-4658-b1f7-386b4f71f087 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:07:50.490768 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558973ea-7f40-4658-b1f7-386b4f71f087 None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:07:50.492525 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 662/1332] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:07:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:07:50.497953 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea52f9-2490-4732-9f71-0dca9dab4c4f None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:07:50.498370 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea52f9-2490-4732-9f71-0dca9dab4c4f None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:07:50.498472 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea52f9-2490-4732-9f71-0dca9dab4c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:07:50.565844 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-87ea52f9-2490-4732-9f71-0dca9dab4c4f None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:07:50.567130 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-87ea52f9-2490-4732-9f71-0dca9dab4c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:07:50.672444 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 671/1333] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:07:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:07:50.708505 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558973ea-7f40-4658-b1f7-386b4f71f087 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:07:50.710096 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-558973ea-7f40-4658-b1f7-386b4f71f087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:07:50.820910 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558973ea-7f40-4658-b1f7-386b4f71f087 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:07:50.891742 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a0454f-f697-4dd3-baa0-11b43493f2f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3802cb341445f994b9204744060ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:07:50.892409 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a0454f-f697-4dd3-baa0-11b43493f2f6 service neutron] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:07:50.892692 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a0454f-f697-4dd3-baa0-11b43493f2f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:07:50.892987 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a0454f-f697-4dd3-baa0-11b43493f2f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:07:50.894657 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-51a0454f-f697-4dd3-baa0-11b43493f2f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:07:51.001205 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a0454f-f697-4dd3-baa0-11b43493f2f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:07:51.002778 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a0454f-f697-4dd3-baa0-11b43493f2f6 service neutron] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:07:51.020866 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 663/1334] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:07:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:07:53.382429 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24df558-498c-4306-a4bb-4fabb599302b None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:07:53.382987 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24df558-498c-4306-a4bb-4fabb599302b None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:07:53.382987 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24df558-498c-4306-a4bb-4fabb599302b None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:07:53.385769 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 672/1335] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:07:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:07:53.393984 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1abec8-ae56-4cbc-b455-307384e68239 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:07:53.394415 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1abec8-ae56-4cbc-b455-307384e68239 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:07:53.394535 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1abec8-ae56-4cbc-b455-307384e68239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:07:53.459287 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-9b1abec8-ae56-4cbc-b455-307384e68239 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:07:53.460420 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-9b1abec8-ae56-4cbc-b455-307384e68239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:07:53.559140 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 664/1336] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:07:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:07:53.607647 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24df558-498c-4306-a4bb-4fabb599302b None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:07:53.609966 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-e24df558-498c-4306-a4bb-4fabb599302b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:07:53.717835 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24df558-498c-4306-a4bb-4fabb599302b None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:07:53.801044 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b45a656-140a-4fd6-afd2-e1307e0b80a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3802cb341445f994b9204744060ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:07:53.801683 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b45a656-140a-4fd6-afd2-e1307e0b80a7 service neutron] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:07:53.801959 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b45a656-140a-4fd6-afd2-e1307e0b80a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:07:53.802223 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b45a656-140a-4fd6-afd2-e1307e0b80a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:07:53.803842 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-8b45a656-140a-4fd6-afd2-e1307e0b80a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:07:53.920738 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b45a656-140a-4fd6-afd2-e1307e0b80a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:07:53.922172 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b45a656-140a-4fd6-afd2-e1307e0b80a7 service neutron] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:07:53.940620 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 673/1337] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:07:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:07:56.657541 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b0ffaf-7e43-4ad9-9b9f-9da50bdb5e4f None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:07:56.658117 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b0ffaf-7e43-4ad9-9b9f-9da50bdb5e4f None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:07:56.658117 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b0ffaf-7e43-4ad9-9b9f-9da50bdb5e4f None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:07:56.660119 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 665/1338] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:07:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:07:56.666024 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d5326a-af9d-4686-9937-f06898554467 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:07:56.666496 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d5326a-af9d-4686-9937-f06898554467 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:07:56.666594 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d5326a-af9d-4686-9937-f06898554467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:07:56.744423 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-33d5326a-af9d-4686-9937-f06898554467 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:07:56.745633 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-33d5326a-af9d-4686-9937-f06898554467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:07:56.848891 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 674/1339] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:07:56 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 07:07:56.896094 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b0ffaf-7e43-4ad9-9b9f-9da50bdb5e4f None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:07:56.897647 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-45b0ffaf-7e43-4ad9-9b9f-9da50bdb5e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:07:57.008345 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b0ffaf-7e43-4ad9-9b9f-9da50bdb5e4f None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:07:57.081254 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c0cf51-1351-47f0-92a4-e34d110081f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3802cb341445f994b9204744060ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:07:57.082304 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c0cf51-1351-47f0-92a4-e34d110081f7 service neutron] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:07:57.082852 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c0cf51-1351-47f0-92a4-e34d110081f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:07:57.083293 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c0cf51-1351-47f0-92a4-e34d110081f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:07:57.086050 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-58c0cf51-1351-47f0-92a4-e34d110081f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:07:57.214437 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c0cf51-1351-47f0-92a4-e34d110081f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:07:57.215929 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c0cf51-1351-47f0-92a4-e34d110081f7 service neutron] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:07:57.234406 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 666/1340] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:07:56 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:08:01.599352 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0eb9ab-4ee4-4f3f-bf40-f54590d65348 None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:08:01.600059 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0eb9ab-4ee4-4f3f-bf40-f54590d65348 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:08:01.600059 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0eb9ab-4ee4-4f3f-bf40-f54590d65348 None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:08:01.602293 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 675/1341] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:08:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:08:01.608238 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5339812-de09-4e62-b6f3-787428ca85c2 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:08:01.608655 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5339812-de09-4e62-b6f3-787428ca85c2 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:08:01.608782 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5339812-de09-4e62-b6f3-787428ca85c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:08:01.677285 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-f5339812-de09-4e62-b6f3-787428ca85c2 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:08:01.678467 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-f5339812-de09-4e62-b6f3-787428ca85c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:08:01.781744 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 667/1342] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:08:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:08:01.820203 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0eb9ab-4ee4-4f3f-bf40-f54590d65348 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:08:01.822691 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-8a0eb9ab-4ee4-4f3f-bf40-f54590d65348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:08:01.921329 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0eb9ab-4ee4-4f3f-bf40-f54590d65348 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:08:01.925123 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b357187-03de-40ca-bfa8-75c8d3b7b141 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3802cb341445f994b9204744060ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:08:01.925799 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b357187-03de-40ca-bfa8-75c8d3b7b141 service neutron] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:08:01.926103 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b357187-03de-40ca-bfa8-75c8d3b7b141 service neutron] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:08:01.926367 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b357187-03de-40ca-bfa8-75c8d3b7b141 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:08:01.935929 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b357187-03de-40ca-bfa8-75c8d3b7b141 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:08:01.937357 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b357187-03de-40ca-bfa8-75c8d3b7b141 service neutron] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:08:01.947455 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 676/1343] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:08:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:08:04.936722 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6dfd54-b037-47aa-8be1-55e3ebb3c674 None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:08:04.937293 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6dfd54-b037-47aa-8be1-55e3ebb3c674 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:08:04.937293 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6dfd54-b037-47aa-8be1-55e3ebb3c674 None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:08:04.939063 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 668/1344] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:08:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:08:04.945834 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae71aa-ff05-4ae5-9bf9-ae480c93548e None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:08:04.946356 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae71aa-ff05-4ae5-9bf9-ae480c93548e None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:08:04.946458 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae71aa-ff05-4ae5-9bf9-ae480c93548e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:08:04.976838 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-eaae71aa-ff05-4ae5-9bf9-ae480c93548e None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:08:04.978028 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-eaae71aa-ff05-4ae5-9bf9-ae480c93548e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:08:05.067336 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 677/1345] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:08:04 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:08:05.112047 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6dfd54-b037-47aa-8be1-55e3ebb3c674 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:08:05.123314 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6dfd54-b037-47aa-8be1-55e3ebb3c674 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:08:05.127130 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88504f59-0069-4759-a9d1-5567a1204de1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3802cb341445f994b9204744060ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:08:05.127843 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88504f59-0069-4759-a9d1-5567a1204de1 service neutron] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:08:05.128202 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88504f59-0069-4759-a9d1-5567a1204de1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:08:05.128640 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88504f59-0069-4759-a9d1-5567a1204de1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:08:05.137772 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88504f59-0069-4759-a9d1-5567a1204de1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:08:05.139313 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88504f59-0069-4759-a9d1-5567a1204de1 service neutron] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:08:05.148971 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 669/1346] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:08:05 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:08:09.698166 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84c976-e908-4291-b3e5-dd93396cdfb9 None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:08:09.698748 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84c976-e908-4291-b3e5-dd93396cdfb9 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:08:09.698856 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84c976-e908-4291-b3e5-dd93396cdfb9 None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:08:09.700935 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 678/1347] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:08:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:08:09.706152 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29189d3-e36f-4c9c-b54d-8bf63fd17888 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:08:09.706593 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29189d3-e36f-4c9c-b54d-8bf63fd17888 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:08:09.706817 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29189d3-e36f-4c9c-b54d-8bf63fd17888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:08:09.725235 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-b29189d3-e36f-4c9c-b54d-8bf63fd17888 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:08:09.726415 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-b29189d3-e36f-4c9c-b54d-8bf63fd17888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:08:09.735093 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 670/1348] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:08:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:08:09.772798 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f84c976-e908-4291-b3e5-dd93396cdfb9 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:08:09.774675 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-3f84c976-e908-4291-b3e5-dd93396cdfb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:08:09.789080 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f84c976-e908-4291-b3e5-dd93396cdfb9 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:08:09.792682 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abf0859-ba34-4141-8c6e-02d727b5554d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3802cb341445f994b9204744060ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:08:09.793966 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abf0859-ba34-4141-8c6e-02d727b5554d service neutron] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:08:09.794246 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abf0859-ba34-4141-8c6e-02d727b5554d service neutron] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:08:09.794518 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abf0859-ba34-4141-8c6e-02d727b5554d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:08:09.804149 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abf0859-ba34-4141-8c6e-02d727b5554d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:08:09.805594 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abf0859-ba34-4141-8c6e-02d727b5554d service neutron] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:08:09.816829 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 679/1349] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:08:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:08:15.146602 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae5e70-7e38-4755-b0e5-498a758aea91 None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:08:15.147114 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae5e70-7e38-4755-b0e5-498a758aea91 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:08:15.147114 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae5e70-7e38-4755-b0e5-498a758aea91 None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:08:15.149258 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 671/1350] 10.222.0.20 () {54 vars in 921 bytes} [Wed Mar 30 07:08:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:08:15.154305 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a156c81c-7b37-44bc-8edb-2f930adda6d0 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:08:15.154701 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a156c81c-7b37-44bc-8edb-2f930adda6d0 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:08:15.154850 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a156c81c-7b37-44bc-8edb-2f930adda6d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:08:15.268647 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-a156c81c-7b37-44bc-8edb-2f930adda6d0 None None] MFA Rules not processed for user `d634743546e8456fac2f6ab1aaee09ef`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:08:15.270126 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-a156c81c-7b37-44bc-8edb-2f930adda6d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:08:15.470916 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 680/1351] 10.222.0.20 () {58 vars in 1018 bytes} [Wed Mar 30 07:08:15 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 07:08:19.706736 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336eb396-a21f-43d2-ba2d-976ef0887bbc None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:08:19.707922 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336eb396-a21f-43d2-ba2d-976ef0887bbc None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:08:19.708303 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336eb396-a21f-43d2-ba2d-976ef0887bbc None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:08:19.710458 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 672/1352] 10.222.0.20 () {54 vars in 921 bytes} [Wed Mar 30 07:08:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:08:19.715784 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078ebe16-2e47-4c13-977d-9f09f62fc121 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:08:19.716263 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078ebe16-2e47-4c13-977d-9f09f62fc121 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:08:19.716341 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078ebe16-2e47-4c13-977d-9f09f62fc121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:08:19.735393 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-078ebe16-2e47-4c13-977d-9f09f62fc121 None None] MFA Rules not processed for user `d634743546e8456fac2f6ab1aaee09ef`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:08:19.736649 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-078ebe16-2e47-4c13-977d-9f09f62fc121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:08:19.746772 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 681/1353] 10.222.0.20 () {58 vars in 1018 bytes} [Wed Mar 30 07:08:19 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:08:21.233614 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e9fcf5-373a-4660-ac15-6301b2729aa0 None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:08:21.234209 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e9fcf5-373a-4660-ac15-6301b2729aa0 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:08:21.234209 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e9fcf5-373a-4660-ac15-6301b2729aa0 None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:08:21.236000 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 673/1354] 10.222.0.20 () {54 vars in 921 bytes} [Wed Mar 30 07:08:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:08:21.242258 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a2b392-16a6-4d75-a1ab-281c2a1b5a36 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:08:21.242869 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a2b392-16a6-4d75-a1ab-281c2a1b5a36 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:08:21.242869 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a2b392-16a6-4d75-a1ab-281c2a1b5a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:08:21.262795 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-83a2b392-16a6-4d75-a1ab-281c2a1b5a36 None None] MFA Rules not processed for user `d634743546e8456fac2f6ab1aaee09ef`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:08:21.264043 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-83a2b392-16a6-4d75-a1ab-281c2a1b5a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:08:21.274524 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 682/1355] 10.222.0.20 () {58 vars in 1018 bytes} [Wed Mar 30 07:08:21 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:08:25.095505 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a087153-fc96-4176-b4dd-fd4bba1b9dd4 None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:08:25.096144 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a087153-fc96-4176-b4dd-fd4bba1b9dd4 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:08:25.096144 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a087153-fc96-4176-b4dd-fd4bba1b9dd4 None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:08:25.098187 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 674/1356] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:08:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:08:25.103246 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332b0c44-fc9d-4e20-b58a-10e6207cbcdb None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:08:25.103699 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332b0c44-fc9d-4e20-b58a-10e6207cbcdb None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:08:25.103791 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332b0c44-fc9d-4e20-b58a-10e6207cbcdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:08:25.122477 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-332b0c44-fc9d-4e20-b58a-10e6207cbcdb None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:08:25.123638 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-332b0c44-fc9d-4e20-b58a-10e6207cbcdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:08:25.132015 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 683/1357] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:08:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 07:08:25.182345 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f71517-4248-4483-bb2f-59796d7973a9 None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:08:25.183084 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f71517-4248-4483-bb2f-59796d7973a9 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:08:25.184234 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f71517-4248-4483-bb2f-59796d7973a9 None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:08:25.187565 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 675/1358] 10.222.0.20 () {54 vars in 960 bytes} [Wed Mar 30 07:08:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:08:25.194285 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3d762b-50f0-43b2-b64f-c6ca11ff5b28 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:08:25.194639 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3d762b-50f0-43b2-b64f-c6ca11ff5b28 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:08:25.194893 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3d762b-50f0-43b2-b64f-c6ca11ff5b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:08:25.258932 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-3f3d762b-50f0-43b2-b64f-c6ca11ff5b28 None None] MFA Rules not processed for user `72b398c5ed14484d8b7a51fee900597b`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:08:25.260385 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-3f3d762b-50f0-43b2-b64f-c6ca11ff5b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:08:25.343971 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 684/1359] 10.222.0.20 () {58 vars in 1057 bytes} [Wed Mar 30 07:08:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:08:25.352582 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f71517-4248-4483-bb2f-59796d7973a9 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:08:25.367242 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f71517-4248-4483-bb2f-59796d7973a9 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:08:25.373443 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bb6f12-5ca2-4482-a38e-5c3248f0dc05 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72b398c5ed14484d8b7a51fee900597b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:08:25.374277 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bb6f12-5ca2-4482-a38e-5c3248f0dc05 service nova] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:08:25.374714 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bb6f12-5ca2-4482-a38e-5c3248f0dc05 service nova] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:08:25.375145 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bb6f12-5ca2-4482-a38e-5c3248f0dc05 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:08:25.384167 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bb6f12-5ca2-4482-a38e-5c3248f0dc05 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:08:25.385931 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bb6f12-5ca2-4482-a38e-5c3248f0dc05 service nova] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:08:25.396308 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 676/1360] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:08:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:08:27.927062 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b1bccf-951f-4519-82ee-48db3b9b53f8 None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:08:27.927584 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b1bccf-951f-4519-82ee-48db3b9b53f8 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:08:27.927710 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b1bccf-951f-4519-82ee-48db3b9b53f8 None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:08:27.929512 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 685/1361] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:08:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:08:27.935050 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5143ae7a-fc3f-4b77-9223-4d3281e54364 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:08:27.935454 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5143ae7a-fc3f-4b77-9223-4d3281e54364 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:08:27.935454 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5143ae7a-fc3f-4b77-9223-4d3281e54364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:08:27.954744 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-5143ae7a-fc3f-4b77-9223-4d3281e54364 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:08:27.956018 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-5143ae7a-fc3f-4b77-9223-4d3281e54364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:08:27.964740 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 677/1362] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:08:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:08:28.008388 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b1bccf-951f-4519-82ee-48db3b9b53f8 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:08:28.024310 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b1bccf-951f-4519-82ee-48db3b9b53f8 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:08:28.029879 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f46061-564e-45dc-ab28-917de5454c69 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72b398c5ed14484d8b7a51fee900597b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:08:28.030529 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f46061-564e-45dc-ab28-917de5454c69 service nova] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:08:28.030813 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f46061-564e-45dc-ab28-917de5454c69 service nova] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:08:28.031089 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f46061-564e-45dc-ab28-917de5454c69 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:08:28.040098 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f46061-564e-45dc-ab28-917de5454c69 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:08:28.041822 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f46061-564e-45dc-ab28-917de5454c69 service nova] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:08:28.053021 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 686/1363] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:08:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:08:30.647838 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150895e-74c3-4d4d-879b-def6b563472d None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:08:30.648353 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150895e-74c3-4d4d-879b-def6b563472d None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:08:30.648475 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150895e-74c3-4d4d-879b-def6b563472d None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:08:30.650214 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 678/1364] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:08:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:08:30.655467 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f4938e-833c-4584-9453-70c5087f49cd None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:08:30.655912 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f4938e-833c-4584-9453-70c5087f49cd None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:08:30.656070 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f4938e-833c-4584-9453-70c5087f49cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:08:30.674398 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-22f4938e-833c-4584-9453-70c5087f49cd None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:08:30.675627 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-22f4938e-833c-4584-9453-70c5087f49cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:08:30.684651 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 687/1365] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:08:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:08:30.730462 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cc1dde-c4d4-46ed-af6e-d5ff8b482ee7 None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:08:30.730748 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cc1dde-c4d4-46ed-af6e-d5ff8b482ee7 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:08:30.730990 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cc1dde-c4d4-46ed-af6e-d5ff8b482ee7 None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:08:30.733409 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 679/1366] 10.222.0.20 () {54 vars in 960 bytes} [Wed Mar 30 07:08:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:08:30.738692 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a86ae8-b2d9-4916-b52f-fbae79dc22e4 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:08:30.738944 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a86ae8-b2d9-4916-b52f-fbae79dc22e4 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:08:30.739533 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a86ae8-b2d9-4916-b52f-fbae79dc22e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:08:30.758245 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-48a86ae8-b2d9-4916-b52f-fbae79dc22e4 None None] MFA Rules not processed for user `72b398c5ed14484d8b7a51fee900597b`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:08:30.759415 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-48a86ae8-b2d9-4916-b52f-fbae79dc22e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:08:30.768813 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 688/1367] 10.222.0.20 () {58 vars in 1057 bytes} [Wed Mar 30 07:08:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:08:30.777005 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cc1dde-c4d4-46ed-af6e-d5ff8b482ee7 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:08:30.791995 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cc1dde-c4d4-46ed-af6e-d5ff8b482ee7 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:08:30.797333 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8594f5b3-e7ed-4413-bff1-feb50e529b38 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72b398c5ed14484d8b7a51fee900597b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:08:30.797964 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8594f5b3-e7ed-4413-bff1-feb50e529b38 service nova] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:08:30.798247 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8594f5b3-e7ed-4413-bff1-feb50e529b38 service nova] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:08:30.798487 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8594f5b3-e7ed-4413-bff1-feb50e529b38 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:08:30.813167 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8594f5b3-e7ed-4413-bff1-feb50e529b38 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:08:30.814802 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8594f5b3-e7ed-4413-bff1-feb50e529b38 service nova] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:08:30.824321 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 680/1368] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:08:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:08:33.251233 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3d61c3-012b-4d57-8b9d-e7955f80d2e1 None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:08:33.251857 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3d61c3-012b-4d57-8b9d-e7955f80d2e1 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:08:33.251857 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3d61c3-012b-4d57-8b9d-e7955f80d2e1 None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:08:33.253659 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 689/1369] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:08:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:08:33.259233 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de949d-d9c6-4337-a7b6-d1a609edbb06 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:08:33.260069 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de949d-d9c6-4337-a7b6-d1a609edbb06 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:08:33.260515 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de949d-d9c6-4337-a7b6-d1a609edbb06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:08:33.278973 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-96de949d-d9c6-4337-a7b6-d1a609edbb06 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:08:33.280494 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-96de949d-d9c6-4337-a7b6-d1a609edbb06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:08:33.288537 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 681/1370] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:08:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:08:33.333258 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3d61c3-012b-4d57-8b9d-e7955f80d2e1 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:08:33.341034 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71afa99c-cf05-4f2e-be12-adb0bcc881a2 None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:08:33.341294 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71afa99c-cf05-4f2e-be12-adb0bcc881a2 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:08:33.341756 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71afa99c-cf05-4f2e-be12-adb0bcc881a2 None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:08:33.343701 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 682/1371] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:08:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 30 07:08:33.348911 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab357f1-ec84-4c56-a5b3-0dfba5fc2378 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:08:33.349166 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab357f1-ec84-4c56-a5b3-0dfba5fc2378 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:08:33.349616 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab357f1-ec84-4c56-a5b3-0dfba5fc2378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:08:33.351330 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3d61c3-012b-4d57-8b9d-e7955f80d2e1 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:08:33.357502 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c542b55d-b59c-4362-9641-85f0f1b22200 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72b398c5ed14484d8b7a51fee900597b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:08:33.358168 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c542b55d-b59c-4362-9641-85f0f1b22200 service nova] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:08:33.358446 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c542b55d-b59c-4362-9641-85f0f1b22200 service nova] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:08:33.358708 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c542b55d-b59c-4362-9641-85f0f1b22200 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:08:33.367545 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c542b55d-b59c-4362-9641-85f0f1b22200 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:08:33.369150 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c542b55d-b59c-4362-9641-85f0f1b22200 service nova] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:08:33.370095 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-2ab357f1-ec84-4c56-a5b3-0dfba5fc2378 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:08:33.371284 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-2ab357f1-ec84-4c56-a5b3-0dfba5fc2378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:08:33.379109 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 690/1372] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:08:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 30 07:08:33.380514 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 683/1373] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:08:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 07:08:33.680383 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7227e2af-a3c4-4634-b3e8-d6148ac44183 None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:08:33.680673 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7227e2af-a3c4-4634-b3e8-d6148ac44183 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:08:33.680957 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7227e2af-a3c4-4634-b3e8-d6148ac44183 None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:08:33.683278 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 691/1374] 10.222.0.20 () {54 vars in 962 bytes} [Wed Mar 30 07:08:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:08:33.688103 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6748ea-8901-4d25-a37f-4b01cd5ecff9 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:08:33.688391 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6748ea-8901-4d25-a37f-4b01cd5ecff9 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:08:33.688666 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6748ea-8901-4d25-a37f-4b01cd5ecff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:08:33.743360 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-6f6748ea-8901-4d25-a37f-4b01cd5ecff9 None None] MFA Rules not processed for user `5e2fda180e8d448d895c40cdad34bc4c`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:08:33.744593 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-6f6748ea-8901-4d25-a37f-4b01cd5ecff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:08:33.803839 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 684/1375] 10.222.0.20 () {58 vars in 1059 bytes} [Wed Mar 30 07:08:33 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:08:33.811525 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7227e2af-a3c4-4634-b3e8-d6148ac44183 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:08:33.823010 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7227e2af-a3c4-4634-b3e8-d6148ac44183 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:08:33.826671 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411671b6-30f2-426f-a7c6-72993dde11c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e2fda180e8d448d895c40cdad34bc4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:08:33.827389 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411671b6-30f2-426f-a7c6-72993dde11c1 service cinder] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:08:33.828170 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411671b6-30f2-426f-a7c6-72993dde11c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:08:33.828759 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411671b6-30f2-426f-a7c6-72993dde11c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:08:33.838984 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411671b6-30f2-426f-a7c6-72993dde11c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:08:33.840631 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411671b6-30f2-426f-a7c6-72993dde11c1 service cinder] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:08:33.851067 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 692/1376] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:08:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:08:35.712583 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b2b68-346a-40ad-b2c8-45c07caad20f None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:08:35.713144 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b2b68-346a-40ad-b2c8-45c07caad20f None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:08:35.713144 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b2b68-346a-40ad-b2c8-45c07caad20f None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:08:35.714924 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 685/1377] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:08:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:08:35.720740 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17830adb-06c7-435d-b7e7-fc221219662e None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:08:35.721302 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17830adb-06c7-435d-b7e7-fc221219662e None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:08:35.721302 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17830adb-06c7-435d-b7e7-fc221219662e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:08:35.744084 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-17830adb-06c7-435d-b7e7-fc221219662e None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:08:35.745375 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-17830adb-06c7-435d-b7e7-fc221219662e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:08:35.755268 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 693/1378] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:08:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:08:35.799697 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1b2b68-346a-40ad-b2c8-45c07caad20f None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:08:35.815490 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1b2b68-346a-40ad-b2c8-45c07caad20f None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:08:35.821352 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8456a1-e3a7-4ee9-a419-185f8f18fe66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72b398c5ed14484d8b7a51fee900597b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:08:35.822005 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8456a1-e3a7-4ee9-a419-185f8f18fe66 service nova] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:08:35.822275 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8456a1-e3a7-4ee9-a419-185f8f18fe66 service nova] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:08:35.822549 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8456a1-e3a7-4ee9-a419-185f8f18fe66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:08:35.831398 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8456a1-e3a7-4ee9-a419-185f8f18fe66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:08:35.833102 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8456a1-e3a7-4ee9-a419-185f8f18fe66 service nova] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:08:35.842842 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 686/1379] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:08:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:08:38.199416 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4de333f-9576-4897-9ac4-2d7c8b604188 None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:08:38.200039 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4de333f-9576-4897-9ac4-2d7c8b604188 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:08:38.200039 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4de333f-9576-4897-9ac4-2d7c8b604188 None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:08:38.201750 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 694/1380] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:08:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:08:38.209143 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dec4d1-943e-4936-ab6c-bf43c88f5aee None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:08:38.209143 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dec4d1-943e-4936-ab6c-bf43c88f5aee None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:08:38.209143 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dec4d1-943e-4936-ab6c-bf43c88f5aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:08:38.230004 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-13dec4d1-943e-4936-ab6c-bf43c88f5aee None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:08:38.231185 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-13dec4d1-943e-4936-ab6c-bf43c88f5aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:08:38.240069 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 687/1381] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:08:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:08:38.283437 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4de333f-9576-4897-9ac4-2d7c8b604188 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:08:38.299683 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4de333f-9576-4897-9ac4-2d7c8b604188 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:08:38.305793 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050e42bc-2af4-4490-a0d2-0d7dbe7cb582 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72b398c5ed14484d8b7a51fee900597b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:08:38.306467 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050e42bc-2af4-4490-a0d2-0d7dbe7cb582 service nova] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:08:38.306745 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050e42bc-2af4-4490-a0d2-0d7dbe7cb582 service nova] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:08:38.307018 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050e42bc-2af4-4490-a0d2-0d7dbe7cb582 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:08:38.315270 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050e42bc-2af4-4490-a0d2-0d7dbe7cb582 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:08:38.317059 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050e42bc-2af4-4490-a0d2-0d7dbe7cb582 service nova] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:08:38.326556 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 695/1382] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:08:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:08:40.674115 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1f85ba-a060-40d0-94a8-53175af83b9c None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:08:40.674733 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1f85ba-a060-40d0-94a8-53175af83b9c None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:08:40.674904 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1f85ba-a060-40d0-94a8-53175af83b9c None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:08:40.677031 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 688/1383] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:08:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:08:40.682616 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7981b4a9-8435-4ec3-81ba-34f77468b0fe None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:08:40.683089 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7981b4a9-8435-4ec3-81ba-34f77468b0fe None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:08:40.683190 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7981b4a9-8435-4ec3-81ba-34f77468b0fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:08:40.701537 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-7981b4a9-8435-4ec3-81ba-34f77468b0fe None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:08:40.702737 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-7981b4a9-8435-4ec3-81ba-34f77468b0fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:08:40.711071 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 696/1384] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:08:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 07:08:40.752964 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1f85ba-a060-40d0-94a8-53175af83b9c None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:08:40.767544 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1f85ba-a060-40d0-94a8-53175af83b9c None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:08:40.773265 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943936a0-3c33-431e-8ce2-a073a6ae27df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72b398c5ed14484d8b7a51fee900597b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:08:40.773901 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943936a0-3c33-431e-8ce2-a073a6ae27df service nova] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:08:40.774182 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943936a0-3c33-431e-8ce2-a073a6ae27df service nova] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:08:40.774451 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943936a0-3c33-431e-8ce2-a073a6ae27df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:08:40.782998 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943936a0-3c33-431e-8ce2-a073a6ae27df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:08:40.784667 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943936a0-3c33-431e-8ce2-a073a6ae27df service nova] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:08:40.794620 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 689/1385] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:08:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 30 07:08:43.094596 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82892165-c324-423c-947f-4cf352eaaea4 None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:08:43.095171 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82892165-c324-423c-947f-4cf352eaaea4 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:08:43.095276 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82892165-c324-423c-947f-4cf352eaaea4 None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:08:43.097269 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 697/1386] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:08:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:08:43.103580 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c26fd01-03f9-4427-8838-77ec41448044 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:08:43.104031 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c26fd01-03f9-4427-8838-77ec41448044 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:08:43.104183 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c26fd01-03f9-4427-8838-77ec41448044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:08:43.125434 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-3c26fd01-03f9-4427-8838-77ec41448044 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:08:43.126610 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-3c26fd01-03f9-4427-8838-77ec41448044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:08:43.134878 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 690/1387] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:08:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:08:43.181584 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82892165-c324-423c-947f-4cf352eaaea4 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:08:43.200383 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82892165-c324-423c-947f-4cf352eaaea4 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:08:43.207156 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea0cf95-864d-4cb6-bfb4-3266c8c173ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72b398c5ed14484d8b7a51fee900597b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:08:43.207831 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea0cf95-864d-4cb6-bfb4-3266c8c173ad service nova] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:08:43.208117 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea0cf95-864d-4cb6-bfb4-3266c8c173ad service nova] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:08:43.208389 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea0cf95-864d-4cb6-bfb4-3266c8c173ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:08:43.217728 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea0cf95-864d-4cb6-bfb4-3266c8c173ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:08:43.219315 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea0cf95-864d-4cb6-bfb4-3266c8c173ad service nova] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:08:43.229359 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 698/1388] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:08:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:08:45.555793 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff529cb-4cfe-4a21-9ca4-db2ccdd800ce None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:08:45.556378 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff529cb-4cfe-4a21-9ca4-db2ccdd800ce None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:08:45.556378 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff529cb-4cfe-4a21-9ca4-db2ccdd800ce None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:08:45.558314 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 691/1389] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:08:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:08:45.568989 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf4ee54-5d5a-439f-a18e-7d8d7685af1d None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:08:45.569547 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf4ee54-5d5a-439f-a18e-7d8d7685af1d None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:08:45.569547 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf4ee54-5d5a-439f-a18e-7d8d7685af1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:08:45.591553 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-7cf4ee54-5d5a-439f-a18e-7d8d7685af1d None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:08:45.593000 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-7cf4ee54-5d5a-439f-a18e-7d8d7685af1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:08:45.601981 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 699/1390] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:08:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:08:45.656265 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff529cb-4cfe-4a21-9ca4-db2ccdd800ce None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:08:45.671146 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff529cb-4cfe-4a21-9ca4-db2ccdd800ce None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:08:45.676789 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dd7e1d-df72-428a-bf46-06a0b0434161 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72b398c5ed14484d8b7a51fee900597b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:08:45.677444 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dd7e1d-df72-428a-bf46-06a0b0434161 service nova] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:08:45.677718 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dd7e1d-df72-428a-bf46-06a0b0434161 service nova] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:08:45.678019 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dd7e1d-df72-428a-bf46-06a0b0434161 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:08:45.686381 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dd7e1d-df72-428a-bf46-06a0b0434161 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:08:45.688363 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dd7e1d-df72-428a-bf46-06a0b0434161 service nova] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:08:45.698492 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 692/1391] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:08:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:08:47.996026 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e56d25-2cca-47a1-aa0f-4ae797eabe80 None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:08:47.996594 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e56d25-2cca-47a1-aa0f-4ae797eabe80 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:08:47.996594 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e56d25-2cca-47a1-aa0f-4ae797eabe80 None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:08:47.998713 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 700/1392] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:08:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:08:48.006071 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8227f75-30ad-4071-ac94-4eef41f83efc None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:08:48.006529 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8227f75-30ad-4071-ac94-4eef41f83efc None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:08:48.006651 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8227f75-30ad-4071-ac94-4eef41f83efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:08:48.033506 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-b8227f75-30ad-4071-ac94-4eef41f83efc None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:08:48.035357 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-b8227f75-30ad-4071-ac94-4eef41f83efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:08:48.044880 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 693/1393] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:08:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:08:48.091915 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e56d25-2cca-47a1-aa0f-4ae797eabe80 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:08:48.109752 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e56d25-2cca-47a1-aa0f-4ae797eabe80 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:08:48.116960 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5285d94f-c1c6-4b4e-94e2-605a34864f22 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72b398c5ed14484d8b7a51fee900597b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:08:48.117602 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5285d94f-c1c6-4b4e-94e2-605a34864f22 service nova] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:08:48.117879 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5285d94f-c1c6-4b4e-94e2-605a34864f22 service nova] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:08:48.118147 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5285d94f-c1c6-4b4e-94e2-605a34864f22 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:08:48.128373 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5285d94f-c1c6-4b4e-94e2-605a34864f22 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:08:48.130312 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5285d94f-c1c6-4b4e-94e2-605a34864f22 service nova] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:08:48.141691 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 701/1394] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:08:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:08:50.495013 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceab103-d8fa-4c7f-894d-d9b536544daa None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:08:50.495593 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceab103-d8fa-4c7f-894d-d9b536544daa None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:08:50.495593 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceab103-d8fa-4c7f-894d-d9b536544daa None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:08:50.497492 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 694/1395] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:08:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 30 07:08:50.504790 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3900bb8-a5bd-40cc-b630-6652d0b93001 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:08:50.505289 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3900bb8-a5bd-40cc-b630-6652d0b93001 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:08:50.505770 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3900bb8-a5bd-40cc-b630-6652d0b93001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:08:50.531728 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-c3900bb8-a5bd-40cc-b630-6652d0b93001 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:08:50.533526 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-c3900bb8-a5bd-40cc-b630-6652d0b93001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:08:50.544918 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 702/1396] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:08:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:08:50.593185 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceab103-d8fa-4c7f-894d-d9b536544daa None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:08:50.609882 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceab103-d8fa-4c7f-894d-d9b536544daa None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:08:50.616646 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09a38fa-9bf2-4008-bbd3-43da4777bea9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72b398c5ed14484d8b7a51fee900597b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:08:50.617328 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a38fa-9bf2-4008-bbd3-43da4777bea9 service nova] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:08:50.617613 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a38fa-9bf2-4008-bbd3-43da4777bea9 service nova] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:08:50.617905 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a38fa-9bf2-4008-bbd3-43da4777bea9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:08:50.628452 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09a38fa-9bf2-4008-bbd3-43da4777bea9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:08:50.630108 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09a38fa-9bf2-4008-bbd3-43da4777bea9 service nova] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:08:50.640742 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 695/1397] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:08:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:08:53.053537 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f2c9ff-06e0-4343-9a48-9cc77975e6e5 None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:08:53.054215 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f2c9ff-06e0-4343-9a48-9cc77975e6e5 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:08:53.054215 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f2c9ff-06e0-4343-9a48-9cc77975e6e5 None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:08:53.055919 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 703/1398] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:08:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:08:53.061480 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeec6a9-eefa-499f-84f9-d6cefc18aa56 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:08:53.061906 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeec6a9-eefa-499f-84f9-d6cefc18aa56 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:08:53.062092 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeec6a9-eefa-499f-84f9-d6cefc18aa56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:08:53.081267 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-ddeec6a9-eefa-499f-84f9-d6cefc18aa56 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:08:53.082481 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-ddeec6a9-eefa-499f-84f9-d6cefc18aa56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:08:53.091046 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 696/1399] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:08:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:08:53.135852 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f2c9ff-06e0-4343-9a48-9cc77975e6e5 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:08:53.152039 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f2c9ff-06e0-4343-9a48-9cc77975e6e5 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:08:53.157934 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08469aed-e2f5-47b5-aa48-84c7cf841b35 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72b398c5ed14484d8b7a51fee900597b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:08:53.158590 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08469aed-e2f5-47b5-aa48-84c7cf841b35 service nova] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:08:53.158863 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08469aed-e2f5-47b5-aa48-84c7cf841b35 service nova] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:08:53.159139 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08469aed-e2f5-47b5-aa48-84c7cf841b35 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:08:53.167846 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08469aed-e2f5-47b5-aa48-84c7cf841b35 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:08:53.169446 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08469aed-e2f5-47b5-aa48-84c7cf841b35 service nova] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:08:53.178864 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 704/1400] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:08:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:08:53.815634 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad0c12-2661-4c41-ba3d-af6a3f845214 None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:08:53.816075 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad0c12-2661-4c41-ba3d-af6a3f845214 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:08:53.816653 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad0c12-2661-4c41-ba3d-af6a3f845214 None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:08:53.819518 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 697/1401] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:08:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:08:53.827850 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a0001-8e24-452d-bdca-4f6d33e217ea None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:08:53.828132 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a0001-8e24-452d-bdca-4f6d33e217ea None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:08:53.828586 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a0001-8e24-452d-bdca-4f6d33e217ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:08:53.854682 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-744a0001-8e24-452d-bdca-4f6d33e217ea None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:08:53.855883 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-744a0001-8e24-452d-bdca-4f6d33e217ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:08:53.865469 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 705/1402] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:08:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:08:53.923786 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82561c99-f16e-4ce4-b22a-56f463cf68ae None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:08:53.924184 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82561c99-f16e-4ce4-b22a-56f463cf68ae None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:08:53.924525 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82561c99-f16e-4ce4-b22a-56f463cf68ae None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:08:53.927190 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 698/1403] 10.222.0.20 () {54 vars in 961 bytes} [Wed Mar 30 07:08:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:08:53.933917 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc710459-187b-4313-a202-1202e6ff584b None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:08:53.934200 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc710459-187b-4313-a202-1202e6ff584b None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:08:53.934485 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc710459-187b-4313-a202-1202e6ff584b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:08:53.986035 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-fc710459-187b-4313-a202-1202e6ff584b None None] MFA Rules not processed for user `e880ade912f3412abf44ba73939d6e50`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:08:53.987225 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-fc710459-187b-4313-a202-1202e6ff584b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:08:54.048395 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 706/1404] 10.222.0.20 () {58 vars in 1058 bytes} [Wed Mar 30 07:08:53 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:08:54.057013 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82561c99-f16e-4ce4-b22a-56f463cf68ae None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:08:54.068800 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82561c99-f16e-4ce4-b22a-56f463cf68ae None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:08:54.072625 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c2faff-16d7-4059-bddd-3c095637cc96 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e880ade912f3412abf44ba73939d6e50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:08:54.073261 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c2faff-16d7-4059-bddd-3c095637cc96 service glance] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:08:54.073535 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c2faff-16d7-4059-bddd-3c095637cc96 service glance] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:08:54.073804 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c2faff-16d7-4059-bddd-3c095637cc96 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:08:54.083233 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c2faff-16d7-4059-bddd-3c095637cc96 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:08:54.084667 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c2faff-16d7-4059-bddd-3c095637cc96 service glance] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:08:54.093961 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 699/1405] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:08:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:08:54.525931 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9fa8b8-c474-4b83-90be-cabaf21da3fa None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:08:54.526410 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9fa8b8-c474-4b83-90be-cabaf21da3fa None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:08:54.526513 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9fa8b8-c474-4b83-90be-cabaf21da3fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:08:54.575915 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-5c9fa8b8-c474-4b83-90be-cabaf21da3fa None None] MFA Rules not processed for user `67102c1adcf0491e9ecdef970ab2d5ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:08:54.577118 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-5c9fa8b8-c474-4b83-90be-cabaf21da3fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:08:54.648532 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 707/1406] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Mar 30 07:08:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:08:54.695159 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d353cd54-eba0-4c24-b9ee-e9de2df2a065 None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:08:54.695534 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d353cd54-eba0-4c24-b9ee-e9de2df2a065 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:08:54.695907 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d353cd54-eba0-4c24-b9ee-e9de2df2a065 None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:08:54.698571 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 700/1407] 10.222.0.20 () {54 vars in 942 bytes} [Wed Mar 30 07:08:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:08:54.706324 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37290a6b-4a41-4df9-a072-a4aa3003d167 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:08:54.706669 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37290a6b-4a41-4df9-a072-a4aa3003d167 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:08:54.707002 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37290a6b-4a41-4df9-a072-a4aa3003d167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:08:54.760922 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-37290a6b-4a41-4df9-a072-a4aa3003d167 None None] MFA Rules not processed for user `c452249c502d4b0688e8dd068f8c4951`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:08:54.762140 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-37290a6b-4a41-4df9-a072-a4aa3003d167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:08:54.839079 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 708/1408] 10.222.0.20 () {58 vars in 1039 bytes} [Wed Mar 30 07:08:54 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:08:54.848773 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d353cd54-eba0-4c24-b9ee-e9de2df2a065 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:08:54.864373 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d353cd54-eba0-4c24-b9ee-e9de2df2a065 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:08:54.871113 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c2288f-0d3d-4771-8cd5-971ef770ac02 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c452249c502d4b0688e8dd068f8c4951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:08:54.871780 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c2288f-0d3d-4771-8cd5-971ef770ac02 service swift] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:08:54.872097 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c2288f-0d3d-4771-8cd5-971ef770ac02 service swift] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:08:54.872371 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c2288f-0d3d-4771-8cd5-971ef770ac02 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:08:54.881082 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c2288f-0d3d-4771-8cd5-971ef770ac02 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:08:54.882682 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c2288f-0d3d-4771-8cd5-971ef770ac02 service swift] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:08:54.891208 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 701/1409] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Mar 30 07:08:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 30 07:09:18.273883 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d3254b-08e6-4b2b-88b7-dfa3af2ff8ac None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:09:18.274561 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d3254b-08e6-4b2b-88b7-dfa3af2ff8ac None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:09:18.274561 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d3254b-08e6-4b2b-88b7-dfa3af2ff8ac None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:09:18.276257 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 709/1410] 10.222.0.20 () {54 vars in 918 bytes} [Wed Mar 30 07:09:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:09:18.281690 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300de4cd-9162-456f-af16-175f93ce5a69 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:09:18.282166 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300de4cd-9162-456f-af16-175f93ce5a69 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:09:18.282269 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300de4cd-9162-456f-af16-175f93ce5a69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:09:18.302401 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-300de4cd-9162-456f-af16-175f93ce5a69 None None] MFA Rules not processed for user `d634743546e8456fac2f6ab1aaee09ef`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:09:18.303608 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-300de4cd-9162-456f-af16-175f93ce5a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:09:18.317177 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 702/1411] 10.222.0.20 () {58 vars in 1015 bytes} [Wed Mar 30 07:09:18 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:09:18.336510 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7282552e-c595-496f-b76a-6f3893a1779d None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:09:18.336784 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7282552e-c595-496f-b76a-6f3893a1779d None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:09:18.337114 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7282552e-c595-496f-b76a-6f3893a1779d None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:09:18.339709 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 710/1412] 10.222.0.20 () {54 vars in 918 bytes} [Wed Mar 30 07:09:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:09:18.344488 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ecd3cb-2d7f-449a-9c33-36f16996767d None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:09:18.344777 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ecd3cb-2d7f-449a-9c33-36f16996767d None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:09:18.345050 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ecd3cb-2d7f-449a-9c33-36f16996767d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:09:18.365085 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-e6ecd3cb-2d7f-449a-9c33-36f16996767d None None] MFA Rules not processed for user `72b398c5ed14484d8b7a51fee900597b`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:09:18.366255 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-e6ecd3cb-2d7f-449a-9c33-36f16996767d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:09:18.377550 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 703/1413] 10.222.0.20 () {58 vars in 1015 bytes} [Wed Mar 30 07:09:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:09:21.185237 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b792a07-b01a-445b-bd94-a6e88d1dfe53 None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:09:21.185854 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b792a07-b01a-445b-bd94-a6e88d1dfe53 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:09:21.185854 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b792a07-b01a-445b-bd94-a6e88d1dfe53 None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:09:21.187590 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 711/1414] 127.0.0.1 () {54 vars in 916 bytes} [Wed Mar 30 07:09:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:09:21.194078 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a284cd54-62d7-438c-a8e8-4bc0af3a0eb3 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:09:21.194783 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a284cd54-62d7-438c-a8e8-4bc0af3a0eb3 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:09:21.195090 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a284cd54-62d7-438c-a8e8-4bc0af3a0eb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:09:21.216814 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-a284cd54-62d7-438c-a8e8-4bc0af3a0eb3 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:09:21.218003 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-a284cd54-62d7-438c-a8e8-4bc0af3a0eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:09:21.227102 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 704/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Mar 30 07:09:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:09:21.269237 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b792a07-b01a-445b-bd94-a6e88d1dfe53 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:09:21.285611 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b792a07-b01a-445b-bd94-a6e88d1dfe53 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:09:21.291550 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e210c3bf-af42-401c-856a-fa05fd6f17e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72b398c5ed14484d8b7a51fee900597b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:09:21.292231 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e210c3bf-af42-401c-856a-fa05fd6f17e4 service nova] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:09:21.292468 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e210c3bf-af42-401c-856a-fa05fd6f17e4 service nova] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:09:21.292760 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e210c3bf-af42-401c-856a-fa05fd6f17e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:09:21.301751 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e210c3bf-af42-401c-856a-fa05fd6f17e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:09:21.303336 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e210c3bf-af42-401c-856a-fa05fd6f17e4 service nova] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:09:21.313050 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 712/1416] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:09:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:09:22.692614 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de9ee8-5df7-4215-acff-4f61b5004ac2 None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:09:22.693228 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de9ee8-5df7-4215-acff-4f61b5004ac2 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:09:22.693228 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de9ee8-5df7-4215-acff-4f61b5004ac2 None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:09:22.696120 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 705/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Mar 30 07:09:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:09:22.702239 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd423f2-05d8-47f4-abf1-e1d2e74046c2 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:09:22.702678 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd423f2-05d8-47f4-abf1-e1d2e74046c2 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:09:22.702815 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd423f2-05d8-47f4-abf1-e1d2e74046c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:09:22.725771 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-2dd423f2-05d8-47f4-abf1-e1d2e74046c2 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:09:22.726977 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-2dd423f2-05d8-47f4-abf1-e1d2e74046c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:09:22.737206 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 713/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Mar 30 07:09:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:09:22.913729 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06de9ee8-5df7-4215-acff-4f61b5004ac2 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:09:22.929031 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06de9ee8-5df7-4215-acff-4f61b5004ac2 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:09:22.934770 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a68215-d655-4474-b488-011897586515 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72b398c5ed14484d8b7a51fee900597b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:09:22.935403 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a68215-d655-4474-b488-011897586515 service nova] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:09:22.935680 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a68215-d655-4474-b488-011897586515 service nova] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:09:22.935980 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a68215-d655-4474-b488-011897586515 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:09:22.944306 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a68215-d655-4474-b488-011897586515 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:09:22.945816 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a68215-d655-4474-b488-011897586515 service nova] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:09:22.955122 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 706/1419] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:09:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 30 07:09:24.253228 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2b0106-b264-4ecc-8382-56bcde71bfb8 None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:09:24.253831 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2b0106-b264-4ecc-8382-56bcde71bfb8 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:09:24.254117 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2b0106-b264-4ecc-8382-56bcde71bfb8 None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:09:24.256751 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 714/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Mar 30 07:09:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:09:24.264174 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167228e5-dc85-426e-91e5-539d70df998a None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:09:24.264597 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167228e5-dc85-426e-91e5-539d70df998a None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:09:24.264723 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167228e5-dc85-426e-91e5-539d70df998a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:09:24.284375 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-167228e5-dc85-426e-91e5-539d70df998a None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:09:24.285608 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-167228e5-dc85-426e-91e5-539d70df998a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:09:24.294998 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 707/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Mar 30 07:09:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:09:24.450882 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2b0106-b264-4ecc-8382-56bcde71bfb8 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:09:24.475034 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2b0106-b264-4ecc-8382-56bcde71bfb8 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:09:24.481992 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70f3c64-d87c-4879-9e9a-15e51e38fe49 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72b398c5ed14484d8b7a51fee900597b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:09:24.482993 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70f3c64-d87c-4879-9e9a-15e51e38fe49 service nova] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:09:24.483275 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70f3c64-d87c-4879-9e9a-15e51e38fe49 service nova] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:09:24.483545 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70f3c64-d87c-4879-9e9a-15e51e38fe49 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:09:24.492655 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70f3c64-d87c-4879-9e9a-15e51e38fe49 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:09:24.494257 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70f3c64-d87c-4879-9e9a-15e51e38fe49 service nova] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:09:24.504521 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 715/1422] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:09:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:09:25.796644 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aca68f4-2a98-4c25-a270-20c8af34b135 None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:09:25.797290 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aca68f4-2a98-4c25-a270-20c8af34b135 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:09:25.797290 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aca68f4-2a98-4c25-a270-20c8af34b135 None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:09:25.798996 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 708/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Mar 30 07:09:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:09:25.804250 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4239b0e3-7095-4de5-96c0-8ccf1fe14e26 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:09:25.804698 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4239b0e3-7095-4de5-96c0-8ccf1fe14e26 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:09:25.804811 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4239b0e3-7095-4de5-96c0-8ccf1fe14e26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:09:25.824937 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-4239b0e3-7095-4de5-96c0-8ccf1fe14e26 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:09:25.826129 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-4239b0e3-7095-4de5-96c0-8ccf1fe14e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:09:25.835345 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 716/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Mar 30 07:09:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:09:25.987410 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aca68f4-2a98-4c25-a270-20c8af34b135 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:09:26.010384 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aca68f4-2a98-4c25-a270-20c8af34b135 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:09:26.017054 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f777a1d-9915-43c3-b416-08ba7533fbce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72b398c5ed14484d8b7a51fee900597b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:09:26.017688 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f777a1d-9915-43c3-b416-08ba7533fbce service nova] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:09:26.017963 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f777a1d-9915-43c3-b416-08ba7533fbce service nova] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:09:26.018231 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f777a1d-9915-43c3-b416-08ba7533fbce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:09:26.026768 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f777a1d-9915-43c3-b416-08ba7533fbce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:09:26.028393 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f777a1d-9915-43c3-b416-08ba7533fbce service nova] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:09:26.037791 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 709/1425] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:09:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:09:27.337734 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8571d6-194f-450e-8721-0ed083491396 None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:09:27.338342 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8571d6-194f-450e-8721-0ed083491396 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:09:27.338342 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8571d6-194f-450e-8721-0ed083491396 None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:09:27.340117 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 717/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Mar 30 07:09:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:09:27.346236 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6427b7f3-6dac-44c6-9997-59eb9d82af72 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:09:27.346937 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6427b7f3-6dac-44c6-9997-59eb9d82af72 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:09:27.347105 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6427b7f3-6dac-44c6-9997-59eb9d82af72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:09:27.373755 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-6427b7f3-6dac-44c6-9997-59eb9d82af72 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:09:27.374958 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-6427b7f3-6dac-44c6-9997-59eb9d82af72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:09:27.384569 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 710/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Mar 30 07:09:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:09:27.534788 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8571d6-194f-450e-8721-0ed083491396 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:09:27.560177 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8571d6-194f-450e-8721-0ed083491396 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:09:27.568902 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fbeb22-673f-427e-b8ad-96eaa28f3c50 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72b398c5ed14484d8b7a51fee900597b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:09:27.569543 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fbeb22-673f-427e-b8ad-96eaa28f3c50 service nova] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:09:27.569822 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fbeb22-673f-427e-b8ad-96eaa28f3c50 service nova] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:09:27.570094 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fbeb22-673f-427e-b8ad-96eaa28f3c50 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:09:27.579008 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fbeb22-673f-427e-b8ad-96eaa28f3c50 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:09:27.580648 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fbeb22-673f-427e-b8ad-96eaa28f3c50 service nova] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:09:27.590455 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 718/1428] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:09:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:09:28.863412 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2ca76d-6a9b-4e0f-9a48-50fae4f04990 None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:09:28.864018 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2ca76d-6a9b-4e0f-9a48-50fae4f04990 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:09:28.864018 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2ca76d-6a9b-4e0f-9a48-50fae4f04990 None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:09:28.865786 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 711/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Mar 30 07:09:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:09:28.872161 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69897090-8f65-4593-8106-029a46592766 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:09:28.872607 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69897090-8f65-4593-8106-029a46592766 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:09:28.872733 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69897090-8f65-4593-8106-029a46592766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:09:28.895417 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-69897090-8f65-4593-8106-029a46592766 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:09:28.896662 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-69897090-8f65-4593-8106-029a46592766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:09:28.906567 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 719/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Mar 30 07:09:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:09:29.073445 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2ca76d-6a9b-4e0f-9a48-50fae4f04990 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:09:29.089790 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2ca76d-6a9b-4e0f-9a48-50fae4f04990 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:09:29.095915 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18545940-0a60-479f-9cde-277ead2532ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72b398c5ed14484d8b7a51fee900597b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:09:29.096545 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18545940-0a60-479f-9cde-277ead2532ba service nova] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:09:29.096822 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18545940-0a60-479f-9cde-277ead2532ba service nova] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:09:29.097157 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18545940-0a60-479f-9cde-277ead2532ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:09:29.105358 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18545940-0a60-479f-9cde-277ead2532ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:09:29.106941 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18545940-0a60-479f-9cde-277ead2532ba service nova] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:09:29.117061 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 712/1431] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:09:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:09:30.345521 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36079a1-5c10-4018-bd8a-deae644dac7e None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:09:30.346434 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36079a1-5c10-4018-bd8a-deae644dac7e None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:09:30.346434 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36079a1-5c10-4018-bd8a-deae644dac7e None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:09:30.349453 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 720/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Mar 30 07:09:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:09:30.354649 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c320bc36-161e-436e-98f1-46d03f29f32c None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:09:30.355072 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c320bc36-161e-436e-98f1-46d03f29f32c None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:09:30.355207 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c320bc36-161e-436e-98f1-46d03f29f32c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:09:30.374423 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-c320bc36-161e-436e-98f1-46d03f29f32c None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:09:30.375576 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-c320bc36-161e-436e-98f1-46d03f29f32c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:09:30.383906 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 713/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Mar 30 07:09:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:09:30.535344 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36079a1-5c10-4018-bd8a-deae644dac7e None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:09:30.560526 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36079a1-5c10-4018-bd8a-deae644dac7e None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:09:30.569627 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f81a3e3-7a7e-4c57-836d-23d156dd7e62 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72b398c5ed14484d8b7a51fee900597b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:09:30.570268 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f81a3e3-7a7e-4c57-836d-23d156dd7e62 service nova] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:09:30.570549 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f81a3e3-7a7e-4c57-836d-23d156dd7e62 service nova] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:09:30.570820 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f81a3e3-7a7e-4c57-836d-23d156dd7e62 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:09:30.579866 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f81a3e3-7a7e-4c57-836d-23d156dd7e62 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:09:30.581519 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f81a3e3-7a7e-4c57-836d-23d156dd7e62 service nova] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:09:30.591588 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 721/1434] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:09:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:09:31.849263 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa759596-358b-430c-adce-c3eee5436b3a None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:09:31.850142 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa759596-358b-430c-adce-c3eee5436b3a None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:09:31.850142 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa759596-358b-430c-adce-c3eee5436b3a None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:09:31.853199 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 714/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Mar 30 07:09:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:09:31.861984 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25fe5d3-69f1-4be1-8bb3-16d044cc3882 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:09:31.862843 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25fe5d3-69f1-4be1-8bb3-16d044cc3882 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:09:31.863218 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25fe5d3-69f1-4be1-8bb3-16d044cc3882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:09:31.883991 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-d25fe5d3-69f1-4be1-8bb3-16d044cc3882 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:09:31.885189 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-d25fe5d3-69f1-4be1-8bb3-16d044cc3882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:09:31.894914 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 722/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Mar 30 07:09:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:09:32.049475 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa759596-358b-430c-adce-c3eee5436b3a None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:09:32.066060 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa759596-358b-430c-adce-c3eee5436b3a None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:09:32.072172 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502ace9a-7cc0-40b3-be89-d06fbc59c5de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72b398c5ed14484d8b7a51fee900597b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:09:32.072796 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502ace9a-7cc0-40b3-be89-d06fbc59c5de service nova] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:09:32.073078 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502ace9a-7cc0-40b3-be89-d06fbc59c5de service nova] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:09:32.073343 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502ace9a-7cc0-40b3-be89-d06fbc59c5de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:09:32.081677 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502ace9a-7cc0-40b3-be89-d06fbc59c5de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:09:32.083249 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502ace9a-7cc0-40b3-be89-d06fbc59c5de service nova] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:09:32.092409 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 715/1437] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:09:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:09:33.367223 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeb3f87-70f5-4228-96df-85906dfb1c0a None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:09:33.367855 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeb3f87-70f5-4228-96df-85906dfb1c0a None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:09:33.367855 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeb3f87-70f5-4228-96df-85906dfb1c0a None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:09:33.369596 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 723/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Mar 30 07:09:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:09:33.374843 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a1e9a1-9356-4f0a-9249-63b3a531cb97 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:09:33.375313 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a1e9a1-9356-4f0a-9249-63b3a531cb97 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:09:33.375416 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a1e9a1-9356-4f0a-9249-63b3a531cb97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:09:33.394751 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-46a1e9a1-9356-4f0a-9249-63b3a531cb97 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:09:33.395977 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-46a1e9a1-9356-4f0a-9249-63b3a531cb97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:09:33.404593 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 716/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Mar 30 07:09:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:09:33.563868 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeb3f87-70f5-4228-96df-85906dfb1c0a None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:09:33.586856 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeb3f87-70f5-4228-96df-85906dfb1c0a None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:09:33.595929 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3692fcd-772c-4bac-9359-6811e63f79fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72b398c5ed14484d8b7a51fee900597b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:09:33.596957 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3692fcd-772c-4bac-9359-6811e63f79fc service nova] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:09:33.597237 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3692fcd-772c-4bac-9359-6811e63f79fc service nova] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:09:33.597510 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3692fcd-772c-4bac-9359-6811e63f79fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:09:33.606023 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3692fcd-772c-4bac-9359-6811e63f79fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:09:33.607623 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3692fcd-772c-4bac-9359-6811e63f79fc service nova] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:09:33.618313 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 724/1440] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:09:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:09:35.777283 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19adb65-58ba-4e84-93e8-1228f24365c0 None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:09:35.778192 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19adb65-58ba-4e84-93e8-1228f24365c0 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:09:35.778192 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19adb65-58ba-4e84-93e8-1228f24365c0 None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:09:35.781679 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 717/1441] 127.0.0.1 () {54 vars in 916 bytes} [Wed Mar 30 07:09:35 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:09:35.788567 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107b64d1-54c3-415d-8582-4d4f45b6a762 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:09:35.789239 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107b64d1-54c3-415d-8582-4d4f45b6a762 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:09:35.789239 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107b64d1-54c3-415d-8582-4d4f45b6a762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:09:35.807424 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-107b64d1-54c3-415d-8582-4d4f45b6a762 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:09:35.808629 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-107b64d1-54c3-415d-8582-4d4f45b6a762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:09:35.818456 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 725/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Mar 30 07:09:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 07:09:35.860664 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19adb65-58ba-4e84-93e8-1228f24365c0 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:09:35.878651 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19adb65-58ba-4e84-93e8-1228f24365c0 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:09:35.883202 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d917f6-9be9-4a7b-bf31-755f16a666b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3802cb341445f994b9204744060ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:09:35.883849 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d917f6-9be9-4a7b-bf31-755f16a666b0 service neutron] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:09:35.884154 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d917f6-9be9-4a7b-bf31-755f16a666b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:09:35.884420 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d917f6-9be9-4a7b-bf31-755f16a666b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:09:35.894370 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d917f6-9be9-4a7b-bf31-755f16a666b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:09:35.895895 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d917f6-9be9-4a7b-bf31-755f16a666b0 service neutron] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:09:35.905154 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 718/1443] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:09:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:09:38.321131 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b1176-1e14-4b6e-aa8b-4b279df721c8 None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:09:38.322061 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b1176-1e14-4b6e-aa8b-4b279df721c8 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:09:38.322061 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b1176-1e14-4b6e-aa8b-4b279df721c8 None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:09:38.324930 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 726/1444] 127.0.0.1 () {54 vars in 916 bytes} [Wed Mar 30 07:09:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:09:38.333359 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64369947-6168-4e22-891e-158c1fa24d69 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:09:38.333781 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64369947-6168-4e22-891e-158c1fa24d69 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:09:38.333929 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64369947-6168-4e22-891e-158c1fa24d69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:09:38.352545 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-64369947-6168-4e22-891e-158c1fa24d69 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:09:38.353739 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-64369947-6168-4e22-891e-158c1fa24d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:09:38.362726 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 719/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Mar 30 07:09:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:09:38.417825 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64b1176-1e14-4b6e-aa8b-4b279df721c8 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:09:38.433128 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64b1176-1e14-4b6e-aa8b-4b279df721c8 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:09:38.437543 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa293ddf-72ce-48c4-a3d0-2ec3b8b4c3e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3802cb341445f994b9204744060ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:09:38.438180 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa293ddf-72ce-48c4-a3d0-2ec3b8b4c3e9 service neutron] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:09:38.438465 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa293ddf-72ce-48c4-a3d0-2ec3b8b4c3e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:09:38.438741 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa293ddf-72ce-48c4-a3d0-2ec3b8b4c3e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:09:38.448995 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa293ddf-72ce-48c4-a3d0-2ec3b8b4c3e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:09:38.450427 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa293ddf-72ce-48c4-a3d0-2ec3b8b4c3e9 service neutron] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:09:38.460272 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 727/1446] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:09:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:09:41.137514 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e03a92e-dd03-479d-b139-afd30863a5ee None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:09:41.138478 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e03a92e-dd03-479d-b139-afd30863a5ee None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:09:41.138478 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e03a92e-dd03-479d-b139-afd30863a5ee None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:09:41.141273 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 720/1447] 127.0.0.1 () {54 vars in 916 bytes} [Wed Mar 30 07:09:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:09:41.150212 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed32209-7a8a-4f7e-a316-a872ae598d09 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:09:41.150645 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed32209-7a8a-4f7e-a316-a872ae598d09 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:09:41.150778 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed32209-7a8a-4f7e-a316-a872ae598d09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:09:41.172592 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-5ed32209-7a8a-4f7e-a316-a872ae598d09 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:09:41.173811 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-5ed32209-7a8a-4f7e-a316-a872ae598d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:09:41.182240 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 728/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Mar 30 07:09:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:09:41.220332 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e03a92e-dd03-479d-b139-afd30863a5ee None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:09:41.232331 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e03a92e-dd03-479d-b139-afd30863a5ee None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:09:41.236678 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8915c6d2-ddd9-4f58-9bd5-4ff7bf7d5ce8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3802cb341445f994b9204744060ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:09:41.237345 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8915c6d2-ddd9-4f58-9bd5-4ff7bf7d5ce8 service neutron] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:09:41.237611 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8915c6d2-ddd9-4f58-9bd5-4ff7bf7d5ce8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:09:41.237887 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8915c6d2-ddd9-4f58-9bd5-4ff7bf7d5ce8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:09:41.247089 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8915c6d2-ddd9-4f58-9bd5-4ff7bf7d5ce8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:09:41.248563 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8915c6d2-ddd9-4f58-9bd5-4ff7bf7d5ce8 service neutron] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:09:41.258009 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 721/1449] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:09:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:09:43.671488 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542199f0-127c-4ec4-af40-f7afb61aac77 None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:09:43.672113 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542199f0-127c-4ec4-af40-f7afb61aac77 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:09:43.672113 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542199f0-127c-4ec4-af40-f7afb61aac77 None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:09:43.673853 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 729/1450] 127.0.0.1 () {54 vars in 916 bytes} [Wed Mar 30 07:09:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:09:43.680387 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf6dca-5bd7-48f1-96cc-7ab7e8f6114f None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:09:43.681184 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf6dca-5bd7-48f1-96cc-7ab7e8f6114f None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:09:43.681184 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf6dca-5bd7-48f1-96cc-7ab7e8f6114f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:09:43.709265 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-9bbf6dca-5bd7-48f1-96cc-7ab7e8f6114f None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:09:43.710467 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-9bbf6dca-5bd7-48f1-96cc-7ab7e8f6114f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:09:43.719813 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 722/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Mar 30 07:09:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:09:43.760013 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542199f0-127c-4ec4-af40-f7afb61aac77 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:09:43.771104 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542199f0-127c-4ec4-af40-f7afb61aac77 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:09:43.774826 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a6f9b7-888d-44ab-8237-ac39c3cc50f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3802cb341445f994b9204744060ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:09:43.775459 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a6f9b7-888d-44ab-8237-ac39c3cc50f2 service neutron] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:09:43.775737 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a6f9b7-888d-44ab-8237-ac39c3cc50f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:09:43.776044 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a6f9b7-888d-44ab-8237-ac39c3cc50f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:09:43.785161 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a6f9b7-888d-44ab-8237-ac39c3cc50f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:09:43.786606 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a6f9b7-888d-44ab-8237-ac39c3cc50f2 service neutron] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:09:43.796044 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 730/1452] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:09:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:09:46.197039 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbab8a0-53fe-4adb-8acc-18016f808401 None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:09:46.198002 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbab8a0-53fe-4adb-8acc-18016f808401 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:09:46.198002 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbab8a0-53fe-4adb-8acc-18016f808401 None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:09:46.200893 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 723/1453] 127.0.0.1 () {54 vars in 916 bytes} [Wed Mar 30 07:09:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:09:46.207779 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca08339-fce2-4b41-afd2-cebf201a0cdb None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:09:46.208272 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca08339-fce2-4b41-afd2-cebf201a0cdb None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:09:46.208383 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca08339-fce2-4b41-afd2-cebf201a0cdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:09:46.232223 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-2ca08339-fce2-4b41-afd2-cebf201a0cdb None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:09:46.233773 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-2ca08339-fce2-4b41-afd2-cebf201a0cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:09:46.242279 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 731/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Mar 30 07:09:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:09:46.289521 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbab8a0-53fe-4adb-8acc-18016f808401 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:09:46.301823 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbab8a0-53fe-4adb-8acc-18016f808401 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:09:46.306424 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9d2fd9-eb7d-4148-9593-4db94acf0545 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3802cb341445f994b9204744060ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:09:46.307069 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9d2fd9-eb7d-4148-9593-4db94acf0545 service neutron] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:09:46.307488 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9d2fd9-eb7d-4148-9593-4db94acf0545 service neutron] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:09:46.307777 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9d2fd9-eb7d-4148-9593-4db94acf0545 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:09:46.320564 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9d2fd9-eb7d-4148-9593-4db94acf0545 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:09:46.322788 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9d2fd9-eb7d-4148-9593-4db94acf0545 service neutron] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:09:46.337485 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 724/1455] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:09:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:09:48.679091 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3163ae6-cfe4-43a3-b0b4-99bb1c1f752d None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:09:48.679705 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3163ae6-cfe4-43a3-b0b4-99bb1c1f752d None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:09:48.679705 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3163ae6-cfe4-43a3-b0b4-99bb1c1f752d None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:09:48.681493 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 732/1456] 127.0.0.1 () {54 vars in 916 bytes} [Wed Mar 30 07:09:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:09:48.686956 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84202a24-9fa8-4fb3-b0b2-2951c8da3127 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:09:48.687467 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84202a24-9fa8-4fb3-b0b2-2951c8da3127 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:09:48.687467 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84202a24-9fa8-4fb3-b0b2-2951c8da3127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:09:48.706685 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-84202a24-9fa8-4fb3-b0b2-2951c8da3127 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:09:48.707948 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-84202a24-9fa8-4fb3-b0b2-2951c8da3127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:09:48.716472 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 725/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Mar 30 07:09:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:09:48.755224 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3163ae6-cfe4-43a3-b0b4-99bb1c1f752d None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:09:48.767534 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3163ae6-cfe4-43a3-b0b4-99bb1c1f752d None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:09:48.771679 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f0f892-f4f6-465e-ba44-d76d0faad500 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3802cb341445f994b9204744060ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:09:48.772348 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f0f892-f4f6-465e-ba44-d76d0faad500 service neutron] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:09:48.772628 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f0f892-f4f6-465e-ba44-d76d0faad500 service neutron] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:09:48.772902 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f0f892-f4f6-465e-ba44-d76d0faad500 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:09:48.782040 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f0f892-f4f6-465e-ba44-d76d0faad500 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:09:48.783606 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f0f892-f4f6-465e-ba44-d76d0faad500 service neutron] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:09:48.793491 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 733/1458] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:09:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:09:51.149563 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4720c8a5-9305-4f2f-8db0-7c893823a39e None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:09:51.150136 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4720c8a5-9305-4f2f-8db0-7c893823a39e None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:09:51.150136 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4720c8a5-9305-4f2f-8db0-7c893823a39e None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:09:51.152720 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 726/1459] 127.0.0.1 () {54 vars in 916 bytes} [Wed Mar 30 07:09:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:09:51.160991 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3105c3d8-90da-4194-bdf1-efcfe75334e8 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:09:51.161451 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3105c3d8-90da-4194-bdf1-efcfe75334e8 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:09:51.161565 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3105c3d8-90da-4194-bdf1-efcfe75334e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:09:51.180972 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-3105c3d8-90da-4194-bdf1-efcfe75334e8 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:09:51.182167 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-3105c3d8-90da-4194-bdf1-efcfe75334e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:09:51.191787 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 734/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Mar 30 07:09:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 07:09:51.233074 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4720c8a5-9305-4f2f-8db0-7c893823a39e None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:09:51.246567 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4720c8a5-9305-4f2f-8db0-7c893823a39e None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:09:51.250827 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55b1aaf-2108-4abe-8db2-6ff7d0680225 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3802cb341445f994b9204744060ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:09:51.251462 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b1aaf-2108-4abe-8db2-6ff7d0680225 service neutron] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:09:51.251743 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b1aaf-2108-4abe-8db2-6ff7d0680225 service neutron] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:09:51.252033 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b1aaf-2108-4abe-8db2-6ff7d0680225 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:09:51.261304 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55b1aaf-2108-4abe-8db2-6ff7d0680225 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:09:51.262792 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55b1aaf-2108-4abe-8db2-6ff7d0680225 service neutron] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:09:51.272350 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 727/1461] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:09:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:09:53.668827 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbb591e-1f24-4a67-b336-a968d4e2d3cb None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:09:53.669718 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbb591e-1f24-4a67-b336-a968d4e2d3cb None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:09:53.669718 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbb591e-1f24-4a67-b336-a968d4e2d3cb None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:09:53.672044 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 735/1462] 127.0.0.1 () {54 vars in 916 bytes} [Wed Mar 30 07:09:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:09:53.677407 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd2359-4a96-4ccd-8cff-734beef201c2 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:09:53.677979 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd2359-4a96-4ccd-8cff-734beef201c2 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:09:53.677979 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd2359-4a96-4ccd-8cff-734beef201c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:09:53.697458 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-d6bd2359-4a96-4ccd-8cff-734beef201c2 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:09:53.698679 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-d6bd2359-4a96-4ccd-8cff-734beef201c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:09:53.708105 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 728/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Mar 30 07:09:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:09:53.745818 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbb591e-1f24-4a67-b336-a968d4e2d3cb None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:09:53.757736 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbb591e-1f24-4a67-b336-a968d4e2d3cb None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:09:53.762714 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2989baf-8aed-4327-acce-236084d7da8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3802cb341445f994b9204744060ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:09:53.763356 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2989baf-8aed-4327-acce-236084d7da8c service neutron] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:09:53.763632 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2989baf-8aed-4327-acce-236084d7da8c service neutron] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:09:53.763924 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2989baf-8aed-4327-acce-236084d7da8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:09:53.773701 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2989baf-8aed-4327-acce-236084d7da8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:09:53.775180 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2989baf-8aed-4327-acce-236084d7da8c service neutron] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:09:53.784951 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 736/1464] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:09:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:09:56.079619 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f698789-eec3-4241-b0b4-354cc3588375 None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:09:56.080264 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f698789-eec3-4241-b0b4-354cc3588375 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:09:56.080264 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f698789-eec3-4241-b0b4-354cc3588375 None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:09:56.082008 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 729/1465] 127.0.0.1 () {54 vars in 916 bytes} [Wed Mar 30 07:09:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 30 07:09:56.088441 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b1557b-6bcb-4e4b-af97-ccb06b214b27 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:09:56.089128 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b1557b-6bcb-4e4b-af97-ccb06b214b27 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:09:56.089272 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b1557b-6bcb-4e4b-af97-ccb06b214b27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:09:56.114726 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-b7b1557b-6bcb-4e4b-af97-ccb06b214b27 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:09:56.115947 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-b7b1557b-6bcb-4e4b-af97-ccb06b214b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:09:56.124815 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 737/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Mar 30 07:09:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:09:56.162577 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f698789-eec3-4241-b0b4-354cc3588375 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:09:56.181053 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f698789-eec3-4241-b0b4-354cc3588375 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:09:56.185379 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e877e75a-8360-4c8b-b64d-8236a7a33e91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3802cb341445f994b9204744060ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:09:56.186018 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e877e75a-8360-4c8b-b64d-8236a7a33e91 service neutron] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:09:56.186299 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e877e75a-8360-4c8b-b64d-8236a7a33e91 service neutron] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:09:56.186567 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e877e75a-8360-4c8b-b64d-8236a7a33e91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:09:56.196501 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e877e75a-8360-4c8b-b64d-8236a7a33e91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:09:56.197941 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e877e75a-8360-4c8b-b64d-8236a7a33e91 service neutron] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:09:56.208237 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 730/1467] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:09:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:09:58.514144 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e17010d-285a-46c2-979a-37654c3917c0 None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:09:58.514702 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e17010d-285a-46c2-979a-37654c3917c0 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:09:58.514702 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e17010d-285a-46c2-979a-37654c3917c0 None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:09:58.516519 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 738/1468] 127.0.0.1 () {54 vars in 916 bytes} [Wed Mar 30 07:09:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:09:58.522512 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de48c894-ba7e-4908-9172-8fc51ef3b126 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:09:58.522942 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de48c894-ba7e-4908-9172-8fc51ef3b126 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:09:58.523075 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de48c894-ba7e-4908-9172-8fc51ef3b126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:09:58.549958 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-de48c894-ba7e-4908-9172-8fc51ef3b126 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:09:58.551166 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-de48c894-ba7e-4908-9172-8fc51ef3b126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:09:58.560877 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 731/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Mar 30 07:09:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:09:58.601035 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e17010d-285a-46c2-979a-37654c3917c0 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:09:58.618532 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e17010d-285a-46c2-979a-37654c3917c0 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:09:58.622845 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0b3606-cbca-4c5b-9bf0-e9b516715ae7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3802cb341445f994b9204744060ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:09:58.623492 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0b3606-cbca-4c5b-9bf0-e9b516715ae7 service neutron] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:09:58.623770 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0b3606-cbca-4c5b-9bf0-e9b516715ae7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:09:58.624085 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0b3606-cbca-4c5b-9bf0-e9b516715ae7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:09:58.633202 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0b3606-cbca-4c5b-9bf0-e9b516715ae7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:09:58.634624 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0b3606-cbca-4c5b-9bf0-e9b516715ae7 service neutron] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:09:58.643926 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 739/1470] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:09:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:10:19.447736 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a405a5-70c7-4948-87f4-493eae5a0f09 None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:10:19.448389 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a405a5-70c7-4948-87f4-493eae5a0f09 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:10:19.448389 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a405a5-70c7-4948-87f4-493eae5a0f09 None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:10:19.450104 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 732/1471] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:10:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:10:19.456906 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ececd42e-f1b1-49a4-b7b3-efc918504458 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:10:19.457646 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ececd42e-f1b1-49a4-b7b3-efc918504458 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:10:19.457954 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ececd42e-f1b1-49a4-b7b3-efc918504458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:10:19.484853 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-ececd42e-f1b1-49a4-b7b3-efc918504458 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:10:19.485995 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-ececd42e-f1b1-49a4-b7b3-efc918504458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:10:19.496441 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 740/1472] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:10:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:10:19.548797 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f663c-8e61-42bf-b223-e0d5f31c8bd7 None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:10:19.549268 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f663c-8e61-42bf-b223-e0d5f31c8bd7 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:10:19.550009 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f663c-8e61-42bf-b223-e0d5f31c8bd7 None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:10:19.551791 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 733/1473] 10.222.0.20 () {54 vars in 961 bytes} [Wed Mar 30 07:10:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:10:19.556931 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83451e0-6784-4f8a-9c69-bc224322964f None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:10:19.557221 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83451e0-6784-4f8a-9c69-bc224322964f None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:10:19.557495 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83451e0-6784-4f8a-9c69-bc224322964f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:10:19.577233 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-d83451e0-6784-4f8a-9c69-bc224322964f None None] MFA Rules not processed for user `e880ade912f3412abf44ba73939d6e50`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:10:19.578429 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-d83451e0-6784-4f8a-9c69-bc224322964f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:10:19.586825 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 741/1474] 10.222.0.20 () {58 vars in 1058 bytes} [Wed Mar 30 07:10:19 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:10:19.594254 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842f663c-8e61-42bf-b223-e0d5f31c8bd7 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:10:19.607285 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842f663c-8e61-42bf-b223-e0d5f31c8bd7 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:10:19.612610 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec374d7c-51e5-4c8d-886a-7026e7ae3c97 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e880ade912f3412abf44ba73939d6e50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:10:19.613272 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec374d7c-51e5-4c8d-886a-7026e7ae3c97 service glance] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:10:19.613724 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec374d7c-51e5-4c8d-886a-7026e7ae3c97 service glance] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:10:19.613876 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec374d7c-51e5-4c8d-886a-7026e7ae3c97 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:10:19.624203 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec374d7c-51e5-4c8d-886a-7026e7ae3c97 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:10:19.625649 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec374d7c-51e5-4c8d-886a-7026e7ae3c97 service glance] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:10:19.635044 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 734/1475] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:10:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:10:22.026547 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98402a53-75dc-4795-a94d-d3ad3f924ffe None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:10:22.027425 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98402a53-75dc-4795-a94d-d3ad3f924ffe None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:10:22.027425 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98402a53-75dc-4795-a94d-d3ad3f924ffe None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:10:22.030373 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 742/1476] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:10:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:10:22.038576 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a01f5-72b2-47e8-b55f-473f01f55a1e None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:10:22.039050 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a01f5-72b2-47e8-b55f-473f01f55a1e None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:10:22.039145 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a01f5-72b2-47e8-b55f-473f01f55a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:10:22.059081 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-6d3a01f5-72b2-47e8-b55f-473f01f55a1e None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:10:22.060341 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-6d3a01f5-72b2-47e8-b55f-473f01f55a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:10:22.068805 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 735/1477] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:10:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:10:22.093150 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98402a53-75dc-4795-a94d-d3ad3f924ffe None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:10:22.107261 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98402a53-75dc-4795-a94d-d3ad3f924ffe None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:10:22.112807 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204008a9-7de1-462d-a9c3-53c1072de35b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:10:22.113470 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204008a9-7de1-462d-a9c3-53c1072de35b admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:10:22.113753 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204008a9-7de1-462d-a9c3-53c1072de35b admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:10:22.114028 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204008a9-7de1-462d-a9c3-53c1072de35b admin admin] PATH_INFO: `/v3/projects` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:10:22.114757 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204008a9-7de1-462d-a9c3-53c1072de35b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:10:22.116511 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING py.warnings [None req-204008a9-7de1-462d-a9c3-53c1072de35b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 30 07:10:22.116511 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: warnings.warn(msg) Mar 30 07:10:22.116511 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: Mar 30 07:10:22.117636 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204008a9-7de1-462d-a9c3-53c1072de35b admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:10:22.136841 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 743/1478] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Mar 30 07:10:22 2022] GET /identity/v3/projects => generated 2553 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:10:24.447189 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a244da4-d67c-47ea-92ef-4e1b046e5f2f None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:10:24.448083 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a244da4-d67c-47ea-92ef-4e1b046e5f2f None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:10:24.448083 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a244da4-d67c-47ea-92ef-4e1b046e5f2f None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:10:24.451190 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 736/1479] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:10:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:10:24.457657 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6182f434-6aa3-4ff6-a63e-ebc135bc855c None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:10:24.458381 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6182f434-6aa3-4ff6-a63e-ebc135bc855c None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:10:24.458575 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6182f434-6aa3-4ff6-a63e-ebc135bc855c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:10:24.483385 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-6182f434-6aa3-4ff6-a63e-ebc135bc855c None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:10:24.484630 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-6182f434-6aa3-4ff6-a63e-ebc135bc855c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:10:24.495103 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 744/1480] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:10:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:10:24.536734 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a244da4-d67c-47ea-92ef-4e1b046e5f2f None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:10:24.553405 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a244da4-d67c-47ea-92ef-4e1b046e5f2f None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:10:24.558987 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467697a8-20c0-4bcf-89c3-97397bb3e07f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72b398c5ed14484d8b7a51fee900597b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:10:24.559617 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467697a8-20c0-4bcf-89c3-97397bb3e07f service nova] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:10:24.559930 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467697a8-20c0-4bcf-89c3-97397bb3e07f service nova] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:10:24.560198 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467697a8-20c0-4bcf-89c3-97397bb3e07f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:10:24.568641 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467697a8-20c0-4bcf-89c3-97397bb3e07f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:10:24.570232 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467697a8-20c0-4bcf-89c3-97397bb3e07f service nova] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:10:24.579526 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 737/1481] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:10:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:10:27.046131 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5420ac23-1a02-461f-9c18-d65313c7c32a None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:10:27.047055 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5420ac23-1a02-461f-9c18-d65313c7c32a None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:10:27.047055 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5420ac23-1a02-461f-9c18-d65313c7c32a None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:10:27.049986 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 745/1482] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:10:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:10:27.055413 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ece69-d6b2-4bab-85b2-d6779460feec None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:10:27.055881 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ece69-d6b2-4bab-85b2-d6779460feec None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:10:27.056003 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ece69-d6b2-4bab-85b2-d6779460feec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:10:27.075759 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-d74ece69-d6b2-4bab-85b2-d6779460feec None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:10:27.076967 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-d74ece69-d6b2-4bab-85b2-d6779460feec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:10:27.085371 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 738/1483] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:10:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:10:27.125592 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5420ac23-1a02-461f-9c18-d65313c7c32a None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:10:27.145090 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5420ac23-1a02-461f-9c18-d65313c7c32a None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:10:27.150069 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa564b7e-ed99-49f8-8aec-00ace4d4e26f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3802cb341445f994b9204744060ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:10:27.150718 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa564b7e-ed99-49f8-8aec-00ace4d4e26f service neutron] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:10:27.151002 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa564b7e-ed99-49f8-8aec-00ace4d4e26f service neutron] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:10:27.151274 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa564b7e-ed99-49f8-8aec-00ace4d4e26f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:10:27.161940 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa564b7e-ed99-49f8-8aec-00ace4d4e26f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:10:27.163378 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa564b7e-ed99-49f8-8aec-00ace4d4e26f service neutron] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:10:27.173416 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 746/1484] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:10:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:10:29.520666 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc6a8d2-5e64-4c17-b1c3-227348ee478f None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:10:29.521529 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc6a8d2-5e64-4c17-b1c3-227348ee478f None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:10:29.521529 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc6a8d2-5e64-4c17-b1c3-227348ee478f None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:10:29.524654 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 739/1485] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:10:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:10:29.530202 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad87097-c64c-4397-bee8-f6f8ad6a5a8e None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:10:29.530643 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad87097-c64c-4397-bee8-f6f8ad6a5a8e None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:10:29.530737 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad87097-c64c-4397-bee8-f6f8ad6a5a8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:10:29.551667 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-4ad87097-c64c-4397-bee8-f6f8ad6a5a8e None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:10:29.552775 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-4ad87097-c64c-4397-bee8-f6f8ad6a5a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:10:29.561165 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 747/1486] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:10:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:10:29.602691 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc6a8d2-5e64-4c17-b1c3-227348ee478f None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:10:29.618421 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc6a8d2-5e64-4c17-b1c3-227348ee478f None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:10:29.622224 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c200c9-176b-4e80-a73a-9b3093690b93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3802cb341445f994b9204744060ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:10:29.622842 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c200c9-176b-4e80-a73a-9b3093690b93 service neutron] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:10:29.623123 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c200c9-176b-4e80-a73a-9b3093690b93 service neutron] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:10:29.623395 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c200c9-176b-4e80-a73a-9b3093690b93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:10:29.633081 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c200c9-176b-4e80-a73a-9b3093690b93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:10:29.634543 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c200c9-176b-4e80-a73a-9b3093690b93 service neutron] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:10:29.644153 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 740/1487] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:10:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:10:32.044754 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640164fa-f1d4-441e-ba91-721437cba7e3 None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:10:32.045669 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640164fa-f1d4-441e-ba91-721437cba7e3 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:10:32.045669 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640164fa-f1d4-441e-ba91-721437cba7e3 None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:10:32.048614 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 748/1488] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:10:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:10:32.057994 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db013e01-c9de-406e-b24f-b334de436026 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:10:32.058450 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db013e01-c9de-406e-b24f-b334de436026 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:10:32.058552 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db013e01-c9de-406e-b24f-b334de436026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:10:32.079778 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-db013e01-c9de-406e-b24f-b334de436026 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:10:32.081042 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-db013e01-c9de-406e-b24f-b334de436026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:10:32.089545 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 741/1489] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:10:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:10:32.132320 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640164fa-f1d4-441e-ba91-721437cba7e3 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:10:32.147526 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640164fa-f1d4-441e-ba91-721437cba7e3 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:10:32.152135 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c58d5f-5f71-45ab-adff-67069f06b12b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3802cb341445f994b9204744060ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:10:32.153042 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c58d5f-5f71-45ab-adff-67069f06b12b service neutron] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:10:32.153355 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c58d5f-5f71-45ab-adff-67069f06b12b service neutron] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:10:32.153691 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c58d5f-5f71-45ab-adff-67069f06b12b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:10:32.166105 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c58d5f-5f71-45ab-adff-67069f06b12b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:10:32.167541 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c58d5f-5f71-45ab-adff-67069f06b12b service neutron] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:10:32.177291 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 749/1490] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:10:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:10:34.700399 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84700f3-f199-4132-a7aa-a9ba54cc5809 None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:10:34.701335 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84700f3-f199-4132-a7aa-a9ba54cc5809 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:10:34.701335 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84700f3-f199-4132-a7aa-a9ba54cc5809 None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:10:34.704232 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 742/1491] 10.222.0.20 () {54 vars in 926 bytes} [Wed Mar 30 07:10:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:10:34.710315 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804132e4-147e-415a-b7e3-cf0e61fbb3e0 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:10:34.710746 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804132e4-147e-415a-b7e3-cf0e61fbb3e0 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:10:34.710870 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804132e4-147e-415a-b7e3-cf0e61fbb3e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:10:34.730147 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-804132e4-147e-415a-b7e3-cf0e61fbb3e0 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:10:34.731350 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-804132e4-147e-415a-b7e3-cf0e61fbb3e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:10:34.740968 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 750/1492] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Mar 30 07:10:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:10:34.779387 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84700f3-f199-4132-a7aa-a9ba54cc5809 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:10:34.793579 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84700f3-f199-4132-a7aa-a9ba54cc5809 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:10:34.800637 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92736d09-683b-44db-abd6-40c5e589d494 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3802cb341445f994b9204744060ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:10:34.801274 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92736d09-683b-44db-abd6-40c5e589d494 service neutron] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:10:34.801553 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92736d09-683b-44db-abd6-40c5e589d494 service neutron] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:10:34.801799 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92736d09-683b-44db-abd6-40c5e589d494 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:10:34.812396 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92736d09-683b-44db-abd6-40c5e589d494 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:10:34.814053 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92736d09-683b-44db-abd6-40c5e589d494 service neutron] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:10:34.824606 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 743/1493] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:10:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:11:56.548229 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d94b8-b734-4096-82c2-a585fdd8e412 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:11:56.548802 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d94b8-b734-4096-82c2-a585fdd8e412 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:11:56.548802 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d94b8-b734-4096-82c2-a585fdd8e412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:11:56.568969 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-602d94b8-b734-4096-82c2-a585fdd8e412 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:11:56.570273 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-602d94b8-b734-4096-82c2-a585fdd8e412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:11:56.579527 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 751/1494] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:11:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:11:56.589042 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4694309e-46a8-4a8f-a540-eb3f4a56dfb5 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:11:56.589571 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4694309e-46a8-4a8f-a540-eb3f4a56dfb5 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:11:56.589571 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4694309e-46a8-4a8f-a540-eb3f4a56dfb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:11:56.608630 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-4694309e-46a8-4a8f-a540-eb3f4a56dfb5 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:11:56.609837 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-4694309e-46a8-4a8f-a540-eb3f4a56dfb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:11:56.619400 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 744/1495] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:11:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 07:11:56.624292 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602d94b8-b734-4096-82c2-a585fdd8e412 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:11:56.636529 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602d94b8-b734-4096-82c2-a585fdd8e412 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:11:56.641890 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c1afe4-627f-4200-a619-8b26f4b6e8d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:11:56.642554 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c1afe4-627f-4200-a619-8b26f4b6e8d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:11:56.642827 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c1afe4-627f-4200-a619-8b26f4b6e8d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:11:56.643106 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c1afe4-627f-4200-a619-8b26f4b6e8d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:11:56.643846 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c1afe4-627f-4200-a619-8b26f4b6e8d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:11:56.644153 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c1afe4-627f-4200-a619-8b26f4b6e8d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:11:56.645228 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING py.warnings [None req-f9c1afe4-627f-4200-a619-8b26f4b6e8d2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 30 07:11:56.645228 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: warnings.warn(msg) Mar 30 07:11:56.645228 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: Mar 30 07:11:56.646103 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c1afe4-627f-4200-a619-8b26f4b6e8d2 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:11:56.658098 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 752/1496] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Mar 30 07:11:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:11:56.666640 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4694309e-46a8-4a8f-a540-eb3f4a56dfb5 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:11:56.676229 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4694309e-46a8-4a8f-a540-eb3f4a56dfb5 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:11:56.681952 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b7bc9e-2fe4-4cc2-9765-0f7219e241d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:11:56.682616 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b7bc9e-2fe4-4cc2-9765-0f7219e241d0 admin admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:11:56.682892 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b7bc9e-2fe4-4cc2-9765-0f7219e241d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:11:56.683164 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b7bc9e-2fe4-4cc2-9765-0f7219e241d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:11:56.683844 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b7bc9e-2fe4-4cc2-9765-0f7219e241d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:11:56.685589 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING py.warnings [None req-53b7bc9e-2fe4-4cc2-9765-0f7219e241d0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 30 07:11:56.685589 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: warnings.warn(msg) Mar 30 07:11:56.685589 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: Mar 30 07:11:56.686783 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b7bc9e-2fe4-4cc2-9765-0f7219e241d0 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:11:56.724454 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 745/1497] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Mar 30 07:11:56 2022] POST /identity/v3/projects => generated 379 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:11:56.728737 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c1afe4-627f-4200-a619-8b26f4b6e8d2 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:11:56.739033 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c1afe4-627f-4200-a619-8b26f4b6e8d2 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:11:56.800995 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecab7145-f963-4c64-8d58-34827b1ba7f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:11:56.801582 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecab7145-f963-4c64-8d58-34827b1ba7f8 admin admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:11:56.801862 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecab7145-f963-4c64-8d58-34827b1ba7f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:11:56.802131 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecab7145-f963-4c64-8d58-34827b1ba7f8 admin admin] PATH_INFO: `/v3/users` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:11:56.802812 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecab7145-f963-4c64-8d58-34827b1ba7f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:11:56.803847 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING py.warnings [None req-ecab7145-f963-4c64-8d58-34827b1ba7f8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 30 07:11:56.803847 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: warnings.warn(msg) Mar 30 07:11:56.803847 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: Mar 30 07:11:56.805053 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecab7145-f963-4c64-8d58-34827b1ba7f8 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:11:56.829154 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 753/1498] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Mar 30 07:11:56 2022] POST /identity/v3/users => generated 290 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:11:56.833929 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b7bc9e-2fe4-4cc2-9765-0f7219e241d0 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:11:56.843986 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b7bc9e-2fe4-4cc2-9765-0f7219e241d0 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:11:56.849142 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70402c19-2f2c-4c3e-9a85-61fba2f07e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:11:56.849849 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70402c19-2f2c-4c3e-9a85-61fba2f07e17 admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:11:56.850155 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70402c19-2f2c-4c3e-9a85-61fba2f07e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:11:56.850429 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70402c19-2f2c-4c3e-9a85-61fba2f07e17 admin admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:11:56.851159 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70402c19-2f2c-4c3e-9a85-61fba2f07e17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:11:56.852220 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING py.warnings [None req-70402c19-2f2c-4c3e-9a85-61fba2f07e17 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 30 07:11:56.852220 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: warnings.warn(msg) Mar 30 07:11:56.852220 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: Mar 30 07:11:56.853243 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70402c19-2f2c-4c3e-9a85-61fba2f07e17 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:11:56.866741 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 746/1499] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:11:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 30 07:11:56.870836 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecab7145-f963-4c64-8d58-34827b1ba7f8 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:11:56.882082 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecab7145-f963-4c64-8d58-34827b1ba7f8 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:11:56.887516 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceba58b-f51c-4971-9817-9959bc5ab226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:11:56.888195 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceba58b-f51c-4971-9817-9959bc5ab226 admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:11:56.888473 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceba58b-f51c-4971-9817-9959bc5ab226 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:11:56.888738 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceba58b-f51c-4971-9817-9959bc5ab226 admin admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:11:56.889484 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceba58b-f51c-4971-9817-9959bc5ab226 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:11:56.890491 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING py.warnings [None req-1ceba58b-f51c-4971-9817-9959bc5ab226 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 30 07:11:56.890491 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: warnings.warn(msg) Mar 30 07:11:56.890491 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: Mar 30 07:11:56.891363 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceba58b-f51c-4971-9817-9959bc5ab226 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:11:56.904507 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 754/1500] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:11:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 30 07:11:56.909237 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70402c19-2f2c-4c3e-9a85-61fba2f07e17 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:11:56.920318 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70402c19-2f2c-4c3e-9a85-61fba2f07e17 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:11:56.925897 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8790b08d-8044-49ba-9931-8c4fa703f2ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:11:56.926785 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8790b08d-8044-49ba-9931-8c4fa703f2ed admin admin] REQUEST_METHOD: `PUT` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:11:56.927063 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8790b08d-8044-49ba-9931-8c4fa703f2ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:11:56.927334 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8790b08d-8044-49ba-9931-8c4fa703f2ed admin admin] PATH_INFO: `/v3/projects/d9abd3eb88bc4ead86ba9d503425703e/users/aa500940a98f44699f438548c05b97da/roles/5d79031a64754b57ba120367465e2252` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:11:56.943140 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8790b08d-8044-49ba-9931-8c4fa703f2ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9abd3eb88bc4ead86ba9d503425703e, user_id=aa500940a98f44699f438548c05b97da, role_id=5d79031a64754b57ba120367465e2252)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:11:56.944264 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING py.warnings [None req-8790b08d-8044-49ba-9931-8c4fa703f2ed admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 30 07:11:56.944264 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: warnings.warn(msg) Mar 30 07:11:56.944264 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: Mar 30 07:11:56.946180 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8790b08d-8044-49ba-9931-8c4fa703f2ed admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:11:56.961617 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 747/1501] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:11:56 2022] PUT /identity/v3/projects/d9abd3eb88bc4ead86ba9d503425703e/users/aa500940a98f44699f438548c05b97da/roles/5d79031a64754b57ba120367465e2252 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:11:56.973077 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b271be-8a02-4bf4-bda3-e9151baa943e None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:11:56.973390 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b271be-8a02-4bf4-bda3-e9151baa943e None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:11:56.973630 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b271be-8a02-4bf4-bda3-e9151baa943e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:11:57.000923 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-b2b271be-8a02-4bf4-bda3-e9151baa943e None None] MFA Rules not processed for user `aa500940a98f44699f438548c05b97da`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:11:57.002110 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-b2b271be-8a02-4bf4-bda3-e9151baa943e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:11:57.088131 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 755/1502] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:11:56 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 07:11:57.105450 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8790b08d-8044-49ba-9931-8c4fa703f2ed admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:11:57.184978 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8790b08d-8044-49ba-9931-8c4fa703f2ed admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:11:57.192338 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fa1b7f-496b-4086-a7f7-7ed0bd541b13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72b398c5ed14484d8b7a51fee900597b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:11:57.192982 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa1b7f-496b-4086-a7f7-7ed0bd541b13 service nova] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:11:57.193256 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa1b7f-496b-4086-a7f7-7ed0bd541b13 service nova] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:11:57.193522 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa1b7f-496b-4086-a7f7-7ed0bd541b13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:11:57.201990 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fa1b7f-496b-4086-a7f7-7ed0bd541b13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:11:57.203581 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fa1b7f-496b-4086-a7f7-7ed0bd541b13 service nova] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:11:57.212985 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 748/1503] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:11:57 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:11:57.287416 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024bb48b-e1de-4c20-bd8c-abcccbcb033e None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:11:57.287701 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024bb48b-e1de-4c20-bd8c-abcccbcb033e None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:11:57.288011 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024bb48b-e1de-4c20-bd8c-abcccbcb033e None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:11:57.289791 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 756/1504] 10.222.0.20 () {52 vars in 829 bytes} [Wed Mar 30 07:11:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:11:57.293663 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fa1b7f-496b-4086-a7f7-7ed0bd541b13 service nova] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:11:57.359920 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fa1b7f-496b-4086-a7f7-7ed0bd541b13 service nova] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:11:57.364949 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdb5fb1-3424-457c-9c69-256394c4a15a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:11:57.365824 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb5fb1-3424-457c-9c69-256394c4a15a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:11:57.366096 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb5fb1-3424-457c-9c69-256394c4a15a admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:11:57.366363 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb5fb1-3424-457c-9c69-256394c4a15a admin admin] PATH_INFO: `/v3/users/aa500940a98f44699f438548c05b97da` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:11:57.367547 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdb5fb1-3424-457c-9c69-256394c4a15a admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa500940a98f44699f438548c05b97da)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:11:57.368603 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING py.warnings [None req-6cdb5fb1-3424-457c-9c69-256394c4a15a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 30 07:11:57.368603 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: warnings.warn(msg) Mar 30 07:11:57.368603 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: Mar 30 07:11:57.369784 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdb5fb1-3424-457c-9c69-256394c4a15a admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:11:57.437220 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-6cdb5fb1-3424-457c-9c69-256394c4a15a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa500940a98f44699f438548c05b97da'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:11:57.437875 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-6cdb5fb1-3424-457c-9c69-256394c4a15a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa500940a98f44699f438548c05b97da'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:11:57.438604 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-6cdb5fb1-3424-457c-9c69-256394c4a15a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa500940a98f44699f438548c05b97da'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:11:57.448940 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-6cdb5fb1-3424-457c-9c69-256394c4a15a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa500940a98f44699f438548c05b97da'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:11:57.462382 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-6cdb5fb1-3424-457c-9c69-256394c4a15a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa500940a98f44699f438548c05b97da'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:11:57.490610 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 749/1505] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Mar 30 07:11:57 2022] DELETE /identity/v3/users/aa500940a98f44699f438548c05b97da => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 07:11:57.495478 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e78d982-4b04-4403-9174-29e50e5ef6a5 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:11:57.495767 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e78d982-4b04-4403-9174-29e50e5ef6a5 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:11:57.496083 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e78d982-4b04-4403-9174-29e50e5ef6a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:11:57.514552 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-2e78d982-4b04-4403-9174-29e50e5ef6a5 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:11:57.515752 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-2e78d982-4b04-4403-9174-29e50e5ef6a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:11:57.578449 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 757/1506] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:11:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:11:57.590184 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdb5fb1-3424-457c-9c69-256394c4a15a admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:11:57.591627 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-6cdb5fb1-3424-457c-9c69-256394c4a15a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:11:57.654328 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdb5fb1-3424-457c-9c69-256394c4a15a admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:11:57.659061 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1da55b-7b62-49bb-bae0-07da51451128 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3802cb341445f994b9204744060ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:11:57.659709 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1da55b-7b62-49bb-bae0-07da51451128 service neutron] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:11:57.660160 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1da55b-7b62-49bb-bae0-07da51451128 service neutron] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:11:57.660515 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1da55b-7b62-49bb-bae0-07da51451128 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:11:57.669866 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1da55b-7b62-49bb-bae0-07da51451128 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:11:57.671314 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1da55b-7b62-49bb-bae0-07da51451128 service neutron] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:11:57.680718 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 750/1507] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:11:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:11:58.018574 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e78d982-4b04-4403-9174-29e50e5ef6a5 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:11:58.020228 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-2e78d982-4b04-4403-9174-29e50e5ef6a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:11:58.032201 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e78d982-4b04-4403-9174-29e50e5ef6a5 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:11:58.038684 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2232762-1ad4-4a81-ad4a-801a03125bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:11:58.039613 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2232762-1ad4-4a81-ad4a-801a03125bf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:11:58.039835 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2232762-1ad4-4a81-ad4a-801a03125bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:11:58.040175 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2232762-1ad4-4a81-ad4a-801a03125bf7 admin admin] PATH_INFO: `/v3/projects/d9abd3eb88bc4ead86ba9d503425703e` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:11:58.041268 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2232762-1ad4-4a81-ad4a-801a03125bf7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9abd3eb88bc4ead86ba9d503425703e)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:11:58.042941 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING py.warnings [None req-f2232762-1ad4-4a81-ad4a-801a03125bf7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 30 07:11:58.042941 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: warnings.warn(msg) Mar 30 07:11:58.042941 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: Mar 30 07:11:58.044651 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2232762-1ad4-4a81-ad4a-801a03125bf7 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:11:58.106192 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-f2232762-1ad4-4a81-ad4a-801a03125bf7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9abd3eb88bc4ead86ba9d503425703e', 'request_id': 'req-f2232762-1ad4-4a81-ad4a-801a03125bf7'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:11:58.117286 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-f2232762-1ad4-4a81-ad4a-801a03125bf7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9abd3eb88bc4ead86ba9d503425703e', 'request_id': 'req-f2232762-1ad4-4a81-ad4a-801a03125bf7'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:11:58.128043 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-f2232762-1ad4-4a81-ad4a-801a03125bf7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9abd3eb88bc4ead86ba9d503425703e', 'request_id': 'req-f2232762-1ad4-4a81-ad4a-801a03125bf7'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:11:58.145982 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-f2232762-1ad4-4a81-ad4a-801a03125bf7 admin admin] The token cache is being invalidate because project d9abd3eb88bc4ead86ba9d503425703e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79960) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 07:11:58.146329 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-f2232762-1ad4-4a81-ad4a-801a03125bf7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:11:58.147091 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-f2232762-1ad4-4a81-ad4a-801a03125bf7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:11:58.148721 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 758/1508] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Mar 30 07:11:58 2022] DELETE /identity/v3/projects/d9abd3eb88bc4ead86ba9d503425703e => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:13:28.523038 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8158864d-8493-4bef-b532-1947ed630d21 None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:13:28.524036 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8158864d-8493-4bef-b532-1947ed630d21 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:13:28.524036 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8158864d-8493-4bef-b532-1947ed630d21 None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:13:28.526723 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 751/1509] 127.0.0.1 () {54 vars in 901 bytes} [Wed Mar 30 07:13:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:13:28.533037 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5089fb-8cbd-4178-b3cf-30b1bda0d9d9 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:13:28.533787 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5089fb-8cbd-4178-b3cf-30b1bda0d9d9 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:13:28.533938 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5089fb-8cbd-4178-b3cf-30b1bda0d9d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:13:28.557721 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-ca5089fb-8cbd-4178-b3cf-30b1bda0d9d9 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:13:28.558879 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-ca5089fb-8cbd-4178-b3cf-30b1bda0d9d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:13:28.631086 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 759/1510] 127.0.0.1 () {58 vars in 998 bytes} [Wed Mar 30 07:13:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:13:28.795661 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8158864d-8493-4bef-b532-1947ed630d21 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:13:28.798363 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-8158864d-8493-4bef-b532-1947ed630d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:13:28.889687 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8158864d-8493-4bef-b532-1947ed630d21 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:13:28.900260 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7167678-a86a-423e-bf76-6f36b5d03b8e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72b398c5ed14484d8b7a51fee900597b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:13:28.901221 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7167678-a86a-423e-bf76-6f36b5d03b8e service nova] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:13:28.901638 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7167678-a86a-423e-bf76-6f36b5d03b8e service nova] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:13:28.902043 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7167678-a86a-423e-bf76-6f36b5d03b8e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:13:28.912648 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7167678-a86a-423e-bf76-6f36b5d03b8e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:13:28.914294 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7167678-a86a-423e-bf76-6f36b5d03b8e service nova] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:13:28.924534 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 752/1511] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:13:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:13:29.183603 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9280ca-93d7-41f8-82d9-c8fd00b24c72 None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:13:29.183902 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9280ca-93d7-41f8-82d9-c8fd00b24c72 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:13:29.184211 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9280ca-93d7-41f8-82d9-c8fd00b24c72 None None] PATH_INFO: `/v3` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:13:29.185566 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 760/1512] 10.222.0.35 () {54 vars in 925 bytes} [Wed Mar 30 07:13:29 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:13:29.192677 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e037f-aa94-495c-87ec-72f34e31c950 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:13:29.192991 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e037f-aa94-495c-87ec-72f34e31c950 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:13:29.193265 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e037f-aa94-495c-87ec-72f34e31c950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:13:29.213463 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-090e037f-aa94-495c-87ec-72f34e31c950 None None] MFA Rules not processed for user `d634743546e8456fac2f6ab1aaee09ef`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:13:29.214743 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-090e037f-aa94-495c-87ec-72f34e31c950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:13:29.284183 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 753/1513] 10.222.0.35 () {58 vars in 1015 bytes} [Wed Mar 30 07:13:29 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:13:30.199696 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aa3f43-d11b-4c8e-aa14-0d70c969b544 None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:13:30.200662 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aa3f43-d11b-4c8e-aa14-0d70c969b544 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:13:30.200662 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aa3f43-d11b-4c8e-aa14-0d70c969b544 None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:13:30.203390 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 761/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Mar 30 07:13:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:13:30.209561 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95579de0-8bb1-4945-b37b-895a6d4d08ee None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:13:30.210032 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95579de0-8bb1-4945-b37b-895a6d4d08ee None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:13:30.210128 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95579de0-8bb1-4945-b37b-895a6d4d08ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:13:30.238325 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-95579de0-8bb1-4945-b37b-895a6d4d08ee None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:13:30.239524 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-95579de0-8bb1-4945-b37b-895a6d4d08ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:13:30.248414 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 754/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Mar 30 07:13:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:13:30.406656 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aa3f43-d11b-4c8e-aa14-0d70c969b544 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:13:30.423040 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aa3f43-d11b-4c8e-aa14-0d70c969b544 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:13:30.429245 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0ae707-986e-4e04-a2c8-af4bcc99e405 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72b398c5ed14484d8b7a51fee900597b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:13:30.429916 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ae707-986e-4e04-a2c8-af4bcc99e405 service nova] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:13:30.430202 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ae707-986e-4e04-a2c8-af4bcc99e405 service nova] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:13:30.430476 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ae707-986e-4e04-a2c8-af4bcc99e405 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:13:30.439682 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0ae707-986e-4e04-a2c8-af4bcc99e405 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:13:30.441316 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0ae707-986e-4e04-a2c8-af4bcc99e405 service nova] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:13:30.450928 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 762/1516] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:13:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:13:38.147214 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee1cced-2f62-403d-9e22-91f1abb822bb None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:13:38.148050 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee1cced-2f62-403d-9e22-91f1abb822bb None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:13:38.148050 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee1cced-2f62-403d-9e22-91f1abb822bb None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:13:38.152276 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 755/1517] 10.222.0.20 () {54 vars in 960 bytes} [Wed Mar 30 07:13:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:13:38.160229 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e5549a-a537-4e2c-a079-6fec1cef9b36 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:13:38.161088 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e5549a-a537-4e2c-a079-6fec1cef9b36 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:13:38.161088 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e5549a-a537-4e2c-a079-6fec1cef9b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:13:38.182332 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-75e5549a-a537-4e2c-a079-6fec1cef9b36 None None] MFA Rules not processed for user `d634743546e8456fac2f6ab1aaee09ef`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:13:38.183538 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-75e5549a-a537-4e2c-a079-6fec1cef9b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:13:38.193702 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 763/1518] 10.222.0.20 () {58 vars in 1057 bytes} [Wed Mar 30 07:13:38 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:13:38.203677 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee1cced-2f62-403d-9e22-91f1abb822bb None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:13:38.219253 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee1cced-2f62-403d-9e22-91f1abb822bb None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:13:38.225440 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b8aed7-f946-4bbf-91c2-6efe1cc8eba8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd634743546e8456fac2f6ab1aaee09ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:13:38.226078 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b8aed7-f946-4bbf-91c2-6efe1cc8eba8 service placement] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:13:38.226363 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b8aed7-f946-4bbf-91c2-6efe1cc8eba8 service placement] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:13:38.226640 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b8aed7-f946-4bbf-91c2-6efe1cc8eba8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:13:38.236848 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b8aed7-f946-4bbf-91c2-6efe1cc8eba8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:13:38.239876 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b8aed7-f946-4bbf-91c2-6efe1cc8eba8 service placement] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:13:38.254367 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 756/1519] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:13:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:13:42.178298 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f4e7f3-e8a2-44a9-8a0e-a3c3fd4030c6 None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:13:42.179045 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f4e7f3-e8a2-44a9-8a0e-a3c3fd4030c6 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:13:42.179045 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f4e7f3-e8a2-44a9-8a0e-a3c3fd4030c6 None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:13:42.180679 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 764/1520] 127.0.0.1 () {54 vars in 901 bytes} [Wed Mar 30 07:13:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:13:42.185977 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271f5f4d-70bc-4db7-97ba-f9cd972332cb None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:13:42.186406 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271f5f4d-70bc-4db7-97ba-f9cd972332cb None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:13:42.186579 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271f5f4d-70bc-4db7-97ba-f9cd972332cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:13:42.206371 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-271f5f4d-70bc-4db7-97ba-f9cd972332cb None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:13:42.207564 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-271f5f4d-70bc-4db7-97ba-f9cd972332cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:13:42.215937 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 757/1521] 127.0.0.1 () {58 vars in 998 bytes} [Wed Mar 30 07:13:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:13:42.368893 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f4e7f3-e8a2-44a9-8a0e-a3c3fd4030c6 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:13:42.389417 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f4e7f3-e8a2-44a9-8a0e-a3c3fd4030c6 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:13:42.398859 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a979e55-4e24-4d35-987f-d47e418a01bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72b398c5ed14484d8b7a51fee900597b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:13:42.399796 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a979e55-4e24-4d35-987f-d47e418a01bb service nova] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:13:42.400107 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a979e55-4e24-4d35-987f-d47e418a01bb service nova] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:13:42.400470 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a979e55-4e24-4d35-987f-d47e418a01bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:13:42.413180 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a979e55-4e24-4d35-987f-d47e418a01bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:13:42.414825 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a979e55-4e24-4d35-987f-d47e418a01bb service nova] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:13:42.424711 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 765/1522] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:13:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:13:43.679993 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85661ce-5dc3-4aa3-b058-1d1e6e7327ef None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:13:43.680663 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85661ce-5dc3-4aa3-b058-1d1e6e7327ef None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:13:43.680663 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85661ce-5dc3-4aa3-b058-1d1e6e7327ef None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:13:43.682359 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 758/1523] 127.0.0.1 () {54 vars in 901 bytes} [Wed Mar 30 07:13:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 30 07:13:43.687723 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c59a713-aedf-4ce4-b114-1607e08648b1 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:13:43.688207 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c59a713-aedf-4ce4-b114-1607e08648b1 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:13:43.688353 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c59a713-aedf-4ce4-b114-1607e08648b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:13:43.706352 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-1c59a713-aedf-4ce4-b114-1607e08648b1 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:13:43.707539 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-1c59a713-aedf-4ce4-b114-1607e08648b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:13:43.715991 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 766/1524] 127.0.0.1 () {58 vars in 998 bytes} [Wed Mar 30 07:13:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 07:13:43.866712 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85661ce-5dc3-4aa3-b058-1d1e6e7327ef None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:13:43.881524 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85661ce-5dc3-4aa3-b058-1d1e6e7327ef None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:13:43.888002 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d678ca0b-5b0f-4cf3-b5b3-ef6a155c8dc6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72b398c5ed14484d8b7a51fee900597b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:13:43.888635 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d678ca0b-5b0f-4cf3-b5b3-ef6a155c8dc6 service nova] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:13:43.888901 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d678ca0b-5b0f-4cf3-b5b3-ef6a155c8dc6 service nova] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:13:43.889171 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d678ca0b-5b0f-4cf3-b5b3-ef6a155c8dc6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:13:43.897239 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d678ca0b-5b0f-4cf3-b5b3-ef6a155c8dc6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:13:43.898819 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d678ca0b-5b0f-4cf3-b5b3-ef6a155c8dc6 service nova] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:13:43.908158 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 759/1525] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:13:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:13:48.085028 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fdf5a6-2f1e-40da-9c7e-f0e85682294f None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:13:48.085678 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fdf5a6-2f1e-40da-9c7e-f0e85682294f None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:13:48.085678 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fdf5a6-2f1e-40da-9c7e-f0e85682294f None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:13:48.087372 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 767/1526] 127.0.0.1 () {54 vars in 916 bytes} [Wed Mar 30 07:13:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:13:48.095736 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99702ae6-53b4-4aa4-bf5a-b8b4e4227d5e None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:13:48.096468 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99702ae6-53b4-4aa4-bf5a-b8b4e4227d5e None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:13:48.096621 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99702ae6-53b4-4aa4-bf5a-b8b4e4227d5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:13:48.123357 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-99702ae6-53b4-4aa4-bf5a-b8b4e4227d5e None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:13:48.124582 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-99702ae6-53b4-4aa4-bf5a-b8b4e4227d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:13:48.132978 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 760/1527] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Mar 30 07:13:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:13:48.169297 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fdf5a6-2f1e-40da-9c7e-f0e85682294f None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:13:48.172067 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-f7fdf5a6-2f1e-40da-9c7e-f0e85682294f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:13:48.233572 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fdf5a6-2f1e-40da-9c7e-f0e85682294f None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:13:48.237394 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ebd140-d86f-4447-8836-764364fec1cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3802cb341445f994b9204744060ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:13:48.238090 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ebd140-d86f-4447-8836-764364fec1cb service neutron] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:13:48.238373 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ebd140-d86f-4447-8836-764364fec1cb service neutron] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:13:48.238647 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ebd140-d86f-4447-8836-764364fec1cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:13:48.248605 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ebd140-d86f-4447-8836-764364fec1cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:13:48.250058 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ebd140-d86f-4447-8836-764364fec1cb service neutron] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:13:48.259940 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 768/1528] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:13:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:13:50.543007 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7739d84b-1534-4931-bbd9-3bc7318167e7 None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:13:50.543933 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7739d84b-1534-4931-bbd9-3bc7318167e7 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:13:50.543933 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7739d84b-1534-4931-bbd9-3bc7318167e7 None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:13:50.546649 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 761/1529] 127.0.0.1 () {54 vars in 916 bytes} [Wed Mar 30 07:13:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:13:50.554750 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0041cd-4d19-4bde-b5e0-0413cfe716ac None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:13:50.555224 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0041cd-4d19-4bde-b5e0-0413cfe716ac None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:13:50.555345 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0041cd-4d19-4bde-b5e0-0413cfe716ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:13:50.575288 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-4f0041cd-4d19-4bde-b5e0-0413cfe716ac None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:13:50.576479 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-4f0041cd-4d19-4bde-b5e0-0413cfe716ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:13:50.584707 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 769/1530] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Mar 30 07:13:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 07:13:50.621069 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7739d84b-1534-4931-bbd9-3bc7318167e7 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:13:50.622998 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-7739d84b-1534-4931-bbd9-3bc7318167e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:13:50.639185 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7739d84b-1534-4931-bbd9-3bc7318167e7 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:13:50.645210 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbc9240-e803-41b8-b8bb-eb85902129a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3802cb341445f994b9204744060ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:13:50.646104 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc9240-e803-41b8-b8bb-eb85902129a0 service neutron] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:13:50.646437 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc9240-e803-41b8-b8bb-eb85902129a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:13:50.646813 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc9240-e803-41b8-b8bb-eb85902129a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:13:50.662457 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbc9240-e803-41b8-b8bb-eb85902129a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:13:50.664649 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbc9240-e803-41b8-b8bb-eb85902129a0 service neutron] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:13:50.674246 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 762/1531] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:13:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:13:54.451120 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0683f47b-6ac7-4af7-99ac-a3ca7ef1cff8 None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:13:54.452073 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0683f47b-6ac7-4af7-99ac-a3ca7ef1cff8 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:13:54.452073 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0683f47b-6ac7-4af7-99ac-a3ca7ef1cff8 None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:13:54.454638 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 770/1532] 127.0.0.1 () {54 vars in 916 bytes} [Wed Mar 30 07:13:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:13:54.460027 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56db1c7c-c57c-4e50-90f8-140140742059 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:13:54.460748 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56db1c7c-c57c-4e50-90f8-140140742059 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:13:54.460748 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56db1c7c-c57c-4e50-90f8-140140742059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:13:54.485885 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-56db1c7c-c57c-4e50-90f8-140140742059 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:13:54.487081 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-56db1c7c-c57c-4e50-90f8-140140742059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:13:54.495520 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 763/1533] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Mar 30 07:13:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:13:54.749062 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0683f47b-6ac7-4af7-99ac-a3ca7ef1cff8 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:13:54.752036 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-0683f47b-6ac7-4af7-99ac-a3ca7ef1cff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:13:54.823192 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0683f47b-6ac7-4af7-99ac-a3ca7ef1cff8 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:13:54.827681 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db302e13-26ea-47bf-bc71-0c549a30119c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e2fda180e8d448d895c40cdad34bc4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:13:54.828350 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db302e13-26ea-47bf-bc71-0c549a30119c service cinder] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:13:54.828630 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db302e13-26ea-47bf-bc71-0c549a30119c service cinder] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:13:54.828912 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db302e13-26ea-47bf-bc71-0c549a30119c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:13:54.840906 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db302e13-26ea-47bf-bc71-0c549a30119c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:13:54.842361 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db302e13-26ea-47bf-bc71-0c549a30119c service cinder] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:13:54.852226 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 771/1534] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:13:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:13:57.200360 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce12f9f8-a3ba-4c45-808e-56ce2c822c0f None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:13:57.201256 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce12f9f8-a3ba-4c45-808e-56ce2c822c0f None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:13:57.201256 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce12f9f8-a3ba-4c45-808e-56ce2c822c0f None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:13:57.204100 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 764/1535] 127.0.0.1 () {54 vars in 916 bytes} [Wed Mar 30 07:13:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:13:57.212890 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee43a4-c704-4908-9924-2875105dbbef None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:13:57.213597 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee43a4-c704-4908-9924-2875105dbbef None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:13:57.213796 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee43a4-c704-4908-9924-2875105dbbef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:13:57.238292 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-8eee43a4-c704-4908-9924-2875105dbbef None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:13:57.239485 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-8eee43a4-c704-4908-9924-2875105dbbef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:13:57.248339 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 772/1536] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Mar 30 07:13:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:13:57.507425 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82191f2f-989f-4b51-ab6b-d68087aab410 None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:13:57.508013 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82191f2f-989f-4b51-ab6b-d68087aab410 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:13:57.508297 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82191f2f-989f-4b51-ab6b-d68087aab410 None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:13:57.510160 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 765/1537] 10.222.0.20 () {54 vars in 962 bytes} [Wed Mar 30 07:13:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:13:57.515364 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d390d12-2f11-48f2-94da-91c62f1dd8ba None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:13:57.515651 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d390d12-2f11-48f2-94da-91c62f1dd8ba None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:13:57.515952 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d390d12-2f11-48f2-94da-91c62f1dd8ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:13:57.536611 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-7d390d12-2f11-48f2-94da-91c62f1dd8ba None None] MFA Rules not processed for user `5e2fda180e8d448d895c40cdad34bc4c`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:13:57.537789 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-7d390d12-2f11-48f2-94da-91c62f1dd8ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:13:57.546212 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 773/1538] 10.222.0.20 () {58 vars in 1059 bytes} [Wed Mar 30 07:13:57 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:13:57.557005 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82191f2f-989f-4b51-ab6b-d68087aab410 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:13:57.573265 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82191f2f-989f-4b51-ab6b-d68087aab410 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:13:57.577734 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e181dd6-e437-47f8-9696-91821a6abbfd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e2fda180e8d448d895c40cdad34bc4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:13:57.578403 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e181dd6-e437-47f8-9696-91821a6abbfd service cinder] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:13:57.578680 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e181dd6-e437-47f8-9696-91821a6abbfd service cinder] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:13:57.578947 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e181dd6-e437-47f8-9696-91821a6abbfd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:13:57.588737 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e181dd6-e437-47f8-9696-91821a6abbfd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:13:57.590170 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e181dd6-e437-47f8-9696-91821a6abbfd service cinder] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:13:57.599338 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 766/1539] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:13:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:15:23.755920 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1048900f-b373-4d42-8ae2-529f30eddf76 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:23.756595 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1048900f-b373-4d42-8ae2-529f30eddf76 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:23.756595 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1048900f-b373-4d42-8ae2-529f30eddf76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:23.784049 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-1048900f-b373-4d42-8ae2-529f30eddf76 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:15:23.785253 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-1048900f-b373-4d42-8ae2-529f30eddf76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:23.798926 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 774/1540] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:15:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:15:23.808973 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c404b9fe-3e77-4e09-9000-da19d5151991 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:23.809611 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c404b9fe-3e77-4e09-9000-da19d5151991 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:23.809611 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c404b9fe-3e77-4e09-9000-da19d5151991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:23.836826 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-c404b9fe-3e77-4e09-9000-da19d5151991 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:15:23.838017 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-c404b9fe-3e77-4e09-9000-da19d5151991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:23.849469 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 767/1541] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:15:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:15:23.853814 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1048900f-b373-4d42-8ae2-529f30eddf76 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:23.869026 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1048900f-b373-4d42-8ae2-529f30eddf76 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:23.876276 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28edebbb-54a7-4e72-b6ba-019e3cac6b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:23.876960 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28edebbb-54a7-4e72-b6ba-019e3cac6b54 admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:23.877239 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28edebbb-54a7-4e72-b6ba-019e3cac6b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:23.877518 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28edebbb-54a7-4e72-b6ba-019e3cac6b54 admin admin] PATH_INFO: `/v3/domains` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:23.878425 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28edebbb-54a7-4e72-b6ba-019e3cac6b54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:15:23.878736 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28edebbb-54a7-4e72-b6ba-019e3cac6b54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:23.880377 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28edebbb-54a7-4e72-b6ba-019e3cac6b54 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:23.899521 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 775/1542] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Mar 30 07:15:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:15:23.908174 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c404b9fe-3e77-4e09-9000-da19d5151991 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:23.926030 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c404b9fe-3e77-4e09-9000-da19d5151991 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:23.931636 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe80171-0d73-4feb-b951-074d8145f57e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:23.932600 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe80171-0d73-4feb-b951-074d8145f57e admin admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:23.933077 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe80171-0d73-4feb-b951-074d8145f57e admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:23.933529 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe80171-0d73-4feb-b951-074d8145f57e admin admin] PATH_INFO: `/v3/projects` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:23.934444 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe80171-0d73-4feb-b951-074d8145f57e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:23.936567 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe80171-0d73-4feb-b951-074d8145f57e admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:23.983443 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 768/1543] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Mar 30 07:15:23 2022] POST /identity/v3/projects => generated 389 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:15:23.987303 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28edebbb-54a7-4e72-b6ba-019e3cac6b54 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:24.001308 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28edebbb-54a7-4e72-b6ba-019e3cac6b54 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:24.083744 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98e064d-a5ad-45ea-93ce-f803f25f74cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:24.084530 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98e064d-a5ad-45ea-93ce-f803f25f74cf admin admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:24.084809 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98e064d-a5ad-45ea-93ce-f803f25f74cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:24.085079 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98e064d-a5ad-45ea-93ce-f803f25f74cf admin admin] PATH_INFO: `/v3/users` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:24.085778 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98e064d-a5ad-45ea-93ce-f803f25f74cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:24.087711 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98e064d-a5ad-45ea-93ce-f803f25f74cf admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:24.123350 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 776/1544] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Mar 30 07:15:23 2022] POST /identity/v3/users => generated 295 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:15:24.127422 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe80171-0d73-4feb-b951-074d8145f57e admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:24.145141 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe80171-0d73-4feb-b951-074d8145f57e admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:24.153980 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28339c9d-08dd-4aaa-8812-637524a76e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:24.154950 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28339c9d-08dd-4aaa-8812-637524a76e05 admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:24.155445 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28339c9d-08dd-4aaa-8812-637524a76e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:24.156083 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28339c9d-08dd-4aaa-8812-637524a76e05 admin admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:24.157024 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28339c9d-08dd-4aaa-8812-637524a76e05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:24.158911 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28339c9d-08dd-4aaa-8812-637524a76e05 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:24.170755 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 769/1545] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:15:24 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:15:24.174603 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98e064d-a5ad-45ea-93ce-f803f25f74cf admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:24.179111 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d15b5a-a988-4f93-b88d-ff7f6fbe51d3 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:24.179739 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d15b5a-a988-4f93-b88d-ff7f6fbe51d3 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:24.180271 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d15b5a-a988-4f93-b88d-ff7f6fbe51d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:24.189550 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98e064d-a5ad-45ea-93ce-f803f25f74cf admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:24.216632 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7313eeef-bd8a-4350-a5b1-92376244f1ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:24.217371 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7313eeef-bd8a-4350-a5b1-92376244f1ee admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:24.217636 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7313eeef-bd8a-4350-a5b1-92376244f1ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:24.217922 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7313eeef-bd8a-4350-a5b1-92376244f1ee admin admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:24.218877 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7313eeef-bd8a-4350-a5b1-92376244f1ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:24.225028 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7313eeef-bd8a-4350-a5b1-92376244f1ee admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:24.243909 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 777/1546] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:15:24 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:15:24.245566 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-56d15b5a-a988-4f93-b88d-ff7f6fbe51d3 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:15:24.245774 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7313eeef-bd8a-4350-a5b1-92376244f1ee admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:24.246915 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-56d15b5a-a988-4f93-b88d-ff7f6fbe51d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:24.262830 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7313eeef-bd8a-4350-a5b1-92376244f1ee admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:24.278078 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 770/1547] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:15:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 07:15:24.281434 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac31287d-a47e-4af7-b5c6-e5398bb31f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:24.282362 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac31287d-a47e-4af7-b5c6-e5398bb31f2d admin admin] REQUEST_METHOD: `PUT` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:24.282646 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac31287d-a47e-4af7-b5c6-e5398bb31f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:24.282921 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac31287d-a47e-4af7-b5c6-e5398bb31f2d admin admin] PATH_INFO: `/v3/projects/8ee09b83520e4e8ba691a79d60604388/users/93c4c81f994a48feb4d712c6b5120996/roles/5d79031a64754b57ba120367465e2252` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:24.289398 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a94a24c-bd64-4f96-a874-09e028745003 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:24.290389 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a94a24c-bd64-4f96-a874-09e028745003 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:24.290545 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a94a24c-bd64-4f96-a874-09e028745003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:24.321108 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac31287d-a47e-4af7-b5c6-e5398bb31f2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ee09b83520e4e8ba691a79d60604388, user_id=93c4c81f994a48feb4d712c6b5120996, role_id=5d79031a64754b57ba120367465e2252)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:24.322182 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING py.warnings [None req-ac31287d-a47e-4af7-b5c6-e5398bb31f2d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 30 07:15:24.322182 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: warnings.warn(msg) Mar 30 07:15:24.322182 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: Mar 30 07:15:24.324196 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac31287d-a47e-4af7-b5c6-e5398bb31f2d admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:24.336605 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-2a94a24c-bd64-4f96-a874-09e028745003 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:15:24.337731 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-2a94a24c-bd64-4f96-a874-09e028745003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:24.354516 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 778/1548] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:15:24 2022] PUT /identity/v3/projects/8ee09b83520e4e8ba691a79d60604388/users/93c4c81f994a48feb4d712c6b5120996/roles/5d79031a64754b57ba120367465e2252 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:15:24.359842 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1bf75e-dda6-45dc-8554-c685159acf4c None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:24.360191 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1bf75e-dda6-45dc-8554-c685159acf4c None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:24.360414 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1bf75e-dda6-45dc-8554-c685159acf4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:24.396491 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-3d1bf75e-dda6-45dc-8554-c685159acf4c None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:15:24.397700 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-3d1bf75e-dda6-45dc-8554-c685159acf4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:24.477109 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 771/1549] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:15:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 07:15:24.478370 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa45d9-fa7a-4a37-870a-4fd05e39c4be None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:24.478965 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa45d9-fa7a-4a37-870a-4fd05e39c4be None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:24.479245 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa45d9-fa7a-4a37-870a-4fd05e39c4be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:24.503191 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-c5fa45d9-fa7a-4a37-870a-4fd05e39c4be None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:15:24.504386 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-c5fa45d9-fa7a-4a37-870a-4fd05e39c4be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:24.517635 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 772/1550] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:15:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:15:24.518769 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee305a8d-46ff-4331-b509-2ad8f7a5fbb8 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:24.519049 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee305a8d-46ff-4331-b509-2ad8f7a5fbb8 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:24.520684 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee305a8d-46ff-4331-b509-2ad8f7a5fbb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:24.528055 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 779/1551] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:15:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:15:24.531368 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1bf75e-dda6-45dc-8554-c685159acf4c None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:24.555484 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-ee305a8d-46ff-4331-b509-2ad8f7a5fbb8 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:15:24.556429 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1bf75e-dda6-45dc-8554-c685159acf4c None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:24.556717 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-ee305a8d-46ff-4331-b509-2ad8f7a5fbb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:24.561874 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f198a1b6-ca1b-4343-b78f-53d5d176cc00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:24.562576 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f198a1b6-ca1b-4343-b78f-53d5d176cc00 admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:24.562861 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f198a1b6-ca1b-4343-b78f-53d5d176cc00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:24.563136 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f198a1b6-ca1b-4343-b78f-53d5d176cc00 admin admin] PATH_INFO: `/v3/domains` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:24.564040 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f198a1b6-ca1b-4343-b78f-53d5d176cc00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:15:24.564350 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f198a1b6-ca1b-4343-b78f-53d5d176cc00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:24.566065 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f198a1b6-ca1b-4343-b78f-53d5d176cc00 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:24.567853 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 773/1552] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:15:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:15:24.569121 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d0303-e3ac-490e-afb6-f8dae525def7 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:24.569667 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d0303-e3ac-490e-afb6-f8dae525def7 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:24.569942 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d0303-e3ac-490e-afb6-f8dae525def7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:24.581017 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 780/1553] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Mar 30 07:15:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:15:24.582704 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e30996-9e6f-41e8-ae8e-34bc11f8f358 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:24.582992 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e30996-9e6f-41e8-ae8e-34bc11f8f358 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:24.583774 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e30996-9e6f-41e8-ae8e-34bc11f8f358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:24.595844 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-5e8d0303-e3ac-490e-afb6-f8dae525def7 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:15:24.598161 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-5e8d0303-e3ac-490e-afb6-f8dae525def7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:24.601868 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-26e30996-9e6f-41e8-ae8e-34bc11f8f358 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:15:24.603023 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-26e30996-9e6f-41e8-ae8e-34bc11f8f358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:24.608528 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 774/1554] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:15:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:15:24.609667 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8d0303-e3ac-490e-afb6-f8dae525def7 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:24.613561 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 781/1555] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:15:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:15:24.615008 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7133b53d-db6d-4e0f-b268-1ebcc5f17a32 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:24.615453 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7133b53d-db6d-4e0f-b268-1ebcc5f17a32 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:24.615911 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7133b53d-db6d-4e0f-b268-1ebcc5f17a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:24.634333 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-7133b53d-db6d-4e0f-b268-1ebcc5f17a32 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:15:24.635517 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-7133b53d-db6d-4e0f-b268-1ebcc5f17a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:24.644217 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 782/1556] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:15:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:15:24.649400 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618a70d8-39b7-46ce-a6d7-6c546d7f6ea4 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:24.649695 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618a70d8-39b7-46ce-a6d7-6c546d7f6ea4 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:24.649963 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618a70d8-39b7-46ce-a6d7-6c546d7f6ea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:24.677942 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-618a70d8-39b7-46ce-a6d7-6c546d7f6ea4 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:15:24.678402 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8d0303-e3ac-490e-afb6-f8dae525def7 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:24.679264 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-618a70d8-39b7-46ce-a6d7-6c546d7f6ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:24.682368 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7f0d14-7f6d-4997-a6b1-e4841a621cbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3802cb341445f994b9204744060ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:24.683086 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7f0d14-7f6d-4997-a6b1-e4841a621cbc service neutron] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:24.683364 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7f0d14-7f6d-4997-a6b1-e4841a621cbc service neutron] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:24.683677 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7f0d14-7f6d-4997-a6b1-e4841a621cbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:24.687308 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 783/1557] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:15:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:15:24.688663 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d06875a-bac7-4da4-aede-918e71a2a26d None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:24.689049 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d06875a-bac7-4da4-aede-918e71a2a26d None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:24.689503 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d06875a-bac7-4da4-aede-918e71a2a26d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:24.693404 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7f0d14-7f6d-4997-a6b1-e4841a621cbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:24.695254 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7f0d14-7f6d-4997-a6b1-e4841a621cbc service neutron] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:24.705759 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 775/1558] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:15:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:15:24.706587 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7f0d14-7f6d-4997-a6b1-e4841a621cbc service neutron] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:24.708355 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-5d06875a-bac7-4da4-aede-918e71a2a26d None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:15:24.709520 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-5d06875a-bac7-4da4-aede-918e71a2a26d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:24.716176 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7f0d14-7f6d-4997-a6b1-e4841a621cbc service neutron] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:24.722193 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 784/1559] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:15:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:15:24.722193 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3b5136-4213-46a1-961b-da243651bff1 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:24.722193 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3b5136-4213-46a1-961b-da243651bff1 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:24.722193 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3b5136-4213-46a1-961b-da243651bff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:24.724984 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771f8f94-837b-464b-86b5-62c23c7bc591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:24.725648 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f8f94-837b-464b-86b5-62c23c7bc591 admin admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:24.725932 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f8f94-837b-464b-86b5-62c23c7bc591 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:24.726206 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f8f94-837b-464b-86b5-62c23c7bc591 admin admin] PATH_INFO: `/v3/projects` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:24.726900 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771f8f94-837b-464b-86b5-62c23c7bc591 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:24.728918 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771f8f94-837b-464b-86b5-62c23c7bc591 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:24.739963 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-aa3b5136-4213-46a1-961b-da243651bff1 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:15:24.741193 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-aa3b5136-4213-46a1-961b-da243651bff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:24.750532 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 785/1560] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:15:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:15:24.751713 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3b5136-4213-46a1-961b-da243651bff1 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:24.760558 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 776/1561] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Mar 30 07:15:24 2022] POST /identity/v3/projects => generated 393 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:15:24.762314 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3b5136-4213-46a1-961b-da243651bff1 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:24.762863 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665d392f-ba82-404e-b716-ed9891329033 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:24.762863 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665d392f-ba82-404e-b716-ed9891329033 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:24.763264 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665d392f-ba82-404e-b716-ed9891329033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:24.783342 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-665d392f-ba82-404e-b716-ed9891329033 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:15:24.784690 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-665d392f-ba82-404e-b716-ed9891329033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:24.830974 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212e8186-28cb-4f16-bef2-e2eb9c696b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:24.831709 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212e8186-28cb-4f16-bef2-e2eb9c696b9a admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:24.832014 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212e8186-28cb-4f16-bef2-e2eb9c696b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:24.832331 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212e8186-28cb-4f16-bef2-e2eb9c696b9a admin admin] PATH_INFO: `/v3/domains` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:24.833163 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212e8186-28cb-4f16-bef2-e2eb9c696b9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:15:24.833537 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212e8186-28cb-4f16-bef2-e2eb9c696b9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:24.835312 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212e8186-28cb-4f16-bef2-e2eb9c696b9a admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:24.849196 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 786/1562] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Mar 30 07:15:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:15:24.855690 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 777/1563] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:15:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:15:24.858816 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f181fc-0d31-4c18-b2c3-7e629aa7c084 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:24.858958 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92b0f40-2aac-4b2c-943a-7c8a5705c17c None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:24.859159 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92b0f40-2aac-4b2c-943a-7c8a5705c17c None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:24.859282 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f181fc-0d31-4c18-b2c3-7e629aa7c084 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:24.859464 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92b0f40-2aac-4b2c-943a-7c8a5705c17c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:24.859577 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f181fc-0d31-4c18-b2c3-7e629aa7c084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:24.878241 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-c92b0f40-2aac-4b2c-943a-7c8a5705c17c None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:15:24.879472 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-c92b0f40-2aac-4b2c-943a-7c8a5705c17c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:24.881620 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-21f181fc-0d31-4c18-b2c3-7e629aa7c084 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:15:24.883332 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-21f181fc-0d31-4c18-b2c3-7e629aa7c084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:24.888341 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 787/1564] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:15:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:15:24.889302 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92b0f40-2aac-4b2c-943a-7c8a5705c17c None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:24.898622 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 778/1565] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:15:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:15:24.899973 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f181fc-0d31-4c18-b2c3-7e629aa7c084 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:24.906236 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92b0f40-2aac-4b2c-943a-7c8a5705c17c None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:24.911412 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f181fc-0d31-4c18-b2c3-7e629aa7c084 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:24.913348 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b10bdeb-51c2-4c58-9d46-3fe991476672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:24.914034 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b10bdeb-51c2-4c58-9d46-3fe991476672 admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:24.914347 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b10bdeb-51c2-4c58-9d46-3fe991476672 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:24.914620 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b10bdeb-51c2-4c58-9d46-3fe991476672 admin admin] PATH_INFO: `/v3/domains` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:24.915357 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b10bdeb-51c2-4c58-9d46-3fe991476672 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:15:24.915663 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b10bdeb-51c2-4c58-9d46-3fe991476672 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:24.917073 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c439a909-c6ee-47bf-9cb8-f6eedc969649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:24.917759 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b10bdeb-51c2-4c58-9d46-3fe991476672 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:24.918134 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c439a909-c6ee-47bf-9cb8-f6eedc969649 admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:24.918470 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c439a909-c6ee-47bf-9cb8-f6eedc969649 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:24.918863 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c439a909-c6ee-47bf-9cb8-f6eedc969649 admin admin] PATH_INFO: `/v3/domains` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:24.920232 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c439a909-c6ee-47bf-9cb8-f6eedc969649 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:15:24.920971 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c439a909-c6ee-47bf-9cb8-f6eedc969649 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:24.922117 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING py.warnings [None req-c439a909-c6ee-47bf-9cb8-f6eedc969649 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 30 07:15:24.922117 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: warnings.warn(msg) Mar 30 07:15:24.922117 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: Mar 30 07:15:24.923085 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c439a909-c6ee-47bf-9cb8-f6eedc969649 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:24.931158 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 788/1566] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Mar 30 07:15:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:15:24.932094 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b10bdeb-51c2-4c58-9d46-3fe991476672 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:24.942554 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 779/1567] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Mar 30 07:15:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:15:24.943965 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c439a909-c6ee-47bf-9cb8-f6eedc969649 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:24.956819 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c439a909-c6ee-47bf-9cb8-f6eedc969649 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:24.957913 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b10bdeb-51c2-4c58-9d46-3fe991476672 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:24.961866 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff9aa89-76b1-40f0-b3d1-3d60b811d117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:24.962551 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff9aa89-76b1-40f0-b3d1-3d60b811d117 admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:24.962833 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff9aa89-76b1-40f0-b3d1-3d60b811d117 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:24.963133 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff9aa89-76b1-40f0-b3d1-3d60b811d117 admin admin] PATH_INFO: `/v3/domains` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:24.963677 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f95e61-5d01-4b05-b406-bc1682df6c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:24.963845 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff9aa89-76b1-40f0-b3d1-3d60b811d117 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:15:24.964162 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff9aa89-76b1-40f0-b3d1-3d60b811d117 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:24.964385 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f95e61-5d01-4b05-b406-bc1682df6c6b admin admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:24.964779 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f95e61-5d01-4b05-b406-bc1682df6c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:24.965117 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f95e61-5d01-4b05-b406-bc1682df6c6b admin admin] PATH_INFO: `/v3/users` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:24.965928 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f95e61-5d01-4b05-b406-bc1682df6c6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:24.966057 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff9aa89-76b1-40f0-b3d1-3d60b811d117 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:24.968015 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f95e61-5d01-4b05-b406-bc1682df6c6b admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:24.980432 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 780/1568] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Mar 30 07:15:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:15:24.982126 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff9aa89-76b1-40f0-b3d1-3d60b811d117 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:25.003554 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 789/1569] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Mar 30 07:15:24 2022] POST /identity/v3/users => generated 297 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:15:25.003796 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff9aa89-76b1-40f0-b3d1-3d60b811d117 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:25.003936 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e08af-3211-4eb8-aa40-24727c8c591b None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:25.003936 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e08af-3211-4eb8-aa40-24727c8c591b None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:25.003936 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e08af-3211-4eb8-aa40-24727c8c591b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:25.006973 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95722c89-92d6-4759-963e-753329120de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:25.007637 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95722c89-92d6-4759-963e-753329120de7 admin admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:25.009687 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95722c89-92d6-4759-963e-753329120de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:25.009687 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95722c89-92d6-4759-963e-753329120de7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:25.009687 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95722c89-92d6-4759-963e-753329120de7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:25.011941 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95722c89-92d6-4759-963e-753329120de7 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:25.019961 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-c11e08af-3211-4eb8-aa40-24727c8c591b None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:15:25.020921 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-c11e08af-3211-4eb8-aa40-24727c8c591b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:25.030249 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 790/1570] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:15:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:15:25.033004 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11e08af-3211-4eb8-aa40-24727c8c591b None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:25.037831 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 781/1571] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Mar 30 07:15:24 2022] POST /identity/v3/projects => generated 377 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:15:25.041617 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95722c89-92d6-4759-963e-753329120de7 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:25.046158 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11e08af-3211-4eb8-aa40-24727c8c591b None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:25.112337 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95722c89-92d6-4759-963e-753329120de7 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:25.117293 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f797ee28-8ff7-4d30-81f7-77497b7e2bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:25.118065 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f797ee28-8ff7-4d30-81f7-77497b7e2bd8 admin admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:25.118405 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f797ee28-8ff7-4d30-81f7-77497b7e2bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:25.118736 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f797ee28-8ff7-4d30-81f7-77497b7e2bd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:25.119492 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f797ee28-8ff7-4d30-81f7-77497b7e2bd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:25.121509 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f797ee28-8ff7-4d30-81f7-77497b7e2bd8 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:25.127068 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b98807-1080-44ae-a4bc-b2962b77b70d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:25.128041 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b98807-1080-44ae-a4bc-b2962b77b70d admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:25.128534 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b98807-1080-44ae-a4bc-b2962b77b70d admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:25.129004 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b98807-1080-44ae-a4bc-b2962b77b70d admin admin] PATH_INFO: `/v3/domains` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:25.129920 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b98807-1080-44ae-a4bc-b2962b77b70d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:15:25.130802 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b98807-1080-44ae-a4bc-b2962b77b70d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:25.133344 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b98807-1080-44ae-a4bc-b2962b77b70d admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:25.150738 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 791/1572] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Mar 30 07:15:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:15:25.152355 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b98807-1080-44ae-a4bc-b2962b77b70d admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:25.163458 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 782/1573] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Mar 30 07:15:25 2022] POST /identity/v3/projects => generated 379 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:15:25.163458 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f797ee28-8ff7-4d30-81f7-77497b7e2bd8 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:25.168235 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b98807-1080-44ae-a4bc-b2962b77b70d admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:25.236831 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39e0fe7-b66a-4f68-8550-a30698a3ba61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:25.237538 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e0fe7-b66a-4f68-8550-a30698a3ba61 admin admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:25.237821 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e0fe7-b66a-4f68-8550-a30698a3ba61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:25.238097 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e0fe7-b66a-4f68-8550-a30698a3ba61 admin admin] PATH_INFO: `/v3/projects` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:25.238822 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39e0fe7-b66a-4f68-8550-a30698a3ba61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:25.239867 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING py.warnings [None req-c39e0fe7-b66a-4f68-8550-a30698a3ba61 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 30 07:15:25.239867 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: warnings.warn(msg) Mar 30 07:15:25.239867 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: Mar 30 07:15:25.241074 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39e0fe7-b66a-4f68-8550-a30698a3ba61 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:25.242672 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f797ee28-8ff7-4d30-81f7-77497b7e2bd8 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:25.248204 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262dbee1-40b8-42a3-a332-53a45ac2111a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:25.249071 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262dbee1-40b8-42a3-a332-53a45ac2111a admin admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:25.249503 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262dbee1-40b8-42a3-a332-53a45ac2111a admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:25.249779 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262dbee1-40b8-42a3-a332-53a45ac2111a admin admin] PATH_INFO: `/v3/projects` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:25.250480 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262dbee1-40b8-42a3-a332-53a45ac2111a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:25.252445 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262dbee1-40b8-42a3-a332-53a45ac2111a admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:25.270924 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 792/1574] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Mar 30 07:15:25 2022] POST /identity/v3/projects => generated 403 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:15:25.271899 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39e0fe7-b66a-4f68-8550-a30698a3ba61 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:25.287920 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 783/1575] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Mar 30 07:15:25 2022] POST /identity/v3/projects => generated 405 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:15:25.288828 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262dbee1-40b8-42a3-a332-53a45ac2111a admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:25.342095 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39e0fe7-b66a-4f68-8550-a30698a3ba61 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:25.361088 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262dbee1-40b8-42a3-a332-53a45ac2111a admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:25.365760 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7fa566-4290-41c3-ba72-de075f62044a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:25.366366 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7fa566-4290-41c3-ba72-de075f62044a admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:25.366647 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7fa566-4290-41c3-ba72-de075f62044a admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:25.366921 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7fa566-4290-41c3-ba72-de075f62044a admin admin] PATH_INFO: `/v3/domains` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:25.367688 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7fa566-4290-41c3-ba72-de075f62044a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:15:25.368009 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7fa566-4290-41c3-ba72-de075f62044a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:25.369631 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7fa566-4290-41c3-ba72-de075f62044a admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:25.382572 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 784/1576] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Mar 30 07:15:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:15:25.383420 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7fa566-4290-41c3-ba72-de075f62044a admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:25.401889 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7fa566-4290-41c3-ba72-de075f62044a admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:25.412202 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a75c6a-114a-4dc7-b5fa-3e781c275d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:25.413108 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a75c6a-114a-4dc7-b5fa-3e781c275d4a admin admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:25.413479 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a75c6a-114a-4dc7-b5fa-3e781c275d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:25.413910 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a75c6a-114a-4dc7-b5fa-3e781c275d4a admin admin] PATH_INFO: `/v3/users` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:25.415017 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a75c6a-114a-4dc7-b5fa-3e781c275d4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:25.416665 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING py.warnings [None req-f6a75c6a-114a-4dc7-b5fa-3e781c275d4a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 30 07:15:25.416665 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: warnings.warn(msg) Mar 30 07:15:25.416665 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: Mar 30 07:15:25.417944 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a75c6a-114a-4dc7-b5fa-3e781c275d4a admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:25.429105 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625baac1-cd5f-40a3-99e5-348d82091ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:25.429999 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625baac1-cd5f-40a3-99e5-348d82091ddc admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:25.430315 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625baac1-cd5f-40a3-99e5-348d82091ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:25.430725 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625baac1-cd5f-40a3-99e5-348d82091ddc admin admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:25.432012 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625baac1-cd5f-40a3-99e5-348d82091ddc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:25.434100 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625baac1-cd5f-40a3-99e5-348d82091ddc admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:25.447635 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 785/1577] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Mar 30 07:15:25 2022] POST /identity/v3/users => generated 289 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:15:25.447635 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a75c6a-114a-4dc7-b5fa-3e781c275d4a admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:25.448401 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 793/1578] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:15:25 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:15:25.450188 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625baac1-cd5f-40a3-99e5-348d82091ddc admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:25.461685 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625baac1-cd5f-40a3-99e5-348d82091ddc admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:25.464643 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a75c6a-114a-4dc7-b5fa-3e781c275d4a admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:25.469079 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b8ebf4-7e9f-406a-9b45-2b5e970448c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:25.469791 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b8ebf4-7e9f-406a-9b45-2b5e970448c4 admin admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:25.470094 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b8ebf4-7e9f-406a-9b45-2b5e970448c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:25.470340 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b8ebf4-7e9f-406a-9b45-2b5e970448c4 admin admin] PATH_INFO: `/v3/users` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:25.471198 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b8ebf4-7e9f-406a-9b45-2b5e970448c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:25.473265 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b8ebf4-7e9f-406a-9b45-2b5e970448c4 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:25.479919 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73648b4-574a-49a4-b20b-6d8098c75a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:25.480791 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73648b4-574a-49a4-b20b-6d8098c75a57 admin admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:25.481220 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73648b4-574a-49a4-b20b-6d8098c75a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:25.482005 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73648b4-574a-49a4-b20b-6d8098c75a57 admin admin] PATH_INFO: `/v3/projects` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:25.482810 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73648b4-574a-49a4-b20b-6d8098c75a57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:25.484805 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73648b4-574a-49a4-b20b-6d8098c75a57 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:25.506875 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 794/1579] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Mar 30 07:15:25 2022] POST /identity/v3/users => generated 290 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:15:25.508727 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b8ebf4-7e9f-406a-9b45-2b5e970448c4 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:25.520997 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 786/1580] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Mar 30 07:15:25 2022] POST /identity/v3/projects => generated 371 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:15:25.522684 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73648b4-574a-49a4-b20b-6d8098c75a57 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:25.526301 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b8ebf4-7e9f-406a-9b45-2b5e970448c4 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:25.603780 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73648b4-574a-49a4-b20b-6d8098c75a57 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:25.605863 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5300128-ad03-45e3-b4b5-71935775a445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:25.607019 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5300128-ad03-45e3-b4b5-71935775a445 admin admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:25.607311 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5300128-ad03-45e3-b4b5-71935775a445 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:25.607731 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5300128-ad03-45e3-b4b5-71935775a445 admin admin] PATH_INFO: `/v3/users` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:25.608638 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5300128-ad03-45e3-b4b5-71935775a445 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:25.609814 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15e3972-ee0d-468e-acbb-78882f192db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:25.610696 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15e3972-ee0d-468e-acbb-78882f192db0 admin admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:25.610823 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5300128-ad03-45e3-b4b5-71935775a445 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:25.611280 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15e3972-ee0d-468e-acbb-78882f192db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:25.611738 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15e3972-ee0d-468e-acbb-78882f192db0 admin admin] PATH_INFO: `/v3/users` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:25.612743 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15e3972-ee0d-468e-acbb-78882f192db0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:25.614862 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15e3972-ee0d-468e-acbb-78882f192db0 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:25.639006 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 795/1581] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Mar 30 07:15:25 2022] POST /identity/v3/users => generated 302 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:15:25.639771 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5300128-ad03-45e3-b4b5-71935775a445 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:25.647589 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 787/1582] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Mar 30 07:15:25 2022] POST /identity/v3/users => generated 303 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:15:25.648749 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15e3972-ee0d-468e-acbb-78882f192db0 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:25.650995 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5300128-ad03-45e3-b4b5-71935775a445 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:25.656371 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a48ff97-c0e5-40de-a5ca-ffe5eadefdeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:25.657043 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a48ff97-c0e5-40de-a5ca-ffe5eadefdeb admin admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:25.657325 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a48ff97-c0e5-40de-a5ca-ffe5eadefdeb admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:25.657600 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a48ff97-c0e5-40de-a5ca-ffe5eadefdeb admin admin] PATH_INFO: `/v3/projects` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:25.658350 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a48ff97-c0e5-40de-a5ca-ffe5eadefdeb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:25.660462 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a48ff97-c0e5-40de-a5ca-ffe5eadefdeb admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:25.666789 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15e3972-ee0d-468e-acbb-78882f192db0 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:25.672810 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dc9d71-abf6-4024-978b-0fd823b78829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:25.673784 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc9d71-abf6-4024-978b-0fd823b78829 admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:25.674068 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc9d71-abf6-4024-978b-0fd823b78829 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:25.674822 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc9d71-abf6-4024-978b-0fd823b78829 admin admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:25.676335 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dc9d71-abf6-4024-978b-0fd823b78829 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:25.678709 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dc9d71-abf6-4024-978b-0fd823b78829 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:25.692331 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 788/1583] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:15:25 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:15:25.693498 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dc9d71-abf6-4024-978b-0fd823b78829 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:25.701867 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 796/1584] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Mar 30 07:15:25 2022] POST /identity/v3/projects => generated 367 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:15:25.701867 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a48ff97-c0e5-40de-a5ca-ffe5eadefdeb admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:25.710360 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dc9d71-abf6-4024-978b-0fd823b78829 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:25.777127 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a48ff97-c0e5-40de-a5ca-ffe5eadefdeb admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:25.783478 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f618a2-7810-4489-b09e-375a5ea28c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:25.784197 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f618a2-7810-4489-b09e-375a5ea28c23 admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:25.784509 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f618a2-7810-4489-b09e-375a5ea28c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:25.784752 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f618a2-7810-4489-b09e-375a5ea28c23 admin admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:25.785483 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f618a2-7810-4489-b09e-375a5ea28c23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:25.787085 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f618a2-7810-4489-b09e-375a5ea28c23 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:25.793083 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c31b6a-5c05-4260-9b29-7feaea3889ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:25.794393 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c31b6a-5c05-4260-9b29-7feaea3889ee admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:25.794867 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c31b6a-5c05-4260-9b29-7feaea3889ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:25.795361 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c31b6a-5c05-4260-9b29-7feaea3889ee admin admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:25.796351 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c31b6a-5c05-4260-9b29-7feaea3889ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:25.798310 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c31b6a-5c05-4260-9b29-7feaea3889ee admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:25.799093 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 797/1585] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:15:25 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:15:25.802865 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f618a2-7810-4489-b09e-375a5ea28c23 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:25.810266 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 789/1586] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:15:25 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:15:25.813512 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f618a2-7810-4489-b09e-375a5ea28c23 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:25.814661 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c31b6a-5c05-4260-9b29-7feaea3889ee admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:25.818142 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43fa0a4-2360-4199-9397-7f9061fd299d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:25.818814 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43fa0a4-2360-4199-9397-7f9061fd299d admin admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:25.819094 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43fa0a4-2360-4199-9397-7f9061fd299d admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:25.819366 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43fa0a4-2360-4199-9397-7f9061fd299d admin admin] PATH_INFO: `/v3/users` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:25.820088 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43fa0a4-2360-4199-9397-7f9061fd299d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:25.822018 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43fa0a4-2360-4199-9397-7f9061fd299d admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:25.827159 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c31b6a-5c05-4260-9b29-7feaea3889ee admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:25.832587 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e514f1d1-d749-4100-b705-cc745741a9c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:25.833530 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e514f1d1-d749-4100-b705-cc745741a9c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:25.834077 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e514f1d1-d749-4100-b705-cc745741a9c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:25.834815 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e514f1d1-d749-4100-b705-cc745741a9c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:25.835785 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e514f1d1-d749-4100-b705-cc745741a9c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:25.837817 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e514f1d1-d749-4100-b705-cc745741a9c5 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:25.849933 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 790/1587] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:15:25 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:15:25.856551 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 798/1588] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Mar 30 07:15:25 2022] POST /identity/v3/users => generated 286 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:15:25.856551 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43fa0a4-2360-4199-9397-7f9061fd299d admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:25.858406 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e514f1d1-d749-4100-b705-cc745741a9c5 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:25.863999 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43fa0a4-2360-4199-9397-7f9061fd299d admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:25.869164 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e514f1d1-d749-4100-b705-cc745741a9c5 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:25.870606 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd65d41-a4ea-4669-b003-8c7b84bc514d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:25.871473 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd65d41-a4ea-4669-b003-8c7b84bc514d admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:25.872024 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd65d41-a4ea-4669-b003-8c7b84bc514d admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:25.872492 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd65d41-a4ea-4669-b003-8c7b84bc514d admin admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:25.873705 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd65d41-a4ea-4669-b003-8c7b84bc514d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:25.874954 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974dde2d-2aab-4baa-979b-85bc4121a617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:25.875603 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd65d41-a4ea-4669-b003-8c7b84bc514d admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:25.876016 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974dde2d-2aab-4baa-979b-85bc4121a617 admin admin] REQUEST_METHOD: `PUT` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:25.876366 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974dde2d-2aab-4baa-979b-85bc4121a617 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:25.876629 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974dde2d-2aab-4baa-979b-85bc4121a617 admin admin] PATH_INFO: `/v3/projects/b5ef95aec46649a2b057416827ea46aa/users/bc84d32966d34ff29620cd40d3d9cc3a/roles/5d79031a64754b57ba120367465e2252` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:25.892677 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 799/1589] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:15:25 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:15:25.893598 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd65d41-a4ea-4669-b003-8c7b84bc514d admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:25.897720 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974dde2d-2aab-4baa-979b-85bc4121a617 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5ef95aec46649a2b057416827ea46aa, user_id=bc84d32966d34ff29620cd40d3d9cc3a, role_id=5d79031a64754b57ba120367465e2252)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:25.901067 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974dde2d-2aab-4baa-979b-85bc4121a617 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:25.908972 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd65d41-a4ea-4669-b003-8c7b84bc514d admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:25.915685 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b84bae-9020-4c92-8a66-6deda006248e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:25.916446 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b84bae-9020-4c92-8a66-6deda006248e admin admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:25.916769 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b84bae-9020-4c92-8a66-6deda006248e admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:25.917044 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b84bae-9020-4c92-8a66-6deda006248e admin admin] PATH_INFO: `/v3/users` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:25.917788 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b84bae-9020-4c92-8a66-6deda006248e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:25.919889 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 791/1590] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:15:25 2022] PUT /identity/v3/projects/b5ef95aec46649a2b057416827ea46aa/users/bc84d32966d34ff29620cd40d3d9cc3a/roles/5d79031a64754b57ba120367465e2252 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:15:25.920840 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b84bae-9020-4c92-8a66-6deda006248e admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:25.921273 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974dde2d-2aab-4baa-979b-85bc4121a617 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:25.947037 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 800/1591] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Mar 30 07:15:25 2022] POST /identity/v3/users => generated 284 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:15:25.947997 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b84bae-9020-4c92-8a66-6deda006248e admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:25.961709 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b84bae-9020-4c92-8a66-6deda006248e admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:26.014108 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974dde2d-2aab-4baa-979b-85bc4121a617 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:26.020480 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54c8463-9631-4ddd-96e3-309a3e23c18b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:26.021436 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54c8463-9631-4ddd-96e3-309a3e23c18b admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:26.021889 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54c8463-9631-4ddd-96e3-309a3e23c18b admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:26.022554 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54c8463-9631-4ddd-96e3-309a3e23c18b admin admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:26.023650 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54c8463-9631-4ddd-96e3-309a3e23c18b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:26.025636 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54c8463-9631-4ddd-96e3-309a3e23c18b admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:26.035042 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53899b34-a2f1-4894-b309-2106909f2392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:26.035978 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53899b34-a2f1-4894-b309-2106909f2392 admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:26.036568 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53899b34-a2f1-4894-b309-2106909f2392 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:26.036962 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53899b34-a2f1-4894-b309-2106909f2392 admin admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:26.037758 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53899b34-a2f1-4894-b309-2106909f2392 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:26.041082 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 792/1592] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:15:25 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:15:26.041082 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54c8463-9631-4ddd-96e3-309a3e23c18b admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:26.041289 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53899b34-a2f1-4894-b309-2106909f2392 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:26.059701 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54c8463-9631-4ddd-96e3-309a3e23c18b admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:26.061861 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 801/1593] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:15:25 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:15:26.063555 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53899b34-a2f1-4894-b309-2106909f2392 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:26.068080 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403678b4-838d-4be4-85d6-deb6d335b1bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:26.068783 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403678b4-838d-4be4-85d6-deb6d335b1bb admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:26.069063 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403678b4-838d-4be4-85d6-deb6d335b1bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:26.069335 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403678b4-838d-4be4-85d6-deb6d335b1bb admin admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:26.070063 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403678b4-838d-4be4-85d6-deb6d335b1bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:26.072497 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403678b4-838d-4be4-85d6-deb6d335b1bb admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:26.082569 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53899b34-a2f1-4894-b309-2106909f2392 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:26.088668 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b1b471-f8e0-4a78-89a8-9578a9af1003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:26.089188 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 793/1594] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:15:26 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:15:26.089886 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b1b471-f8e0-4a78-89a8-9578a9af1003 admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:26.090371 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b1b471-f8e0-4a78-89a8-9578a9af1003 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:26.090836 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403678b4-838d-4be4-85d6-deb6d335b1bb admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:26.091231 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b1b471-f8e0-4a78-89a8-9578a9af1003 admin admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:26.092657 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b1b471-f8e0-4a78-89a8-9578a9af1003 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:26.094639 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b1b471-f8e0-4a78-89a8-9578a9af1003 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:26.102713 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403678b4-838d-4be4-85d6-deb6d335b1bb admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:26.109828 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 802/1595] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:15:26 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:15:26.110016 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33b5a86-f877-4fd5-a18c-f94084245ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:26.110725 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33b5a86-f877-4fd5-a18c-f94084245ef5 admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:26.111010 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33b5a86-f877-4fd5-a18c-f94084245ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:26.111422 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33b5a86-f877-4fd5-a18c-f94084245ef5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:26.112290 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09360777-7391-4d08-82d5-32aa056fd7bf None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:26.112426 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33b5a86-f877-4fd5-a18c-f94084245ef5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:26.112911 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09360777-7391-4d08-82d5-32aa056fd7bf None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:26.113412 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09360777-7391-4d08-82d5-32aa056fd7bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:26.114075 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33b5a86-f877-4fd5-a18c-f94084245ef5 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:26.129983 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 794/1596] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:15:26 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:15:26.131033 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33b5a86-f877-4fd5-a18c-f94084245ef5 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:26.142235 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33b5a86-f877-4fd5-a18c-f94084245ef5 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:26.143135 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-09360777-7391-4d08-82d5-32aa056fd7bf None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:15:26.144747 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-09360777-7391-4d08-82d5-32aa056fd7bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:26.147022 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3588cf00-ad2a-4ade-b913-b0061dd9eb56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:26.147981 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3588cf00-ad2a-4ade-b913-b0061dd9eb56 admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:26.148333 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3588cf00-ad2a-4ade-b913-b0061dd9eb56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:26.148712 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3588cf00-ad2a-4ade-b913-b0061dd9eb56 admin admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:26.149626 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3588cf00-ad2a-4ade-b913-b0061dd9eb56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:26.151281 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3588cf00-ad2a-4ade-b913-b0061dd9eb56 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:26.160261 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 803/1597] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:15:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:15:26.161207 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09360777-7391-4d08-82d5-32aa056fd7bf None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:26.169156 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 795/1598] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:15:26 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:15:26.170195 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3588cf00-ad2a-4ade-b913-b0061dd9eb56 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:26.178346 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09360777-7391-4d08-82d5-32aa056fd7bf None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:26.181881 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3588cf00-ad2a-4ade-b913-b0061dd9eb56 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:26.185175 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0563ef-bcb5-410a-a02c-690b8aaa4990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:26.186330 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0563ef-bcb5-410a-a02c-690b8aaa4990 admin admin] REQUEST_METHOD: `PUT` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:26.186716 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0563ef-bcb5-410a-a02c-690b8aaa4990 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:26.187062 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0563ef-bcb5-410a-a02c-690b8aaa4990 admin admin] PATH_INFO: `/v3/projects/ad704701fcba49e5adc45e451291ef71/users/d766a95dfb444e6c95d1111d933cdd83/roles/5d79031a64754b57ba120367465e2252` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:26.190772 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f490cd29-7a97-49c8-9ba2-58402ef3ebfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:26.193607 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f490cd29-7a97-49c8-9ba2-58402ef3ebfc admin admin] REQUEST_METHOD: `PUT` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:26.195882 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f490cd29-7a97-49c8-9ba2-58402ef3ebfc admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:26.200093 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f490cd29-7a97-49c8-9ba2-58402ef3ebfc admin admin] PATH_INFO: `/v3/projects/cc9ab7163ff443ff849d017d40115708/users/8dd9d32c47014294a367654b57c96f3f/roles/5d79031a64754b57ba120367465e2252` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:26.220609 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0563ef-bcb5-410a-a02c-690b8aaa4990 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad704701fcba49e5adc45e451291ef71, user_id=d766a95dfb444e6c95d1111d933cdd83, role_id=5d79031a64754b57ba120367465e2252)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:26.225813 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0563ef-bcb5-410a-a02c-690b8aaa4990 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:26.234014 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f490cd29-7a97-49c8-9ba2-58402ef3ebfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc9ab7163ff443ff849d017d40115708, user_id=8dd9d32c47014294a367654b57c96f3f, role_id=5d79031a64754b57ba120367465e2252)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:26.238413 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f490cd29-7a97-49c8-9ba2-58402ef3ebfc admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:26.250231 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 804/1599] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:15:26 2022] PUT /identity/v3/projects/ad704701fcba49e5adc45e451291ef71/users/d766a95dfb444e6c95d1111d933cdd83/roles/5d79031a64754b57ba120367465e2252 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:15:26.251351 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0563ef-bcb5-410a-a02c-690b8aaa4990 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:26.268983 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 796/1600] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:15:26 2022] PUT /identity/v3/projects/cc9ab7163ff443ff849d017d40115708/users/8dd9d32c47014294a367654b57c96f3f/roles/5d79031a64754b57ba120367465e2252 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:15:26.270126 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f490cd29-7a97-49c8-9ba2-58402ef3ebfc admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:26.341454 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0563ef-bcb5-410a-a02c-690b8aaa4990 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:26.351289 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f490cd29-7a97-49c8-9ba2-58402ef3ebfc admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:26.355994 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba72574-06f7-48d6-92eb-8a518d51029f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:26.357087 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba72574-06f7-48d6-92eb-8a518d51029f admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:26.357359 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba72574-06f7-48d6-92eb-8a518d51029f admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:26.357625 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba72574-06f7-48d6-92eb-8a518d51029f admin admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:26.358403 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba72574-06f7-48d6-92eb-8a518d51029f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:26.360444 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba72574-06f7-48d6-92eb-8a518d51029f admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:26.371007 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 797/1601] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:15:26 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:15:26.371996 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba72574-06f7-48d6-92eb-8a518d51029f admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:26.382957 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba72574-06f7-48d6-92eb-8a518d51029f admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:26.390657 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36ea802-caa3-46fb-a4ba-b3c575b89c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:26.391563 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ea802-caa3-46fb-a4ba-b3c575b89c4e admin admin] REQUEST_METHOD: `PUT` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:26.392991 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ea802-caa3-46fb-a4ba-b3c575b89c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:26.393357 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ea802-caa3-46fb-a4ba-b3c575b89c4e admin admin] PATH_INFO: `/v3/projects/58f2d5fdc6ee44929783ecb547d70e4b/users/3b4ce27507804d57b07fa870f73d2705/roles/5d79031a64754b57ba120367465e2252` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:26.407505 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad95966-6751-46f4-ba2a-47ffa1ee9947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:26.408698 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad95966-6751-46f4-ba2a-47ffa1ee9947 admin admin] REQUEST_METHOD: `PUT` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:26.408820 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad95966-6751-46f4-ba2a-47ffa1ee9947 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:26.409035 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad95966-6751-46f4-ba2a-47ffa1ee9947 admin admin] PATH_INFO: `/v3/projects/afbd1074d9a0409c8e1514d4892949e8/users/7178083f96174a8ea8974df06c9eb009/roles/5d79031a64754b57ba120367465e2252` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:26.413875 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36ea802-caa3-46fb-a4ba-b3c575b89c4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=58f2d5fdc6ee44929783ecb547d70e4b, user_id=3b4ce27507804d57b07fa870f73d2705, role_id=5d79031a64754b57ba120367465e2252)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:26.417113 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36ea802-caa3-46fb-a4ba-b3c575b89c4e admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:26.436249 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad95966-6751-46f4-ba2a-47ffa1ee9947 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afbd1074d9a0409c8e1514d4892949e8, user_id=7178083f96174a8ea8974df06c9eb009, role_id=5d79031a64754b57ba120367465e2252)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:26.455373 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 798/1602] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:15:26 2022] PUT /identity/v3/projects/58f2d5fdc6ee44929783ecb547d70e4b/users/3b4ce27507804d57b07fa870f73d2705/roles/5d79031a64754b57ba120367465e2252 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:15:26.455373 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36ea802-caa3-46fb-a4ba-b3c575b89c4e admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:26.456394 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad95966-6751-46f4-ba2a-47ffa1ee9947 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:26.486679 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 805/1603] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:15:26 2022] PUT /identity/v3/projects/afbd1074d9a0409c8e1514d4892949e8/users/7178083f96174a8ea8974df06c9eb009/roles/5d79031a64754b57ba120367465e2252 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:15:26.488587 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad95966-6751-46f4-ba2a-47ffa1ee9947 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:26.554542 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36ea802-caa3-46fb-a4ba-b3c575b89c4e admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:26.589240 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad95966-6751-46f4-ba2a-47ffa1ee9947 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:26.595001 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e5ecee-caa9-41e4-93bb-2ae878c48767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:26.595693 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e5ecee-caa9-41e4-93bb-2ae878c48767 admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:26.596008 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e5ecee-caa9-41e4-93bb-2ae878c48767 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:26.596279 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e5ecee-caa9-41e4-93bb-2ae878c48767 admin admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:26.597297 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e5ecee-caa9-41e4-93bb-2ae878c48767 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:26.599550 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e5ecee-caa9-41e4-93bb-2ae878c48767 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:26.611229 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 806/1604] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:15:26 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:15:26.616132 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b278ac-dc87-425f-afe5-b93bf3c7d036 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:26.616329 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b278ac-dc87-425f-afe5-b93bf3c7d036 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:26.616604 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b278ac-dc87-425f-afe5-b93bf3c7d036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:26.619296 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd24d9ce-e6d4-4c88-8422-9d0daf639dd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3802cb341445f994b9204744060ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:26.620064 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd24d9ce-e6d4-4c88-8422-9d0daf639dd0 service neutron] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:26.620440 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd24d9ce-e6d4-4c88-8422-9d0daf639dd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:26.620754 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd24d9ce-e6d4-4c88-8422-9d0daf639dd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:26.632380 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd24d9ce-e6d4-4c88-8422-9d0daf639dd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:26.634402 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd24d9ce-e6d4-4c88-8422-9d0daf639dd0 service neutron] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:26.635148 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-90b278ac-dc87-425f-afe5-b93bf3c7d036 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:15:26.636381 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-90b278ac-dc87-425f-afe5-b93bf3c7d036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:26.646212 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 799/1605] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:15:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:15:26.647888 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7de0427-5bd2-4d59-af4d-c61cd1928587 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:26.648250 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7de0427-5bd2-4d59-af4d-c61cd1928587 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:26.648602 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7de0427-5bd2-4d59-af4d-c61cd1928587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:26.672470 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-a7de0427-5bd2-4d59-af4d-c61cd1928587 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:15:26.673884 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-a7de0427-5bd2-4d59-af4d-c61cd1928587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:26.674390 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 807/1606] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:15:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:15:26.675273 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b278ac-dc87-425f-afe5-b93bf3c7d036 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:26.686550 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 800/1607] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:15:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:15:26.687703 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0da368-c08d-4186-9d70-7d242debe7ca None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:26.688155 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0da368-c08d-4186-9d70-7d242debe7ca None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:26.688386 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0da368-c08d-4186-9d70-7d242debe7ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:26.692466 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b278ac-dc87-425f-afe5-b93bf3c7d036 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:26.698888 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff0443b-d6b3-4bc5-93e0-88d00ec2ad3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:26.699939 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff0443b-d6b3-4bc5-93e0-88d00ec2ad3f admin admin] REQUEST_METHOD: `PUT` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:26.700358 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff0443b-d6b3-4bc5-93e0-88d00ec2ad3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:26.700942 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff0443b-d6b3-4bc5-93e0-88d00ec2ad3f admin admin] PATH_INFO: `/v3/projects/728b95eba64247c6aab0736ea79dd7ac/users/b775cdb37e6f4afb97f1c230dc0c45db/roles/5d79031a64754b57ba120367465e2252` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:26.708282 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-2e0da368-c08d-4186-9d70-7d242debe7ca None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:15:26.709492 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-2e0da368-c08d-4186-9d70-7d242debe7ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:26.718132 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 801/1608] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:15:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:15:26.719839 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d40e502-ad6c-4c17-895c-d8ec9ff359e9 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:26.720318 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d40e502-ad6c-4c17-895c-d8ec9ff359e9 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:26.720626 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d40e502-ad6c-4c17-895c-d8ec9ff359e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:26.725541 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff0443b-d6b3-4bc5-93e0-88d00ec2ad3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=728b95eba64247c6aab0736ea79dd7ac, user_id=b775cdb37e6f4afb97f1c230dc0c45db, role_id=5d79031a64754b57ba120367465e2252)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:26.729606 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff0443b-d6b3-4bc5-93e0-88d00ec2ad3f admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:26.755553 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-0d40e502-ad6c-4c17-895c-d8ec9ff359e9 None None] MFA Rules not processed for user `7178083f96174a8ea8974df06c9eb009`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:15:26.755801 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 808/1609] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:15:26 2022] PUT /identity/v3/projects/728b95eba64247c6aab0736ea79dd7ac/users/b775cdb37e6f4afb97f1c230dc0c45db/roles/5d79031a64754b57ba120367465e2252 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:15:26.756636 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff0443b-d6b3-4bc5-93e0-88d00ec2ad3f admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:26.760161 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-0d40e502-ad6c-4c17-895c-d8ec9ff359e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:26.830625 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff0443b-d6b3-4bc5-93e0-88d00ec2ad3f admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:26.835831 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e145c4c-e2d2-43a3-ba7b-34f273682457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:26.836746 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e145c4c-e2d2-43a3-ba7b-34f273682457 admin admin] REQUEST_METHOD: `PUT` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:26.837159 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e145c4c-e2d2-43a3-ba7b-34f273682457 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:26.838254 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e145c4c-e2d2-43a3-ba7b-34f273682457 admin admin] PATH_INFO: `/v3/projects/3ceb7221fd424b1ebdcaaa1c3e5b52b8/users/f691894ac05541969f0b4cb434e0aa06/roles/5d79031a64754b57ba120367465e2252` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:26.845952 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 802/1610] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:15:26 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:15:26.845952 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d40e502-ad6c-4c17-895c-d8ec9ff359e9 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:26.857610 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e145c4c-e2d2-43a3-ba7b-34f273682457 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ceb7221fd424b1ebdcaaa1c3e5b52b8, user_id=f691894ac05541969f0b4cb434e0aa06, role_id=5d79031a64754b57ba120367465e2252)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:26.862029 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e145c4c-e2d2-43a3-ba7b-34f273682457 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:26.892284 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 809/1611] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:15:26 2022] PUT /identity/v3/projects/3ceb7221fd424b1ebdcaaa1c3e5b52b8/users/f691894ac05541969f0b4cb434e0aa06/roles/5d79031a64754b57ba120367465e2252 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:15:26.892284 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e145c4c-e2d2-43a3-ba7b-34f273682457 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:26.918043 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d40e502-ad6c-4c17-895c-d8ec9ff359e9 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:26.972631 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e145c4c-e2d2-43a3-ba7b-34f273682457 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:26.977267 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3215d8cf-1b1b-46e4-8458-03c322df8900 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3802cb341445f994b9204744060ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:26.978610 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3215d8cf-1b1b-46e4-8458-03c322df8900 service neutron] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:26.979637 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3215d8cf-1b1b-46e4-8458-03c322df8900 service neutron] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:26.980196 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3215d8cf-1b1b-46e4-8458-03c322df8900 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:26.984055 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ad8650-5408-4d9b-8f1f-026f07fb454b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3802cb341445f994b9204744060ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:26.985335 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad8650-5408-4d9b-8f1f-026f07fb454b service neutron] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:26.985965 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad8650-5408-4d9b-8f1f-026f07fb454b service neutron] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:26.986302 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad8650-5408-4d9b-8f1f-026f07fb454b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:27.079724 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3215d8cf-1b1b-46e4-8458-03c322df8900 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:27.081682 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3215d8cf-1b1b-46e4-8458-03c322df8900 service neutron] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:27.095150 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 810/1612] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:15:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:15:27.096325 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3215d8cf-1b1b-46e4-8458-03c322df8900 service neutron] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:27.106477 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ad8650-5408-4d9b-8f1f-026f07fb454b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:27.108380 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ad8650-5408-4d9b-8f1f-026f07fb454b service neutron] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:27.109243 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3215d8cf-1b1b-46e4-8458-03c322df8900 service neutron] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:27.113376 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868859bc-1c8a-43a1-8543-4d2a52a9a620 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3802cb341445f994b9204744060ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:27.114256 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868859bc-1c8a-43a1-8543-4d2a52a9a620 service neutron] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:27.114681 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868859bc-1c8a-43a1-8543-4d2a52a9a620 service neutron] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:27.115102 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868859bc-1c8a-43a1-8543-4d2a52a9a620 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:27.130030 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868859bc-1c8a-43a1-8543-4d2a52a9a620 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:27.133450 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868859bc-1c8a-43a1-8543-4d2a52a9a620 service neutron] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:27.135465 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 803/1613] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:15:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:15:27.140230 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f38f44-1a0e-4bd9-ac5c-dfbfb1849117 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:27.140974 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f38f44-1a0e-4bd9-ac5c-dfbfb1849117 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:27.141994 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f38f44-1a0e-4bd9-ac5c-dfbfb1849117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:27.162684 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 811/1614] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:15:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:15:27.163649 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868859bc-1c8a-43a1-8543-4d2a52a9a620 service neutron] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:27.190072 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868859bc-1c8a-43a1-8543-4d2a52a9a620 service neutron] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:27.214776 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6a192d-594e-4e61-aea5-82611e8fe457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:27.215536 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a192d-594e-4e61-aea5-82611e8fe457 admin admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:27.215902 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a192d-594e-4e61-aea5-82611e8fe457 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:27.216584 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a192d-594e-4e61-aea5-82611e8fe457 admin admin] PATH_INFO: `/v3/projects` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:27.217198 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6a192d-594e-4e61-aea5-82611e8fe457 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:27.220088 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-c5f38f44-1a0e-4bd9-ac5c-dfbfb1849117 None None] MFA Rules not processed for user `b775cdb37e6f4afb97f1c230dc0c45db`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:15:27.221819 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-c5f38f44-1a0e-4bd9-ac5c-dfbfb1849117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:27.225252 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6a192d-594e-4e61-aea5-82611e8fe457 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:27.288663 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 812/1615] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Mar 30 07:15:27 2022] POST /identity/v3/projects => generated 401 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:15:27.293964 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd1589a-2b41-4c5f-8071-8f5ce490214b None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:27.294300 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd1589a-2b41-4c5f-8071-8f5ce490214b None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:27.297176 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd1589a-2b41-4c5f-8071-8f5ce490214b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:27.376590 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-5bd1589a-2b41-4c5f-8071-8f5ce490214b None None] MFA Rules not processed for user `f691894ac05541969f0b4cb434e0aa06`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:15:27.376590 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-5bd1589a-2b41-4c5f-8071-8f5ce490214b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:27.411619 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 804/1616] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:15:27 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:15:27.413887 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f38f44-1a0e-4bd9-ac5c-dfbfb1849117 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:27.435034 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f38f44-1a0e-4bd9-ac5c-dfbfb1849117 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:27.545367 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 813/1617] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:15:27 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:15:27.547081 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd1589a-2b41-4c5f-8071-8f5ce490214b None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:27.575754 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6ede8b-bf47-42e9-bafe-1d0813983211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:27.576628 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6ede8b-bf47-42e9-bafe-1d0813983211 admin admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:27.576886 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6ede8b-bf47-42e9-bafe-1d0813983211 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:27.582643 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6ede8b-bf47-42e9-bafe-1d0813983211 admin admin] PATH_INFO: `/v3/users` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:27.585166 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6ede8b-bf47-42e9-bafe-1d0813983211 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:27.592417 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6ede8b-bf47-42e9-bafe-1d0813983211 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:27.648564 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 805/1618] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Mar 30 07:15:27 2022] POST /identity/v3/users => generated 307 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:15:27.654220 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6ede8b-bf47-42e9-bafe-1d0813983211 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:27.654912 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd1589a-2b41-4c5f-8071-8f5ce490214b None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:27.662687 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5570c32f-bf86-4734-b92d-c54802730742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:27.663695 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5570c32f-bf86-4734-b92d-c54802730742 admin admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:27.664247 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5570c32f-bf86-4734-b92d-c54802730742 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:27.675900 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5570c32f-bf86-4734-b92d-c54802730742 admin admin] PATH_INFO: `/v3/projects` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:27.681955 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5570c32f-bf86-4734-b92d-c54802730742 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:27.684698 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5570c32f-bf86-4734-b92d-c54802730742 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:27.739757 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 814/1619] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Mar 30 07:15:27 2022] POST /identity/v3/projects => generated 371 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:15:27.741528 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5570c32f-bf86-4734-b92d-c54802730742 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:27.757340 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6ede8b-bf47-42e9-bafe-1d0813983211 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:27.838451 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5570c32f-bf86-4734-b92d-c54802730742 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:27.854341 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364d8091-db0b-4acc-8039-5196ac05870f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e2fda180e8d448d895c40cdad34bc4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:27.855126 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a6eab7-0359-4502-a96a-76d966c3de1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:27.856113 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364d8091-db0b-4acc-8039-5196ac05870f service cinder] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:27.856568 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a6eab7-0359-4502-a96a-76d966c3de1f admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:27.857111 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364d8091-db0b-4acc-8039-5196ac05870f service cinder] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:27.857526 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364d8091-db0b-4acc-8039-5196ac05870f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:27.857937 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a6eab7-0359-4502-a96a-76d966c3de1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:27.858424 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a6eab7-0359-4502-a96a-76d966c3de1f admin admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:27.859359 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a6eab7-0359-4502-a96a-76d966c3de1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:27.862298 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a6eab7-0359-4502-a96a-76d966c3de1f admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:27.882712 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 815/1620] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:15:27 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:15:27.884143 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a6eab7-0359-4502-a96a-76d966c3de1f admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:27.903443 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a6eab7-0359-4502-a96a-76d966c3de1f admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:27.915353 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872bbbcc-6ac4-412d-b45a-aa24b2a0e79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:27.922007 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872bbbcc-6ac4-412d-b45a-aa24b2a0e79b admin admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:27.922555 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872bbbcc-6ac4-412d-b45a-aa24b2a0e79b admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:27.922988 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872bbbcc-6ac4-412d-b45a-aa24b2a0e79b admin admin] PATH_INFO: `/v3/users` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:27.924371 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872bbbcc-6ac4-412d-b45a-aa24b2a0e79b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:27.928733 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872bbbcc-6ac4-412d-b45a-aa24b2a0e79b admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:27.954834 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 816/1621] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Mar 30 07:15:27 2022] POST /identity/v3/users => generated 292 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:15:27.958781 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872bbbcc-6ac4-412d-b45a-aa24b2a0e79b admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:27.988284 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364d8091-db0b-4acc-8039-5196ac05870f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:27.990799 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364d8091-db0b-4acc-8039-5196ac05870f service cinder] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:27.994841 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872bbbcc-6ac4-412d-b45a-aa24b2a0e79b admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:28.005057 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 806/1622] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:15:27 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:15:28.005303 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19da7f6-0dd3-41e1-881b-18dae7575aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:28.006553 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19da7f6-0dd3-41e1-881b-18dae7575aad admin admin] REQUEST_METHOD: `PUT` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:28.006746 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19da7f6-0dd3-41e1-881b-18dae7575aad admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:28.006904 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19da7f6-0dd3-41e1-881b-18dae7575aad admin admin] PATH_INFO: `/v3/projects/10a7773629d047fbb32eae9dae147348/users/97ec68175599448997bd093bcdc3f95b/roles/1c39b9ab8cfd4c0ea71845831920a845` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:28.007971 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364d8091-db0b-4acc-8039-5196ac05870f service cinder] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:28.027068 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364d8091-db0b-4acc-8039-5196ac05870f service cinder] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:28.040261 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf869c2b-3bae-4a14-8307-01268434b111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:28.042284 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf869c2b-3bae-4a14-8307-01268434b111 admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:28.043930 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf869c2b-3bae-4a14-8307-01268434b111 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:28.044233 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf869c2b-3bae-4a14-8307-01268434b111 admin admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:28.045276 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf869c2b-3bae-4a14-8307-01268434b111 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:28.046901 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf869c2b-3bae-4a14-8307-01268434b111 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:28.048444 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19da7f6-0dd3-41e1-881b-18dae7575aad admin admin] RBAC: Authorizing `identity:create_grant(project_id=10a7773629d047fbb32eae9dae147348, user_id=97ec68175599448997bd093bcdc3f95b, role_id=1c39b9ab8cfd4c0ea71845831920a845)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:28.070692 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19da7f6-0dd3-41e1-881b-18dae7575aad admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:28.077564 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 807/1623] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:15:28 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:15:28.081859 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf869c2b-3bae-4a14-8307-01268434b111 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:28.103560 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf869c2b-3bae-4a14-8307-01268434b111 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:28.104246 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 817/1624] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:15:27 2022] PUT /identity/v3/projects/10a7773629d047fbb32eae9dae147348/users/97ec68175599448997bd093bcdc3f95b/roles/1c39b9ab8cfd4c0ea71845831920a845 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:15:28.109212 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19da7f6-0dd3-41e1-881b-18dae7575aad admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:28.213715 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2263481f-3840-4d34-9b75-c9b9b44ee44c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:28.214619 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2263481f-3840-4d34-9b75-c9b9b44ee44c admin admin] REQUEST_METHOD: `PUT` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:28.214913 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2263481f-3840-4d34-9b75-c9b9b44ee44c admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:28.215230 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2263481f-3840-4d34-9b75-c9b9b44ee44c admin admin] PATH_INFO: `/v3/projects/3feed9d8e2d842c6b67d2f4b780ce3e8/users/36b949ab7fb344b69d978b137fec134e/roles/1c39b9ab8cfd4c0ea71845831920a845` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:28.259601 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2263481f-3840-4d34-9b75-c9b9b44ee44c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3feed9d8e2d842c6b67d2f4b780ce3e8, user_id=36b949ab7fb344b69d978b137fec134e, role_id=1c39b9ab8cfd4c0ea71845831920a845)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:28.263969 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2263481f-3840-4d34-9b75-c9b9b44ee44c admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:28.280370 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19da7f6-0dd3-41e1-881b-18dae7575aad admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:28.289878 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859b4c8b-22c9-45d8-89d2-d66bbf094ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:28.290667 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859b4c8b-22c9-45d8-89d2-d66bbf094ef1 admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:28.290952 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859b4c8b-22c9-45d8-89d2-d66bbf094ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:28.291271 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859b4c8b-22c9-45d8-89d2-d66bbf094ef1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:28.292314 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859b4c8b-22c9-45d8-89d2-d66bbf094ef1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:28.293374 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 808/1625] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:15:28 2022] PUT /identity/v3/projects/3feed9d8e2d842c6b67d2f4b780ce3e8/users/36b949ab7fb344b69d978b137fec134e/roles/1c39b9ab8cfd4c0ea71845831920a845 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 07:15:28.297851 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2263481f-3840-4d34-9b75-c9b9b44ee44c admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:28.298051 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859b4c8b-22c9-45d8-89d2-d66bbf094ef1 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:28.311932 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 818/1626] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:15:28 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:15:28.324334 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859b4c8b-22c9-45d8-89d2-d66bbf094ef1 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:28.342599 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859b4c8b-22c9-45d8-89d2-d66bbf094ef1 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:28.446435 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2263481f-3840-4d34-9b75-c9b9b44ee44c admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:28.456652 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88486a79-d046-40b0-ba5b-a3f5b37ec108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:28.457572 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88486a79-d046-40b0-ba5b-a3f5b37ec108 admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:28.458176 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88486a79-d046-40b0-ba5b-a3f5b37ec108 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:28.458663 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88486a79-d046-40b0-ba5b-a3f5b37ec108 admin admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:28.460124 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88486a79-d046-40b0-ba5b-a3f5b37ec108 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:28.462748 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88486a79-d046-40b0-ba5b-a3f5b37ec108 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:28.475350 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993e947b-0f3f-455f-b70f-12097110b704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:28.476293 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e947b-0f3f-455f-b70f-12097110b704 admin admin] REQUEST_METHOD: `PUT` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:28.476616 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e947b-0f3f-455f-b70f-12097110b704 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:28.476902 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e947b-0f3f-455f-b70f-12097110b704 admin admin] PATH_INFO: `/v3/projects/10a7773629d047fbb32eae9dae147348/users/97ec68175599448997bd093bcdc3f95b/roles/1c39b9ab8cfd4c0ea71845831920a845` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:28.483743 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 809/1627] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:15:28 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 30 07:15:28.484827 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993e947b-0f3f-455f-b70f-12097110b704 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10a7773629d047fbb32eae9dae147348, user_id=97ec68175599448997bd093bcdc3f95b, role_id=1c39b9ab8cfd4c0ea71845831920a845)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:28.486324 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88486a79-d046-40b0-ba5b-a3f5b37ec108 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:28.492978 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993e947b-0f3f-455f-b70f-12097110b704 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:28.509052 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88486a79-d046-40b0-ba5b-a3f5b37ec108 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:28.527924 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 819/1628] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:15:28 2022] PUT /identity/v3/projects/10a7773629d047fbb32eae9dae147348/users/97ec68175599448997bd093bcdc3f95b/roles/1c39b9ab8cfd4c0ea71845831920a845 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:15:28.541230 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4a26e8-5938-45b3-99aa-28ebff6f341a None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:28.541880 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4a26e8-5938-45b3-99aa-28ebff6f341a None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:28.542408 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4a26e8-5938-45b3-99aa-28ebff6f341a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:28.579991 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-4f4a26e8-5938-45b3-99aa-28ebff6f341a None None] MFA Rules not processed for user `97ec68175599448997bd093bcdc3f95b`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:15:28.581644 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-4f4a26e8-5938-45b3-99aa-28ebff6f341a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:28.655488 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d57ef4-07c4-49f8-9538-f28ce6b9e4fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:28.656451 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d57ef4-07c4-49f8-9538-f28ce6b9e4fd admin admin] REQUEST_METHOD: `PUT` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:28.656742 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d57ef4-07c4-49f8-9538-f28ce6b9e4fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:28.656995 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d57ef4-07c4-49f8-9538-f28ce6b9e4fd admin admin] PATH_INFO: `/v3/projects/3feed9d8e2d842c6b67d2f4b780ce3e8/users/36b949ab7fb344b69d978b137fec134e/roles/1c39b9ab8cfd4c0ea71845831920a845` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:28.659164 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d57ef4-07c4-49f8-9538-f28ce6b9e4fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=3feed9d8e2d842c6b67d2f4b780ce3e8, user_id=36b949ab7fb344b69d978b137fec134e, role_id=1c39b9ab8cfd4c0ea71845831920a845)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:28.661815 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d57ef4-07c4-49f8-9538-f28ce6b9e4fd admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:28.676820 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 810/1629] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:15:28 2022] PUT /identity/v3/projects/3feed9d8e2d842c6b67d2f4b780ce3e8/users/36b949ab7fb344b69d978b137fec134e/roles/1c39b9ab8cfd4c0ea71845831920a845 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:15:28.687842 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec4d37-4c34-478f-8ff1-db4556d04d80 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:28.688364 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec4d37-4c34-478f-8ff1-db4556d04d80 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:28.688712 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec4d37-4c34-478f-8ff1-db4556d04d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:28.727185 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 820/1630] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:15:28 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:15:28.741468 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4a26e8-5938-45b3-99aa-28ebff6f341a None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:28.745873 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-5cec4d37-4c34-478f-8ff1-db4556d04d80 None None] MFA Rules not processed for user `36b949ab7fb344b69d978b137fec134e`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:15:28.748197 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-5cec4d37-4c34-478f-8ff1-db4556d04d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:28.836992 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 811/1631] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:15:28 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 07:15:28.906397 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cec4d37-4c34-478f-8ff1-db4556d04d80 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:28.918268 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4a26e8-5938-45b3-99aa-28ebff6f341a None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:28.991768 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cec4d37-4c34-478f-8ff1-db4556d04d80 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:28.999431 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a89e57-e807-497b-a67c-0dab3d468f6a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e2fda180e8d448d895c40cdad34bc4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:29.001547 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a89e57-e807-497b-a67c-0dab3d468f6a service cinder] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:29.002566 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a89e57-e807-497b-a67c-0dab3d468f6a service cinder] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:29.002566 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a89e57-e807-497b-a67c-0dab3d468f6a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:29.023976 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a89e57-e807-497b-a67c-0dab3d468f6a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:29.026271 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a89e57-e807-497b-a67c-0dab3d468f6a service cinder] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:29.034063 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f44de1-7dc6-4a35-a005-a58662359eb1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e2fda180e8d448d895c40cdad34bc4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:29.034757 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f44de1-7dc6-4a35-a005-a58662359eb1 service cinder] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:29.035036 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f44de1-7dc6-4a35-a005-a58662359eb1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:29.035311 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f44de1-7dc6-4a35-a005-a58662359eb1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:29.059124 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 812/1632] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:15:28 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:15:29.172550 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f44de1-7dc6-4a35-a005-a58662359eb1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:29.174024 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f44de1-7dc6-4a35-a005-a58662359eb1 service cinder] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:29.196936 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 821/1633] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:15:28 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 30 07:15:29.215752 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a89e57-e807-497b-a67c-0dab3d468f6a service cinder] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:29.226595 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a89e57-e807-497b-a67c-0dab3d468f6a service cinder] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:29.242513 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7aed1a-0d93-405c-a744-a01ebe39d01a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e2fda180e8d448d895c40cdad34bc4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:29.244495 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7aed1a-0d93-405c-a744-a01ebe39d01a service cinder] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:29.244778 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7aed1a-0d93-405c-a744-a01ebe39d01a service cinder] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:29.245258 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7aed1a-0d93-405c-a744-a01ebe39d01a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:29.385448 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7aed1a-0d93-405c-a744-a01ebe39d01a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:29.388179 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7aed1a-0d93-405c-a744-a01ebe39d01a service cinder] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:29.404087 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 813/1634] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:15:29 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:15:29.553820 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f44de1-7dc6-4a35-a005-a58662359eb1 service cinder] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:29.727180 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f44de1-7dc6-4a35-a005-a58662359eb1 service cinder] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:29.740933 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadb4fcc-3680-4b8c-a671-a4820831b719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:29.743765 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb4fcc-3680-4b8c-a671-a4820831b719 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:29.744004 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb4fcc-3680-4b8c-a671-a4820831b719 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:29.744371 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb4fcc-3680-4b8c-a671-a4820831b719 admin admin] PATH_INFO: `/v3/users/7178083f96174a8ea8974df06c9eb009` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:29.749550 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadb4fcc-3680-4b8c-a671-a4820831b719 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7178083f96174a8ea8974df06c9eb009)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:29.753427 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: WARNING py.warnings [None req-fadb4fcc-3680-4b8c-a671-a4820831b719 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 30 07:15:29.753427 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: warnings.warn(msg) Mar 30 07:15:29.753427 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: Mar 30 07:15:29.761001 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadb4fcc-3680-4b8c-a671-a4820831b719 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:29.930357 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-fadb4fcc-3680-4b8c-a671-a4820831b719 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7178083f96174a8ea8974df06c9eb009'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:15:29.932393 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-fadb4fcc-3680-4b8c-a671-a4820831b719 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7178083f96174a8ea8974df06c9eb009'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:15:29.957400 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-fadb4fcc-3680-4b8c-a671-a4820831b719 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7178083f96174a8ea8974df06c9eb009'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:15:30.034752 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-fadb4fcc-3680-4b8c-a671-a4820831b719 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7178083f96174a8ea8974df06c9eb009'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:15:30.035574 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-fadb4fcc-3680-4b8c-a671-a4820831b719 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7178083f96174a8ea8974df06c9eb009'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:15:30.057663 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 822/1635] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Mar 30 07:15:29 2022] DELETE /identity/v3/users/7178083f96174a8ea8974df06c9eb009 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:15:30.059628 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc2c4ee-2994-4102-819c-b4b282deeed7 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:30.060172 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc2c4ee-2994-4102-819c-b4b282deeed7 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:30.060284 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc2c4ee-2994-4102-819c-b4b282deeed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:30.075699 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a2ded-1969-48f3-a491-6c0e7dcb152f None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:30.075844 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a2ded-1969-48f3-a491-6c0e7dcb152f None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:30.076149 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a2ded-1969-48f3-a491-6c0e7dcb152f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:30.089119 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-2cc2c4ee-2994-4102-819c-b4b282deeed7 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:15:30.093435 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-2cc2c4ee-2994-4102-819c-b4b282deeed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:30.127596 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-6f7a2ded-1969-48f3-a491-6c0e7dcb152f None None] MFA Rules not processed for user `d766a95dfb444e6c95d1111d933cdd83`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:15:30.129076 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-6f7a2ded-1969-48f3-a491-6c0e7dcb152f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:30.195416 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 814/1636] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:15:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:15:30.229959 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc2c4ee-2994-4102-819c-b4b282deeed7 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:30.232927 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-2cc2c4ee-2994-4102-819c-b4b282deeed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:30.286244 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 823/1637] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:15:30 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:15:30.288418 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a7fd05-c218-4b82-b8b6-ee3fd65d88ef None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:30.288583 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a7fd05-c218-4b82-b8b6-ee3fd65d88ef None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:30.289103 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a7fd05-c218-4b82-b8b6-ee3fd65d88ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:30.327186 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-24a7fd05-c218-4b82-b8b6-ee3fd65d88ef None None] MFA Rules not processed for user `d766a95dfb444e6c95d1111d933cdd83`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:15:30.330312 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-24a7fd05-c218-4b82-b8b6-ee3fd65d88ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:30.351258 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc2c4ee-2994-4102-819c-b4b282deeed7 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:30.355963 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 824/1638] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:15:30 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:15:30.367958 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5649b52-fcda-4b30-80c0-77e43d1e77eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3802cb341445f994b9204744060ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:30.371470 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5649b52-fcda-4b30-80c0-77e43d1e77eb service neutron] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:30.373592 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5649b52-fcda-4b30-80c0-77e43d1e77eb service neutron] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:30.374088 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5649b52-fcda-4b30-80c0-77e43d1e77eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:30.379443 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d526019-cbcf-4c5b-9e7d-24af33a0aaeb None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:30.379906 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d526019-cbcf-4c5b-9e7d-24af33a0aaeb None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:30.380263 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d526019-cbcf-4c5b-9e7d-24af33a0aaeb None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:30.383158 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 825/1639] 10.222.0.20 () {54 vars in 960 bytes} [Wed Mar 30 07:15:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 30 07:15:30.389569 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f153c696-246e-4c01-92a8-b73424b8ce95 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:30.389992 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f153c696-246e-4c01-92a8-b73424b8ce95 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:30.390484 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f153c696-246e-4c01-92a8-b73424b8ce95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:30.396662 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5649b52-fcda-4b30-80c0-77e43d1e77eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:30.399472 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5649b52-fcda-4b30-80c0-77e43d1e77eb service neutron] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:30.426612 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 815/1640] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:15:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 30 07:15:30.452685 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-f153c696-246e-4c01-92a8-b73424b8ce95 None None] MFA Rules not processed for user `72b398c5ed14484d8b7a51fee900597b`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:15:30.469907 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-f153c696-246e-4c01-92a8-b73424b8ce95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:30.629809 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 826/1641] 10.222.0.20 () {58 vars in 1057 bytes} [Wed Mar 30 07:15:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:15:30.638330 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5649b52-fcda-4b30-80c0-77e43d1e77eb service neutron] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:30.655771 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5649b52-fcda-4b30-80c0-77e43d1e77eb service neutron] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:30.671079 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1e1908-5d93-4fa9-b4f4-fa7bebbc207b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72b398c5ed14484d8b7a51fee900597b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:30.672141 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1e1908-5d93-4fa9-b4f4-fa7bebbc207b service nova] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:30.672665 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1e1908-5d93-4fa9-b4f4-fa7bebbc207b service nova] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:30.673167 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1e1908-5d93-4fa9-b4f4-fa7bebbc207b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:30.693937 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1e1908-5d93-4fa9-b4f4-fa7bebbc207b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:30.698836 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1e1908-5d93-4fa9-b4f4-fa7bebbc207b service nova] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:30.711428 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 816/1642] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:15:30 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:15:31.455843 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37614e72-66ff-4c8e-973d-cd1f0b9d8e53 None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:31.455843 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37614e72-66ff-4c8e-973d-cd1f0b9d8e53 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:31.456433 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37614e72-66ff-4c8e-973d-cd1f0b9d8e53 None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:31.458592 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 827/1643] 10.222.0.20 () {54 vars in 912 bytes} [Wed Mar 30 07:15:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:15:31.486068 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae49b5f-92d0-410c-a9f9-02f25e61ed53 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:31.486607 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae49b5f-92d0-410c-a9f9-02f25e61ed53 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:31.486822 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae49b5f-92d0-410c-a9f9-02f25e61ed53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:31.567494 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-cae49b5f-92d0-410c-a9f9-02f25e61ed53 None None] MFA Rules not processed for user `72b398c5ed14484d8b7a51fee900597b`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:15:31.572800 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-cae49b5f-92d0-410c-a9f9-02f25e61ed53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:31.607614 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 817/1644] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Mar 30 07:15:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:15:31.637929 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37614e72-66ff-4c8e-973d-cd1f0b9d8e53 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:31.639937 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-37614e72-66ff-4c8e-973d-cd1f0b9d8e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:31.846150 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37614e72-66ff-4c8e-973d-cd1f0b9d8e53 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:31.859120 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a392ed-98b9-4f2c-b839-ebd562169020 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e880ade912f3412abf44ba73939d6e50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:31.859673 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a392ed-98b9-4f2c-b839-ebd562169020 service glance] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:31.859993 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a392ed-98b9-4f2c-b839-ebd562169020 service glance] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:31.860270 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a392ed-98b9-4f2c-b839-ebd562169020 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:31.874057 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be3347c-2378-44bb-8b1d-d6330478c1c4 None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:31.874335 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be3347c-2378-44bb-8b1d-d6330478c1c4 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:31.874607 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be3347c-2378-44bb-8b1d-d6330478c1c4 None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:31.876272 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a392ed-98b9-4f2c-b839-ebd562169020 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:31.876727 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 818/1645] 10.222.0.20 () {54 vars in 960 bytes} [Wed Mar 30 07:15:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 30 07:15:31.877737 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a392ed-98b9-4f2c-b839-ebd562169020 service glance] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:31.889464 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe06abc4-ac9d-4250-af03-898bdd2e3297 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:31.889677 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe06abc4-ac9d-4250-af03-898bdd2e3297 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:31.889863 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe06abc4-ac9d-4250-af03-898bdd2e3297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:31.896045 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 828/1646] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:15:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:15:31.924956 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-fe06abc4-ac9d-4250-af03-898bdd2e3297 None None] MFA Rules not processed for user `72b398c5ed14484d8b7a51fee900597b`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:15:31.926253 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-fe06abc4-ac9d-4250-af03-898bdd2e3297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:31.946967 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 819/1647] 10.222.0.20 () {58 vars in 1057 bytes} [Wed Mar 30 07:15:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:15:31.964734 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21167402-4620-4078-b5f6-945e368fcb9d None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:31.964996 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21167402-4620-4078-b5f6-945e368fcb9d None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:31.965345 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21167402-4620-4078-b5f6-945e368fcb9d None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:31.968195 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 829/1648] 10.222.0.20 () {54 vars in 912 bytes} [Wed Mar 30 07:15:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:15:31.983735 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5f9b6e-2005-45b0-9661-ad40a9ca9bc3 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:31.984139 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5f9b6e-2005-45b0-9661-ad40a9ca9bc3 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:31.984541 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5f9b6e-2005-45b0-9661-ad40a9ca9bc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:32.020463 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-2a5f9b6e-2005-45b0-9661-ad40a9ca9bc3 None None] MFA Rules not processed for user `72b398c5ed14484d8b7a51fee900597b`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:15:32.021829 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-2a5f9b6e-2005-45b0-9661-ad40a9ca9bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:32.035360 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 820/1649] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Mar 30 07:15:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:15:32.051345 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21167402-4620-4078-b5f6-945e368fcb9d None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:32.053815 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-21167402-4620-4078-b5f6-945e368fcb9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:32.149146 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b625227-caeb-4c40-89b6-f921276c5dfa None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:32.149569 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b625227-caeb-4c40-89b6-f921276c5dfa None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:32.149940 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b625227-caeb-4c40-89b6-f921276c5dfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:32.185492 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21167402-4620-4078-b5f6-945e368fcb9d None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:32.197848 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff05f36-56f4-4d6c-b40d-f11562c66987 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e2fda180e8d448d895c40cdad34bc4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:32.197848 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff05f36-56f4-4d6c-b40d-f11562c66987 service cinder] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:32.197848 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff05f36-56f4-4d6c-b40d-f11562c66987 service cinder] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:32.197848 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff05f36-56f4-4d6c-b40d-f11562c66987 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:32.224836 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff05f36-56f4-4d6c-b40d-f11562c66987 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:32.226320 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff05f36-56f4-4d6c-b40d-f11562c66987 service cinder] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:32.240118 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-3b625227-caeb-4c40-89b6-f921276c5dfa None None] MFA Rules not processed for user `3b4ce27507804d57b07fa870f73d2705`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:15:32.241619 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-3b625227-caeb-4c40-89b6-f921276c5dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:32.257107 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 830/1650] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:15:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:15:32.455616 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 821/1651] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:15:32 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:15:32.459946 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff05f36-56f4-4d6c-b40d-f11562c66987 service cinder] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:32.461939 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-9ff05f36-56f4-4d6c-b40d-f11562c66987 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:32.486957 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff05f36-56f4-4d6c-b40d-f11562c66987 service cinder] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:32.500368 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad4137f-83d2-4dc5-955e-a19f4eb53cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:32.501065 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad4137f-83d2-4dc5-955e-a19f4eb53cac admin admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:32.501370 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad4137f-83d2-4dc5-955e-a19f4eb53cac admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:32.501649 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad4137f-83d2-4dc5-955e-a19f4eb53cac admin admin] PATH_INFO: `/v3/projects` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:32.502369 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad4137f-83d2-4dc5-955e-a19f4eb53cac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:32.504561 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad4137f-83d2-4dc5-955e-a19f4eb53cac admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:32.564069 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 831/1652] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Mar 30 07:15:32 2022] POST /identity/v3/projects => generated 403 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:15:32.565180 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b625227-caeb-4c40-89b6-f921276c5dfa None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:32.597337 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b625227-caeb-4c40-89b6-f921276c5dfa None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:32.797960 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28626a24-8b95-40b6-a7a2-3167a6593b92 None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:32.798251 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28626a24-8b95-40b6-a7a2-3167a6593b92 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:32.798532 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28626a24-8b95-40b6-a7a2-3167a6593b92 None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:32.800632 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 832/1653] 10.222.0.20 () {54 vars in 912 bytes} [Wed Mar 30 07:15:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 30 07:15:32.807453 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da0587-bc17-4507-8724-d19d02092195 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:32.807743 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da0587-bc17-4507-8724-d19d02092195 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:32.808046 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da0587-bc17-4507-8724-d19d02092195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:32.922807 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505f5330-06f7-401e-865e-42ad425e11e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:32.926128 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505f5330-06f7-401e-865e-42ad425e11e1 admin admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:32.928801 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505f5330-06f7-401e-865e-42ad425e11e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:32.929220 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505f5330-06f7-401e-865e-42ad425e11e1 admin admin] PATH_INFO: `/v3/users` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:32.929814 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505f5330-06f7-401e-865e-42ad425e11e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:32.954790 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505f5330-06f7-401e-865e-42ad425e11e1 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:32.979987 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-95da0587-bc17-4507-8724-d19d02092195 None None] MFA Rules not processed for user `54f3802cb341445f994b9204744060ae`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:15:32.985713 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-95da0587-bc17-4507-8724-d19d02092195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:33.019832 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 822/1654] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Mar 30 07:15:32 2022] POST /identity/v3/users => generated 308 bytes in 451 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:15:33.021048 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505f5330-06f7-401e-865e-42ad425e11e1 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:33.038755 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505f5330-06f7-401e-865e-42ad425e11e1 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:33.058699 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c5082d-a525-4bc3-80e6-e2ea22542758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:33.061800 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c5082d-a525-4bc3-80e6-e2ea22542758 admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:33.062715 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c5082d-a525-4bc3-80e6-e2ea22542758 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:33.063153 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c5082d-a525-4bc3-80e6-e2ea22542758 admin admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:33.065174 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c5082d-a525-4bc3-80e6-e2ea22542758 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:33.071838 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c5082d-a525-4bc3-80e6-e2ea22542758 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:33.110162 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 823/1655] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:15:33 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:15:33.112084 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c5082d-a525-4bc3-80e6-e2ea22542758 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:33.125743 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c5082d-a525-4bc3-80e6-e2ea22542758 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:33.134350 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad98b640-9057-4c2d-b999-014712711389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:33.137760 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad98b640-9057-4c2d-b999-014712711389 admin admin] REQUEST_METHOD: `PUT` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:33.138535 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad98b640-9057-4c2d-b999-014712711389 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:33.138958 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad98b640-9057-4c2d-b999-014712711389 admin admin] PATH_INFO: `/v3/projects/ce1ca3b4248a49ae8b6b2405d3aeb82d/users/f31f06ffbb8b48318ce55bd7ffa809e2/roles/1c39b9ab8cfd4c0ea71845831920a845` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:33.151527 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 833/1656] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Mar 30 07:15:32 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 07:15:33.175499 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad98b640-9057-4c2d-b999-014712711389 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce1ca3b4248a49ae8b6b2405d3aeb82d, user_id=f31f06ffbb8b48318ce55bd7ffa809e2, role_id=1c39b9ab8cfd4c0ea71845831920a845)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:33.178411 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad98b640-9057-4c2d-b999-014712711389 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:33.190097 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95da0587-bc17-4507-8724-d19d02092195 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:33.195623 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-95da0587-bc17-4507-8724-d19d02092195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:33.214013 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 824/1657] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:15:33 2022] PUT /identity/v3/projects/ce1ca3b4248a49ae8b6b2405d3aeb82d/users/f31f06ffbb8b48318ce55bd7ffa809e2/roles/1c39b9ab8cfd4c0ea71845831920a845 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:15:33.221196 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad98b640-9057-4c2d-b999-014712711389 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:33.257807 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95da0587-bc17-4507-8724-d19d02092195 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:33.437094 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c96f24-4aa1-4a8a-8e34-dc5105a50135 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3802cb341445f994b9204744060ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:33.439525 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c96f24-4aa1-4a8a-8e34-dc5105a50135 service neutron] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:33.439525 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c96f24-4aa1-4a8a-8e34-dc5105a50135 service neutron] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:33.440391 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c96f24-4aa1-4a8a-8e34-dc5105a50135 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:33.462023 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad98b640-9057-4c2d-b999-014712711389 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:33.476175 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c96f24-4aa1-4a8a-8e34-dc5105a50135 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:33.479521 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd9fb77-765c-4baf-964d-aaf4d5f39a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:33.482079 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd9fb77-765c-4baf-964d-aaf4d5f39a1a admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:33.482383 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd9fb77-765c-4baf-964d-aaf4d5f39a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:33.482845 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd9fb77-765c-4baf-964d-aaf4d5f39a1a admin admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:33.483794 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd9fb77-765c-4baf-964d-aaf4d5f39a1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:33.488119 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd9fb77-765c-4baf-964d-aaf4d5f39a1a admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:33.489447 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c96f24-4aa1-4a8a-8e34-dc5105a50135 service neutron] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:33.521818 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 834/1658] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:15:33 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:15:33.524744 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c96f24-4aa1-4a8a-8e34-dc5105a50135 service neutron] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:33.527520 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 825/1659] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:15:33 2022] GET /identity/v3/roles => generated 1420 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:15:33.528771 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd9fb77-765c-4baf-964d-aaf4d5f39a1a admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:33.530343 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-51c96f24-4aa1-4a8a-8e34-dc5105a50135 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:33.570992 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd9fb77-765c-4baf-964d-aaf4d5f39a1a admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:33.573379 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c96f24-4aa1-4a8a-8e34-dc5105a50135 service neutron] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:33.577628 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8887e0-8310-48e2-874d-d26be1ed874d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:33.579393 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8887e0-8310-48e2-874d-d26be1ed874d admin admin] REQUEST_METHOD: `PUT` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:33.579779 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8887e0-8310-48e2-874d-d26be1ed874d admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:33.580638 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8887e0-8310-48e2-874d-d26be1ed874d admin admin] PATH_INFO: `/v3/projects/ce1ca3b4248a49ae8b6b2405d3aeb82d/users/f31f06ffbb8b48318ce55bd7ffa809e2/roles/1c39b9ab8cfd4c0ea71845831920a845` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:33.586643 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8887e0-8310-48e2-874d-d26be1ed874d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce1ca3b4248a49ae8b6b2405d3aeb82d, user_id=f31f06ffbb8b48318ce55bd7ffa809e2, role_id=1c39b9ab8cfd4c0ea71845831920a845)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:33.592176 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8887e0-8310-48e2-874d-d26be1ed874d admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:33.597373 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf6be95-cce8-4785-8cc9-0c424634f1ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:33.598586 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf6be95-cce8-4785-8cc9-0c424634f1ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:33.599033 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf6be95-cce8-4785-8cc9-0c424634f1ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:33.599457 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf6be95-cce8-4785-8cc9-0c424634f1ac admin admin] PATH_INFO: `/v3/projects/afbd1074d9a0409c8e1514d4892949e8` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:33.608823 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf6be95-cce8-4785-8cc9-0c424634f1ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=afbd1074d9a0409c8e1514d4892949e8)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:33.611161 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf6be95-cce8-4785-8cc9-0c424634f1ac admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:33.629149 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 826/1660] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:15:33 2022] PUT /identity/v3/projects/ce1ca3b4248a49ae8b6b2405d3aeb82d/users/f31f06ffbb8b48318ce55bd7ffa809e2/roles/1c39b9ab8cfd4c0ea71845831920a845 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:15:33.772117 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-2bf6be95-cce8-4785-8cc9-0c424634f1ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afbd1074d9a0409c8e1514d4892949e8', 'request_id': 'req-2bf6be95-cce8-4785-8cc9-0c424634f1ac'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:15:33.798055 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-2bf6be95-cce8-4785-8cc9-0c424634f1ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afbd1074d9a0409c8e1514d4892949e8', 'request_id': 'req-2bf6be95-cce8-4785-8cc9-0c424634f1ac'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:15:33.808077 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-2bf6be95-cce8-4785-8cc9-0c424634f1ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afbd1074d9a0409c8e1514d4892949e8', 'request_id': 'req-2bf6be95-cce8-4785-8cc9-0c424634f1ac'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:15:33.840022 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-2bf6be95-cce8-4785-8cc9-0c424634f1ac admin admin] The token cache is being invalidate because project afbd1074d9a0409c8e1514d4892949e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79960) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 07:15:33.840724 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-2bf6be95-cce8-4785-8cc9-0c424634f1ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:15:33.844423 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-2bf6be95-cce8-4785-8cc9-0c424634f1ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:15:33.849870 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 835/1661] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Mar 30 07:15:33 2022] DELETE /identity/v3/projects/afbd1074d9a0409c8e1514d4892949e8 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:15:33.853699 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8887e0-8310-48e2-874d-d26be1ed874d admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:33.855771 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-7b8887e0-8310-48e2-874d-d26be1ed874d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:34.052710 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8887e0-8310-48e2-874d-d26be1ed874d admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:34.151897 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07adc8b0-65a4-42bb-8c43-996d9d168897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:34.152811 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07adc8b0-65a4-42bb-8c43-996d9d168897 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:34.153132 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07adc8b0-65a4-42bb-8c43-996d9d168897 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:34.153404 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07adc8b0-65a4-42bb-8c43-996d9d168897 admin admin] PATH_INFO: `/v3/users/97ec68175599448997bd093bcdc3f95b` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:34.155383 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07adc8b0-65a4-42bb-8c43-996d9d168897 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97ec68175599448997bd093bcdc3f95b)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:34.157600 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07adc8b0-65a4-42bb-8c43-996d9d168897 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:34.245279 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-07adc8b0-65a4-42bb-8c43-996d9d168897 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97ec68175599448997bd093bcdc3f95b'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:15:34.245949 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-07adc8b0-65a4-42bb-8c43-996d9d168897 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97ec68175599448997bd093bcdc3f95b'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:15:34.246559 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-07adc8b0-65a4-42bb-8c43-996d9d168897 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97ec68175599448997bd093bcdc3f95b'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:15:34.259830 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-07adc8b0-65a4-42bb-8c43-996d9d168897 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97ec68175599448997bd093bcdc3f95b'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:15:34.269429 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-07adc8b0-65a4-42bb-8c43-996d9d168897 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97ec68175599448997bd093bcdc3f95b'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:15:34.299441 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 827/1662] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Mar 30 07:15:33 2022] DELETE /identity/v3/users/97ec68175599448997bd093bcdc3f95b => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:15:34.611531 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6f1d66-3101-4746-ad2e-b6c563d3fa28 None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:34.612116 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6f1d66-3101-4746-ad2e-b6c563d3fa28 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:34.612116 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6f1d66-3101-4746-ad2e-b6c563d3fa28 None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:34.614522 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 836/1663] 10.222.0.20 () {54 vars in 960 bytes} [Wed Mar 30 07:15:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:15:34.620808 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b793ff0-3bf8-4d8b-8958-4d9355399fd4 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:34.621366 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b793ff0-3bf8-4d8b-8958-4d9355399fd4 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:34.621366 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b793ff0-3bf8-4d8b-8958-4d9355399fd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:34.657691 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-8b793ff0-3bf8-4d8b-8958-4d9355399fd4 None None] MFA Rules not processed for user `d634743546e8456fac2f6ab1aaee09ef`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:15:34.658980 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-8b793ff0-3bf8-4d8b-8958-4d9355399fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:34.847524 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 828/1664] 10.222.0.20 () {58 vars in 1057 bytes} [Wed Mar 30 07:15:34 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 07:15:34.865512 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6f1d66-3101-4746-ad2e-b6c563d3fa28 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:34.905123 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6f1d66-3101-4746-ad2e-b6c563d3fa28 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:34.912623 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3910b509-c139-45ba-9729-74fe296bb415 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd634743546e8456fac2f6ab1aaee09ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:34.913834 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3910b509-c139-45ba-9729-74fe296bb415 service placement] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:34.915323 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3910b509-c139-45ba-9729-74fe296bb415 service placement] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:34.915964 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3910b509-c139-45ba-9729-74fe296bb415 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:34.918164 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-3910b509-c139-45ba-9729-74fe296bb415 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:34.966403 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3910b509-c139-45ba-9729-74fe296bb415 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:34.968762 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3910b509-c139-45ba-9729-74fe296bb415 service placement] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:35.026612 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 837/1665] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:15:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 30 07:15:36.575389 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cabc55-c6ed-44f1-8a38-8903368b265e None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:36.575913 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cabc55-c6ed-44f1-8a38-8903368b265e None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:36.576143 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cabc55-c6ed-44f1-8a38-8903368b265e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:36.637783 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-f6cabc55-c6ed-44f1-8a38-8903368b265e None None] MFA Rules not processed for user `f31f06ffbb8b48318ce55bd7ffa809e2`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:15:36.644313 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-f6cabc55-c6ed-44f1-8a38-8903368b265e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:36.656741 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3910b509-c139-45ba-9729-74fe296bb415 service placement] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:36.658354 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-3910b509-c139-45ba-9729-74fe296bb415 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:36.812806 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3910b509-c139-45ba-9729-74fe296bb415 service placement] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:36.830457 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d064bed4-661d-4d58-998b-8207282af41d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:36.831721 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d064bed4-661d-4d58-998b-8207282af41d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:36.832184 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d064bed4-661d-4d58-998b-8207282af41d admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:36.832597 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d064bed4-661d-4d58-998b-8207282af41d admin admin] PATH_INFO: `/v3/projects/10a7773629d047fbb32eae9dae147348` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:36.836457 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d064bed4-661d-4d58-998b-8207282af41d admin admin] RBAC: Authorizing `identity:delete_project(project_id=10a7773629d047fbb32eae9dae147348)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:36.838583 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d064bed4-661d-4d58-998b-8207282af41d admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:36.909214 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 829/1666] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:15:36 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:15:37.008952 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-d064bed4-661d-4d58-998b-8207282af41d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10a7773629d047fbb32eae9dae147348', 'request_id': 'req-d064bed4-661d-4d58-998b-8207282af41d'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:15:37.026179 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-d064bed4-661d-4d58-998b-8207282af41d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10a7773629d047fbb32eae9dae147348', 'request_id': 'req-d064bed4-661d-4d58-998b-8207282af41d'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:15:37.050609 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-d064bed4-661d-4d58-998b-8207282af41d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10a7773629d047fbb32eae9dae147348', 'request_id': 'req-d064bed4-661d-4d58-998b-8207282af41d'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:15:37.073292 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-d064bed4-661d-4d58-998b-8207282af41d admin admin] The token cache is being invalidate because project 10a7773629d047fbb32eae9dae147348 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79960) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 07:15:37.076001 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-d064bed4-661d-4d58-998b-8207282af41d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:15:37.076826 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-d064bed4-661d-4d58-998b-8207282af41d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:15:37.082397 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 838/1667] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Mar 30 07:15:36 2022] DELETE /identity/v3/projects/10a7773629d047fbb32eae9dae147348 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 07:15:37.087557 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcec21b-61fd-4450-8b4c-b4928fdbce8d None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:37.087868 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcec21b-61fd-4450-8b4c-b4928fdbce8d None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:37.088148 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcec21b-61fd-4450-8b4c-b4928fdbce8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:37.126686 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-9bcec21b-61fd-4450-8b4c-b4928fdbce8d None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:15:37.130852 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-9bcec21b-61fd-4450-8b4c-b4928fdbce8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:37.299993 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 830/1668] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:15:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:15:37.307008 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58918143-b628-43b4-8e2c-e8b4a182396a None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:37.307419 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58918143-b628-43b4-8e2c-e8b4a182396a None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:37.308327 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58918143-b628-43b4-8e2c-e8b4a182396a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:37.353102 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-58918143-b628-43b4-8e2c-e8b4a182396a None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:15:37.354367 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-58918143-b628-43b4-8e2c-e8b4a182396a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:37.377455 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 839/1669] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:15:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:15:37.381881 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcec21b-61fd-4450-8b4c-b4928fdbce8d None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:37.393196 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcec21b-61fd-4450-8b4c-b4928fdbce8d None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:37.400544 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91597f1d-8355-45f5-a8b5-8afe1ce53781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:37.401533 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91597f1d-8355-45f5-a8b5-8afe1ce53781 admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:37.401987 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91597f1d-8355-45f5-a8b5-8afe1ce53781 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:37.402433 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91597f1d-8355-45f5-a8b5-8afe1ce53781 admin admin] PATH_INFO: `/v3/domains` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:37.403619 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91597f1d-8355-45f5-a8b5-8afe1ce53781 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:15:37.404473 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91597f1d-8355-45f5-a8b5-8afe1ce53781 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:37.406668 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91597f1d-8355-45f5-a8b5-8afe1ce53781 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:37.428993 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2617b5-c060-4e3d-8cf1-6aea6de26099 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:37.429280 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2617b5-c060-4e3d-8cf1-6aea6de26099 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:37.429552 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2617b5-c060-4e3d-8cf1-6aea6de26099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:37.435864 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 831/1670] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Mar 30 07:15:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:15:37.439447 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91597f1d-8355-45f5-a8b5-8afe1ce53781 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:37.466496 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91597f1d-8355-45f5-a8b5-8afe1ce53781 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:37.482830 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa89378-0577-4f24-9944-89958da07b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:37.499545 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa89378-0577-4f24-9944-89958da07b54 admin admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:37.500139 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa89378-0577-4f24-9944-89958da07b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:37.500558 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa89378-0577-4f24-9944-89958da07b54 admin admin] PATH_INFO: `/v3/projects` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:37.503335 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa89378-0577-4f24-9944-89958da07b54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:37.506688 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa89378-0577-4f24-9944-89958da07b54 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:37.508637 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-4c2617b5-c060-4e3d-8cf1-6aea6de26099 None None] MFA Rules not processed for user `93c4c81f994a48feb4d712c6b5120996`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:15:37.523127 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-4c2617b5-c060-4e3d-8cf1-6aea6de26099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:37.558955 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 832/1671] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Mar 30 07:15:37 2022] POST /identity/v3/projects => generated 363 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:15:37.562632 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa89378-0577-4f24-9944-89958da07b54 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:37.718927 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa89378-0577-4f24-9944-89958da07b54 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:37.725139 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6624f4d-8311-4355-90f7-1cb88c98d88f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:37.726216 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6624f4d-8311-4355-90f7-1cb88c98d88f admin admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:37.726500 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6624f4d-8311-4355-90f7-1cb88c98d88f admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:37.726774 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6624f4d-8311-4355-90f7-1cb88c98d88f admin admin] PATH_INFO: `/v3/users` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:37.727695 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6624f4d-8311-4355-90f7-1cb88c98d88f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:37.730537 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6624f4d-8311-4355-90f7-1cb88c98d88f admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:37.744491 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 840/1672] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:15:37 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:15:37.757202 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2617b5-c060-4e3d-8cf1-6aea6de26099 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:37.759209 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-4c2617b5-c060-4e3d-8cf1-6aea6de26099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:37.767277 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 833/1673] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Mar 30 07:15:37 2022] POST /identity/v3/users => generated 282 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:15:37.771401 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6624f4d-8311-4355-90f7-1cb88c98d88f admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:37.787330 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6624f4d-8311-4355-90f7-1cb88c98d88f admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:37.793230 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667e8e77-d1cc-449f-890d-535707cc4603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:37.794399 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667e8e77-d1cc-449f-890d-535707cc4603 admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:37.795036 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667e8e77-d1cc-449f-890d-535707cc4603 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:37.795476 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667e8e77-d1cc-449f-890d-535707cc4603 admin admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:37.797551 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667e8e77-d1cc-449f-890d-535707cc4603 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:37.799920 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667e8e77-d1cc-449f-890d-535707cc4603 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:37.815786 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 834/1674] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:15:37 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 30 07:15:37.819655 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667e8e77-d1cc-449f-890d-535707cc4603 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:37.846967 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667e8e77-d1cc-449f-890d-535707cc4603 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:37.861150 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c775afc-79ba-402c-8366-e7ab5a7d1618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:37.862004 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c775afc-79ba-402c-8366-e7ab5a7d1618 admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:37.864872 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c775afc-79ba-402c-8366-e7ab5a7d1618 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:37.864872 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c775afc-79ba-402c-8366-e7ab5a7d1618 admin admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:37.865280 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c775afc-79ba-402c-8366-e7ab5a7d1618 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:37.867756 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c775afc-79ba-402c-8366-e7ab5a7d1618 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:37.891437 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 835/1675] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:15:37 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:15:37.893100 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c775afc-79ba-402c-8366-e7ab5a7d1618 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:37.904779 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c775afc-79ba-402c-8366-e7ab5a7d1618 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:37.912275 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c720ddd-39b6-4f3e-8e47-c13f3e573e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:37.913733 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c720ddd-39b6-4f3e-8e47-c13f3e573e08 admin admin] REQUEST_METHOD: `PUT` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:37.914132 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c720ddd-39b6-4f3e-8e47-c13f3e573e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:37.914502 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c720ddd-39b6-4f3e-8e47-c13f3e573e08 admin admin] PATH_INFO: `/v3/projects/a056d4fb32aa4058a1613dad74af3ed3/users/2b714e8a99b94cc69875600630c4b655/roles/5d79031a64754b57ba120367465e2252` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:37.934321 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2617b5-c060-4e3d-8cf1-6aea6de26099 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:37.935701 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c720ddd-39b6-4f3e-8e47-c13f3e573e08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a056d4fb32aa4058a1613dad74af3ed3, user_id=2b714e8a99b94cc69875600630c4b655, role_id=5d79031a64754b57ba120367465e2252)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:37.938923 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c720ddd-39b6-4f3e-8e47-c13f3e573e08 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:37.967676 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 836/1676] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:15:37 2022] PUT /identity/v3/projects/a056d4fb32aa4058a1613dad74af3ed3/users/2b714e8a99b94cc69875600630c4b655/roles/5d79031a64754b57ba120367465e2252 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:15:37.979378 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b046ade4-cbf8-4303-bb18-5f8ac5605b07 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:37.979740 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b046ade4-cbf8-4303-bb18-5f8ac5605b07 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:37.980527 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b046ade4-cbf8-4303-bb18-5f8ac5605b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:38.073478 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d7579d-643d-4c8a-828e-95827dece692 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72b398c5ed14484d8b7a51fee900597b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:38.074566 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d7579d-643d-4c8a-828e-95827dece692 service nova] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:38.074951 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d7579d-643d-4c8a-828e-95827dece692 service nova] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:38.075334 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d7579d-643d-4c8a-828e-95827dece692 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:38.090034 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-b046ade4-cbf8-4303-bb18-5f8ac5605b07 None None] MFA Rules not processed for user `2b714e8a99b94cc69875600630c4b655`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:15:38.098864 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-b046ade4-cbf8-4303-bb18-5f8ac5605b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:38.210418 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d7579d-643d-4c8a-828e-95827dece692 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:38.212252 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d7579d-643d-4c8a-828e-95827dece692 service nova] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:38.217213 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 837/1677] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:15:37 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 07:15:38.222163 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b046ade4-cbf8-4303-bb18-5f8ac5605b07 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:38.265205 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 841/1678] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:15:37 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:15:38.344286 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b046ade4-cbf8-4303-bb18-5f8ac5605b07 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:38.373641 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2da576-12c0-46d4-8f24-ec565986da8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:38.374262 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2da576-12c0-46d4-8f24-ec565986da8f admin admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:38.375304 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2da576-12c0-46d4-8f24-ec565986da8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:38.375588 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2da576-12c0-46d4-8f24-ec565986da8f admin admin] PATH_INFO: `/v3/projects` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:38.376383 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2da576-12c0-46d4-8f24-ec565986da8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:38.378329 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2da576-12c0-46d4-8f24-ec565986da8f admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:38.503787 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 838/1679] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Mar 30 07:15:38 2022] POST /identity/v3/projects => generated 365 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 07:15:38.505586 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d7579d-643d-4c8a-828e-95827dece692 service nova] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:38.523581 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d7579d-643d-4c8a-828e-95827dece692 service nova] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:38.766913 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14da3afc-b315-4e69-bccc-c1a673353562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:38.767449 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14da3afc-b315-4e69-bccc-c1a673353562 admin admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:38.769068 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14da3afc-b315-4e69-bccc-c1a673353562 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:38.769354 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14da3afc-b315-4e69-bccc-c1a673353562 admin admin] PATH_INFO: `/v3/users` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:38.770070 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14da3afc-b315-4e69-bccc-c1a673353562 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:38.772491 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14da3afc-b315-4e69-bccc-c1a673353562 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:38.865221 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 842/1680] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Mar 30 07:15:38 2022] POST /identity/v3/users => generated 289 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:15:38.869768 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2da576-12c0-46d4-8f24-ec565986da8f admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:38.946840 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2da576-12c0-46d4-8f24-ec565986da8f admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:38.966022 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21afa745-a17a-49cc-a781-2a9f28b94cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:38.966617 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c780f62-ed7b-4670-9ca3-d8e86c351b7e None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:38.967090 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c780f62-ed7b-4670-9ca3-d8e86c351b7e None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:38.967504 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c780f62-ed7b-4670-9ca3-d8e86c351b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:38.968487 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21afa745-a17a-49cc-a781-2a9f28b94cfc admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:38.968816 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21afa745-a17a-49cc-a781-2a9f28b94cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:38.969099 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21afa745-a17a-49cc-a781-2a9f28b94cfc admin admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:38.970651 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21afa745-a17a-49cc-a781-2a9f28b94cfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:38.972802 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21afa745-a17a-49cc-a781-2a9f28b94cfc admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:39.015380 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 839/1681] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:15:38 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:15:39.021099 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21afa745-a17a-49cc-a781-2a9f28b94cfc admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:39.022300 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-1c780f62-ed7b-4670-9ca3-d8e86c351b7e None None] MFA Rules not processed for user `67102c1adcf0491e9ecdef970ab2d5ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:15:39.023547 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-1c780f62-ed7b-4670-9ca3-d8e86c351b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:39.055527 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21afa745-a17a-49cc-a781-2a9f28b94cfc admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:39.062853 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899b8a0e-1b3e-46ef-a2d8-1ae6c7c9f93d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:39.076269 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899b8a0e-1b3e-46ef-a2d8-1ae6c7c9f93d admin admin] REQUEST_METHOD: `PUT` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:39.077098 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899b8a0e-1b3e-46ef-a2d8-1ae6c7c9f93d admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:39.077682 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899b8a0e-1b3e-46ef-a2d8-1ae6c7c9f93d admin admin] PATH_INFO: `/v3/projects/7cbefe28e05841d1834721f8808d15f1/users/70e330aaac8a48f38799a4b386fb6492/roles/1c39b9ab8cfd4c0ea71845831920a845` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:39.106892 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899b8a0e-1b3e-46ef-a2d8-1ae6c7c9f93d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cbefe28e05841d1834721f8808d15f1, user_id=70e330aaac8a48f38799a4b386fb6492, role_id=1c39b9ab8cfd4c0ea71845831920a845)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:39.129919 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899b8a0e-1b3e-46ef-a2d8-1ae6c7c9f93d admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:39.170194 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 840/1682] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:15:39 2022] PUT /identity/v3/projects/7cbefe28e05841d1834721f8808d15f1/users/70e330aaac8a48f38799a4b386fb6492/roles/1c39b9ab8cfd4c0ea71845831920a845 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:15:39.171836 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899b8a0e-1b3e-46ef-a2d8-1ae6c7c9f93d admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:39.271247 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 843/1683] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Mar 30 07:15:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:15:39.345151 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899b8a0e-1b3e-46ef-a2d8-1ae6c7c9f93d admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:39.368069 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034e8037-ee36-42bb-a4f1-caa4b6058a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:39.371047 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034e8037-ee36-42bb-a4f1-caa4b6058a3e admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:39.371624 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034e8037-ee36-42bb-a4f1-caa4b6058a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:39.376978 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034e8037-ee36-42bb-a4f1-caa4b6058a3e admin admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:39.378078 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034e8037-ee36-42bb-a4f1-caa4b6058a3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:39.379843 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034e8037-ee36-42bb-a4f1-caa4b6058a3e admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:39.410589 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c780f62-ed7b-4670-9ca3-d8e86c351b7e None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:39.424348 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 841/1684] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:15:39 2022] GET /identity/v3/roles => generated 1420 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:15:39.438727 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c780f62-ed7b-4670-9ca3-d8e86c351b7e None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:39.449441 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f31b7e-b602-4519-b303-dcbe330c7aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:39.451043 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f31b7e-b602-4519-b303-dcbe330c7aba admin admin] REQUEST_METHOD: `PUT` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:39.451908 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f31b7e-b602-4519-b303-dcbe330c7aba admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:39.452201 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f31b7e-b602-4519-b303-dcbe330c7aba admin admin] PATH_INFO: `/v3/projects/7cbefe28e05841d1834721f8808d15f1/users/70e330aaac8a48f38799a4b386fb6492/roles/1c39b9ab8cfd4c0ea71845831920a845` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:39.461001 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f31b7e-b602-4519-b303-dcbe330c7aba admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cbefe28e05841d1834721f8808d15f1, user_id=70e330aaac8a48f38799a4b386fb6492, role_id=1c39b9ab8cfd4c0ea71845831920a845)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:39.463789 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f31b7e-b602-4519-b303-dcbe330c7aba admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:39.512019 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 844/1685] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:15:39 2022] PUT /identity/v3/projects/7cbefe28e05841d1834721f8808d15f1/users/70e330aaac8a48f38799a4b386fb6492/roles/1c39b9ab8cfd4c0ea71845831920a845 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:15:39.518612 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02170bae-1e12-4e66-8b7d-f108c6d8f8cc None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:39.519483 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02170bae-1e12-4e66-8b7d-f108c6d8f8cc None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:39.519905 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02170bae-1e12-4e66-8b7d-f108c6d8f8cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:39.614655 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-02170bae-1e12-4e66-8b7d-f108c6d8f8cc None None] MFA Rules not processed for user `70e330aaac8a48f38799a4b386fb6492`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:15:39.629317 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-02170bae-1e12-4e66-8b7d-f108c6d8f8cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:39.672990 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f31b7e-b602-4519-b303-dcbe330c7aba admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:39.674789 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-49f31b7e-b602-4519-b303-dcbe330c7aba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:39.867850 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 842/1686] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:15:39 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:15:39.936632 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f31b7e-b602-4519-b303-dcbe330c7aba admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:39.951282 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3a9314-e342-47a3-9b08-efb5b89cfb40 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c452249c502d4b0688e8dd068f8c4951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:39.952270 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a9314-e342-47a3-9b08-efb5b89cfb40 service swift] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:39.952733 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a9314-e342-47a3-9b08-efb5b89cfb40 service swift] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:39.953973 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a9314-e342-47a3-9b08-efb5b89cfb40 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:40.030988 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02170bae-1e12-4e66-8b7d-f108c6d8f8cc None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:40.032454 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-02170bae-1e12-4e66-8b7d-f108c6d8f8cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:40.125728 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3a9314-e342-47a3-9b08-efb5b89cfb40 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:40.129437 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3a9314-e342-47a3-9b08-efb5b89cfb40 service swift] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:40.151934 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02170bae-1e12-4e66-8b7d-f108c6d8f8cc None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:40.156729 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7304d40-c228-42af-9db8-4239ef7f2148 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e2fda180e8d448d895c40cdad34bc4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:40.157458 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7304d40-c228-42af-9db8-4239ef7f2148 service cinder] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:40.157739 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7304d40-c228-42af-9db8-4239ef7f2148 service cinder] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:40.158011 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7304d40-c228-42af-9db8-4239ef7f2148 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:40.159194 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 845/1687] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Mar 30 07:15:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 30 07:15:40.180365 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7304d40-c228-42af-9db8-4239ef7f2148 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:40.181832 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7304d40-c228-42af-9db8-4239ef7f2148 service cinder] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:40.210344 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 843/1688] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:15:40 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 30 07:15:40.725932 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3a9314-e342-47a3-9b08-efb5b89cfb40 service swift] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:40.750088 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3a9314-e342-47a3-9b08-efb5b89cfb40 service swift] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:40.772773 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42687a7-9dde-4d57-b201-fe91c5e8d149 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e2fda180e8d448d895c40cdad34bc4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:40.773553 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42687a7-9dde-4d57-b201-fe91c5e8d149 service cinder] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:40.773841 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42687a7-9dde-4d57-b201-fe91c5e8d149 service cinder] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:40.774122 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42687a7-9dde-4d57-b201-fe91c5e8d149 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:41.122799 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42687a7-9dde-4d57-b201-fe91c5e8d149 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:41.132614 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42687a7-9dde-4d57-b201-fe91c5e8d149 service cinder] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:41.184429 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 846/1689] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:15:40 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:15:42.028938 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcc7e92-238e-476c-8669-da2e518fe4df None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:42.032573 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcc7e92-238e-476c-8669-da2e518fe4df None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:42.037684 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcc7e92-238e-476c-8669-da2e518fe4df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:42.101565 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-9dcc7e92-238e-476c-8669-da2e518fe4df None None] MFA Rules not processed for user `8dd9d32c47014294a367654b57c96f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:15:42.103145 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-9dcc7e92-238e-476c-8669-da2e518fe4df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:42.315347 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 844/1690] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:15:42 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:15:42.322998 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42687a7-9dde-4d57-b201-fe91c5e8d149 service cinder] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:42.499708 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42687a7-9dde-4d57-b201-fe91c5e8d149 service cinder] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:42.519738 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aa8160-9b65-4f5f-a158-c34f2ee72c01 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72b398c5ed14484d8b7a51fee900597b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:42.519738 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aa8160-9b65-4f5f-a158-c34f2ee72c01 service nova] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:42.519738 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aa8160-9b65-4f5f-a158-c34f2ee72c01 service nova] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:42.519738 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aa8160-9b65-4f5f-a158-c34f2ee72c01 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:42.567610 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5aa8160-9b65-4f5f-a158-c34f2ee72c01 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:42.572602 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5aa8160-9b65-4f5f-a158-c34f2ee72c01 service nova] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:42.617191 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 847/1691] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:15:42 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:15:43.196780 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53a3ea8-c356-4da4-9739-ab19cbccc6da None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:43.197644 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53a3ea8-c356-4da4-9739-ab19cbccc6da None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:43.197644 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53a3ea8-c356-4da4-9739-ab19cbccc6da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:43.254282 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-d53a3ea8-c356-4da4-9739-ab19cbccc6da None None] MFA Rules not processed for user `bc84d32966d34ff29620cd40d3d9cc3a`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:15:43.255515 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-d53a3ea8-c356-4da4-9739-ab19cbccc6da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:43.400059 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 845/1692] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:15:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:15:43.411765 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498d3a1e-1a85-421d-9d62-e7009bf7a3b1 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:43.412329 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498d3a1e-1a85-421d-9d62-e7009bf7a3b1 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:43.412756 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498d3a1e-1a85-421d-9d62-e7009bf7a3b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:43.451241 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-498d3a1e-1a85-421d-9d62-e7009bf7a3b1 None None] MFA Rules not processed for user `bc84d32966d34ff29620cd40d3d9cc3a`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:15:43.452791 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-498d3a1e-1a85-421d-9d62-e7009bf7a3b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:43.472339 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 848/1693] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:15:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:15:43.485629 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53a3ea8-c356-4da4-9739-ab19cbccc6da None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:43.486161 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-d53a3ea8-c356-4da4-9739-ab19cbccc6da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:43.546443 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53a3ea8-c356-4da4-9739-ab19cbccc6da None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:43.569297 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b58f8d0-a843-4e4c-9264-179345c45396 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72b398c5ed14484d8b7a51fee900597b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:43.570000 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b58f8d0-a843-4e4c-9264-179345c45396 service nova] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:43.570366 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b58f8d0-a843-4e4c-9264-179345c45396 service nova] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:43.570542 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b58f8d0-a843-4e4c-9264-179345c45396 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:43.598580 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b58f8d0-a843-4e4c-9264-179345c45396 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:43.600433 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b58f8d0-a843-4e4c-9264-179345c45396 service nova] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:43.638741 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 846/1694] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:15:43 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:15:43.814030 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139a85b0-3885-49d2-81f8-d0d799de281e None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:43.814309 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139a85b0-3885-49d2-81f8-d0d799de281e None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:43.814799 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139a85b0-3885-49d2-81f8-d0d799de281e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:43.881245 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-139a85b0-3885-49d2-81f8-d0d799de281e None None] MFA Rules not processed for user `54f3802cb341445f994b9204744060ae`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:15:43.886365 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-139a85b0-3885-49d2-81f8-d0d799de281e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:44.046373 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 849/1695] 10.222.0.35 () {58 vars in 1015 bytes} [Wed Mar 30 07:15:43 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:15:44.159259 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b58f8d0-a843-4e4c-9264-179345c45396 service nova] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:44.160933 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-8b58f8d0-a843-4e4c-9264-179345c45396 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:44.175341 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139a85b0-3885-49d2-81f8-d0d799de281e None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:44.177629 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-139a85b0-3885-49d2-81f8-d0d799de281e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:44.197064 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139a85b0-3885-49d2-81f8-d0d799de281e None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:44.220139 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e39726-5943-49c9-bc29-3ebcbb0f96bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3802cb341445f994b9204744060ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:44.221169 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e39726-5943-49c9-bc29-3ebcbb0f96bd service neutron] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:44.221460 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e39726-5943-49c9-bc29-3ebcbb0f96bd service neutron] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:44.221739 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e39726-5943-49c9-bc29-3ebcbb0f96bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:44.249046 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e39726-5943-49c9-bc29-3ebcbb0f96bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:44.250645 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e39726-5943-49c9-bc29-3ebcbb0f96bd service neutron] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:44.287168 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 850/1696] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:15:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:15:44.361502 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b58f8d0-a843-4e4c-9264-179345c45396 service nova] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:44.376037 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb708c8-6e1e-4b0c-b78c-746d191e8aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:44.377250 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb708c8-6e1e-4b0c-b78c-746d191e8aae admin admin] REQUEST_METHOD: `DELETE` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:44.377668 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb708c8-6e1e-4b0c-b78c-746d191e8aae admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:44.378092 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb708c8-6e1e-4b0c-b78c-746d191e8aae admin admin] PATH_INFO: `/v3/users/3b4ce27507804d57b07fa870f73d2705` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:44.385452 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb708c8-6e1e-4b0c-b78c-746d191e8aae admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b4ce27507804d57b07fa870f73d2705)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:44.387720 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb708c8-6e1e-4b0c-b78c-746d191e8aae admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:44.484383 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-0cb708c8-6e1e-4b0c-b78c-746d191e8aae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b4ce27507804d57b07fa870f73d2705'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:15:44.485401 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-0cb708c8-6e1e-4b0c-b78c-746d191e8aae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b4ce27507804d57b07fa870f73d2705'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:15:44.486253 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-0cb708c8-6e1e-4b0c-b78c-746d191e8aae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b4ce27507804d57b07fa870f73d2705'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:15:44.497489 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-0cb708c8-6e1e-4b0c-b78c-746d191e8aae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b4ce27507804d57b07fa870f73d2705'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:15:44.514061 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-0cb708c8-6e1e-4b0c-b78c-746d191e8aae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b4ce27507804d57b07fa870f73d2705'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:15:44.559216 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 847/1697] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Mar 30 07:15:44 2022] DELETE /identity/v3/users/3b4ce27507804d57b07fa870f73d2705 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:15:45.075510 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e39726-5943-49c9-bc29-3ebcbb0f96bd service neutron] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:45.076996 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-d1e39726-5943-49c9-bc29-3ebcbb0f96bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:45.115094 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e39726-5943-49c9-bc29-3ebcbb0f96bd service neutron] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:45.281828 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb708c8-6e1e-4b0c-b78c-746d191e8aae admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:45.285324 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-0cb708c8-6e1e-4b0c-b78c-746d191e8aae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:45.381619 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b9b240-dbee-429d-8dc0-f47fd8c0cc82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:45.382525 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b9b240-dbee-429d-8dc0-f47fd8c0cc82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:45.382801 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b9b240-dbee-429d-8dc0-f47fd8c0cc82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:45.383062 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b9b240-dbee-429d-8dc0-f47fd8c0cc82 admin admin] PATH_INFO: `/v3/users/f691894ac05541969f0b4cb434e0aa06` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:45.395966 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b9b240-dbee-429d-8dc0-f47fd8c0cc82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f691894ac05541969f0b4cb434e0aa06)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:45.395966 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b9b240-dbee-429d-8dc0-f47fd8c0cc82 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:45.506508 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-f1b9b240-dbee-429d-8dc0-f47fd8c0cc82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f691894ac05541969f0b4cb434e0aa06'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:15:45.507591 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-f1b9b240-dbee-429d-8dc0-f47fd8c0cc82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f691894ac05541969f0b4cb434e0aa06'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:15:45.523508 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-f1b9b240-dbee-429d-8dc0-f47fd8c0cc82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f691894ac05541969f0b4cb434e0aa06'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:15:45.541318 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb708c8-6e1e-4b0c-b78c-746d191e8aae admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:45.558655 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d149fe09-b5ae-4f99-8fb7-1621339b750d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:45.559629 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d149fe09-b5ae-4f99-8fb7-1621339b750d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:45.566308 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d149fe09-b5ae-4f99-8fb7-1621339b750d admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:45.566661 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d149fe09-b5ae-4f99-8fb7-1621339b750d admin admin] PATH_INFO: `/v3/users/2b714e8a99b94cc69875600630c4b655` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:45.569048 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d149fe09-b5ae-4f99-8fb7-1621339b750d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b714e8a99b94cc69875600630c4b655)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:45.571027 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d149fe09-b5ae-4f99-8fb7-1621339b750d admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:45.577230 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-f1b9b240-dbee-429d-8dc0-f47fd8c0cc82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f691894ac05541969f0b4cb434e0aa06'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:15:45.580077 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-f1b9b240-dbee-429d-8dc0-f47fd8c0cc82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f691894ac05541969f0b4cb434e0aa06'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:15:45.624970 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 851/1698] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Mar 30 07:15:45 2022] DELETE /identity/v3/users/f691894ac05541969f0b4cb434e0aa06 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:15:45.630352 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5739cd8b-0cae-421d-8526-ffaf9671c786 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:45.630875 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5739cd8b-0cae-421d-8526-ffaf9671c786 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:45.631282 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5739cd8b-0cae-421d-8526-ffaf9671c786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:45.693868 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-5739cd8b-0cae-421d-8526-ffaf9671c786 None None] MFA Rules not processed for user `bc84d32966d34ff29620cd40d3d9cc3a`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:15:45.695251 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-5739cd8b-0cae-421d-8526-ffaf9671c786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:45.755841 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-d149fe09-b5ae-4f99-8fb7-1621339b750d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b714e8a99b94cc69875600630c4b655'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:15:45.758498 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-d149fe09-b5ae-4f99-8fb7-1621339b750d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b714e8a99b94cc69875600630c4b655'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:15:45.760254 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-d149fe09-b5ae-4f99-8fb7-1621339b750d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b714e8a99b94cc69875600630c4b655'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:15:45.807362 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-d149fe09-b5ae-4f99-8fb7-1621339b750d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b714e8a99b94cc69875600630c4b655'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:15:45.860894 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-d149fe09-b5ae-4f99-8fb7-1621339b750d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b714e8a99b94cc69875600630c4b655'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:15:45.902130 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 852/1699] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:15:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:15:45.909493 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f9e213-ec79-4fb5-b4ac-a2e4875c49c6 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:45.910402 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f9e213-ec79-4fb5-b4ac-a2e4875c49c6 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:45.911658 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f9e213-ec79-4fb5-b4ac-a2e4875c49c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:45.949023 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-17f9e213-ec79-4fb5-b4ac-a2e4875c49c6 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:15:45.957694 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-17f9e213-ec79-4fb5-b4ac-a2e4875c49c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:45.989048 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 848/1700] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Mar 30 07:15:45 2022] DELETE /identity/v3/users/2b714e8a99b94cc69875600630c4b655 => generated 0 bytes in 708 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:15:46.000199 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d149fe09-b5ae-4f99-8fb7-1621339b750d admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:46.005122 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-d149fe09-b5ae-4f99-8fb7-1621339b750d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:46.135300 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 853/1701] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:15:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:15:46.137180 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e0c90e-e622-4aab-8ba1-ef6e56e5a08e None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:46.137180 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e0c90e-e622-4aab-8ba1-ef6e56e5a08e None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:46.137422 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e0c90e-e622-4aab-8ba1-ef6e56e5a08e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:46.182575 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-d5e0c90e-e622-4aab-8ba1-ef6e56e5a08e None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:15:46.184593 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-d5e0c90e-e622-4aab-8ba1-ef6e56e5a08e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:46.194682 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d149fe09-b5ae-4f99-8fb7-1621339b750d admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:46.200580 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 854/1702] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:15:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:15:46.205727 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4def73e9-e1e5-4f5a-8401-778cd342202e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:46.210287 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def73e9-e1e5-4f5a-8401-778cd342202e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:46.210895 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def73e9-e1e5-4f5a-8401-778cd342202e admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:46.211308 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def73e9-e1e5-4f5a-8401-778cd342202e admin admin] PATH_INFO: `/v3/projects/58f2d5fdc6ee44929783ecb547d70e4b` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:46.212756 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4def73e9-e1e5-4f5a-8401-778cd342202e admin admin] RBAC: Authorizing `identity:delete_project(project_id=58f2d5fdc6ee44929783ecb547d70e4b)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:46.215473 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: WARNING py.warnings [None req-4def73e9-e1e5-4f5a-8401-778cd342202e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 30 07:15:46.215473 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: warnings.warn(msg) Mar 30 07:15:46.215473 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: Mar 30 07:15:46.221742 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4def73e9-e1e5-4f5a-8401-778cd342202e admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:46.230541 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e0c90e-e622-4aab-8ba1-ef6e56e5a08e None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:46.236639 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-d5e0c90e-e622-4aab-8ba1-ef6e56e5a08e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:46.359060 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e0c90e-e622-4aab-8ba1-ef6e56e5a08e None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:46.374418 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-4def73e9-e1e5-4f5a-8401-778cd342202e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58f2d5fdc6ee44929783ecb547d70e4b', 'request_id': 'req-4def73e9-e1e5-4f5a-8401-778cd342202e'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:15:46.401691 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-4def73e9-e1e5-4f5a-8401-778cd342202e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58f2d5fdc6ee44929783ecb547d70e4b', 'request_id': 'req-4def73e9-e1e5-4f5a-8401-778cd342202e'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:15:46.431628 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-4def73e9-e1e5-4f5a-8401-778cd342202e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58f2d5fdc6ee44929783ecb547d70e4b', 'request_id': 'req-4def73e9-e1e5-4f5a-8401-778cd342202e'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:15:46.486231 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-4def73e9-e1e5-4f5a-8401-778cd342202e admin admin] The token cache is being invalidate because project 58f2d5fdc6ee44929783ecb547d70e4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79961) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 07:15:46.488259 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-4def73e9-e1e5-4f5a-8401-778cd342202e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:15:46.489850 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-4def73e9-e1e5-4f5a-8401-778cd342202e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:15:46.500647 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 849/1703] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Mar 30 07:15:45 2022] DELETE /identity/v3/projects/58f2d5fdc6ee44929783ecb547d70e4b => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:15:46.501713 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4def73e9-e1e5-4f5a-8401-778cd342202e admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:46.512857 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-4def73e9-e1e5-4f5a-8401-778cd342202e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:46.586344 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32125db-004a-4b99-b326-640a7856312b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3802cb341445f994b9204744060ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:46.589814 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32125db-004a-4b99-b326-640a7856312b service neutron] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:46.591702 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32125db-004a-4b99-b326-640a7856312b service neutron] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:46.592401 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32125db-004a-4b99-b326-640a7856312b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:46.599823 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-e32125db-004a-4b99-b326-640a7856312b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:46.782674 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4def73e9-e1e5-4f5a-8401-778cd342202e admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:46.800058 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d205b28-3f03-4f4b-83f5-04869b564e0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3802cb341445f994b9204744060ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:46.801261 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d205b28-3f03-4f4b-83f5-04869b564e0f service neutron] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:46.801261 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d205b28-3f03-4f4b-83f5-04869b564e0f service neutron] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:46.801442 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d205b28-3f03-4f4b-83f5-04869b564e0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:46.804583 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-3d205b28-3f03-4f4b-83f5-04869b564e0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:46.880962 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32125db-004a-4b99-b326-640a7856312b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:46.885798 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32125db-004a-4b99-b326-640a7856312b service neutron] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:46.930816 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 855/1704] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:15:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 729 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:15:46.931635 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32125db-004a-4b99-b326-640a7856312b service neutron] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:46.944581 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-e32125db-004a-4b99-b326-640a7856312b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:47.014228 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32125db-004a-4b99-b326-640a7856312b service neutron] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:47.036604 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8054ec-7642-4201-b810-934ea49239bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:47.037528 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8054ec-7642-4201-b810-934ea49239bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:47.037811 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8054ec-7642-4201-b810-934ea49239bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:47.038086 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8054ec-7642-4201-b810-934ea49239bc admin admin] PATH_INFO: `/v3/users/f31f06ffbb8b48318ce55bd7ffa809e2` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:47.043732 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8054ec-7642-4201-b810-934ea49239bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=f31f06ffbb8b48318ce55bd7ffa809e2)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:47.063367 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8054ec-7642-4201-b810-934ea49239bc admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:47.088011 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d205b28-3f03-4f4b-83f5-04869b564e0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:47.098458 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d205b28-3f03-4f4b-83f5-04869b564e0f service neutron] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:47.153947 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 850/1705] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:15:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 652 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:15:47.270578 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-be8054ec-7642-4201-b810-934ea49239bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f31f06ffbb8b48318ce55bd7ffa809e2'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:15:47.272274 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-be8054ec-7642-4201-b810-934ea49239bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f31f06ffbb8b48318ce55bd7ffa809e2'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:15:47.319140 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-be8054ec-7642-4201-b810-934ea49239bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f31f06ffbb8b48318ce55bd7ffa809e2'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:15:47.360598 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-be8054ec-7642-4201-b810-934ea49239bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f31f06ffbb8b48318ce55bd7ffa809e2'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:15:47.362181 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-be8054ec-7642-4201-b810-934ea49239bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f31f06ffbb8b48318ce55bd7ffa809e2'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:15:47.421342 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 856/1706] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Mar 30 07:15:46 2022] DELETE /identity/v3/users/f31f06ffbb8b48318ce55bd7ffa809e2 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:15:47.677142 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e31f4b-6119-4471-8128-2b3d20157de5 None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:47.677441 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e31f4b-6119-4471-8128-2b3d20157de5 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:47.677719 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e31f4b-6119-4471-8128-2b3d20157de5 None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:47.679564 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 851/1707] 10.222.0.20 () {54 vars in 912 bytes} [Wed Mar 30 07:15:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:15:47.689762 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20dea25-c948-4004-a7f4-ec90702ccde7 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:47.690041 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20dea25-c948-4004-a7f4-ec90702ccde7 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:47.690353 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20dea25-c948-4004-a7f4-ec90702ccde7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:47.753626 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-c20dea25-c948-4004-a7f4-ec90702ccde7 None None] MFA Rules not processed for user `54f3802cb341445f994b9204744060ae`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:15:47.755798 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-c20dea25-c948-4004-a7f4-ec90702ccde7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:47.928634 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 857/1708] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Mar 30 07:15:47 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:15:48.158769 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e31f4b-6119-4471-8128-2b3d20157de5 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:48.169864 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-a5e31f4b-6119-4471-8128-2b3d20157de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:48.232434 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e31f4b-6119-4471-8128-2b3d20157de5 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:48.251443 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8538dc85-a5f2-402f-b7dd-cd8200898e43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3802cb341445f994b9204744060ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:48.253646 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8538dc85-a5f2-402f-b7dd-cd8200898e43 service neutron] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:48.253937 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8538dc85-a5f2-402f-b7dd-cd8200898e43 service neutron] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:48.254227 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8538dc85-a5f2-402f-b7dd-cd8200898e43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:48.287653 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8538dc85-a5f2-402f-b7dd-cd8200898e43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:48.292495 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8538dc85-a5f2-402f-b7dd-cd8200898e43 service neutron] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:48.333923 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 852/1709] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:15:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:15:48.831641 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad5d55-bd5a-4208-9916-41eeea77e0bf None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:48.832605 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad5d55-bd5a-4208-9916-41eeea77e0bf None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:48.833106 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad5d55-bd5a-4208-9916-41eeea77e0bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:48.899169 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-cfad5d55-bd5a-4208-9916-41eeea77e0bf None None] MFA Rules not processed for user `93c4c81f994a48feb4d712c6b5120996`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:15:48.901355 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-cfad5d55-bd5a-4208-9916-41eeea77e0bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:49.085553 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 858/1710] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:15:48 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:15:49.859762 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8857dca-99b7-4fc4-addf-71070f3cf9e4 None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:49.860332 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8857dca-99b7-4fc4-addf-71070f3cf9e4 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:49.860619 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8857dca-99b7-4fc4-addf-71070f3cf9e4 None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:49.862810 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 853/1711] 10.222.0.20 () {54 vars in 921 bytes} [Wed Mar 30 07:15:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:15:49.978416 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d800c6f9-779c-4d11-88fb-20b98adc484f None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:49.979501 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d800c6f9-779c-4d11-88fb-20b98adc484f None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:49.980083 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d800c6f9-779c-4d11-88fb-20b98adc484f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:50.050516 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-d800c6f9-779c-4d11-88fb-20b98adc484f None None] MFA Rules not processed for user `72b398c5ed14484d8b7a51fee900597b`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:15:50.052030 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-d800c6f9-779c-4d11-88fb-20b98adc484f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:50.317262 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 859/1712] 10.222.0.20 () {58 vars in 1018 bytes} [Wed Mar 30 07:15:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 07:15:50.581439 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8857dca-99b7-4fc4-addf-71070f3cf9e4 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:50.585100 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-d8857dca-99b7-4fc4-addf-71070f3cf9e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:50.762417 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8857dca-99b7-4fc4-addf-71070f3cf9e4 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:50.775368 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd9e6fa-e806-4ea6-8c1f-ee25ecc86cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:50.776458 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd9e6fa-e806-4ea6-8c1f-ee25ecc86cf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:50.779749 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd9e6fa-e806-4ea6-8c1f-ee25ecc86cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:50.780177 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd9e6fa-e806-4ea6-8c1f-ee25ecc86cf2 admin admin] PATH_INFO: `/v3/projects/ce1ca3b4248a49ae8b6b2405d3aeb82d` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:50.782039 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd9e6fa-e806-4ea6-8c1f-ee25ecc86cf2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce1ca3b4248a49ae8b6b2405d3aeb82d)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:50.789177 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd9e6fa-e806-4ea6-8c1f-ee25ecc86cf2 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:50.907212 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-9cd9e6fa-e806-4ea6-8c1f-ee25ecc86cf2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce1ca3b4248a49ae8b6b2405d3aeb82d', 'request_id': 'req-9cd9e6fa-e806-4ea6-8c1f-ee25ecc86cf2'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:15:50.922105 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-9cd9e6fa-e806-4ea6-8c1f-ee25ecc86cf2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce1ca3b4248a49ae8b6b2405d3aeb82d', 'request_id': 'req-9cd9e6fa-e806-4ea6-8c1f-ee25ecc86cf2'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:15:50.942312 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-9cd9e6fa-e806-4ea6-8c1f-ee25ecc86cf2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce1ca3b4248a49ae8b6b2405d3aeb82d', 'request_id': 'req-9cd9e6fa-e806-4ea6-8c1f-ee25ecc86cf2'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:15:50.958527 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-9cd9e6fa-e806-4ea6-8c1f-ee25ecc86cf2 admin admin] The token cache is being invalidate because project ce1ca3b4248a49ae8b6b2405d3aeb82d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79961) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 07:15:50.959240 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-9cd9e6fa-e806-4ea6-8c1f-ee25ecc86cf2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:15:50.962147 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-9cd9e6fa-e806-4ea6-8c1f-ee25ecc86cf2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:15:50.968867 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 854/1713] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Mar 30 07:15:50 2022] DELETE /identity/v3/projects/ce1ca3b4248a49ae8b6b2405d3aeb82d => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:15:50.970109 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bcf64f-50d0-46b0-aaba-6663899038bb None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:50.970405 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bcf64f-50d0-46b0-aaba-6663899038bb None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:50.970686 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bcf64f-50d0-46b0-aaba-6663899038bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:51.017011 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-81bcf64f-50d0-46b0-aaba-6663899038bb None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:15:51.020743 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-81bcf64f-50d0-46b0-aaba-6663899038bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:51.285308 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 860/1714] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:15:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:15:51.294840 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd977f76-1c49-45a9-bed7-e9b68bbc12b5 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:51.295285 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd977f76-1c49-45a9-bed7-e9b68bbc12b5 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:51.295669 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd977f76-1c49-45a9-bed7-e9b68bbc12b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:51.339224 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-dd977f76-1c49-45a9-bed7-e9b68bbc12b5 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:15:51.341210 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-dd977f76-1c49-45a9-bed7-e9b68bbc12b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:51.378856 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 855/1715] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:15:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:15:51.382836 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bcf64f-50d0-46b0-aaba-6663899038bb None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:51.411867 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bcf64f-50d0-46b0-aaba-6663899038bb None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:51.431884 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8ba47b-8605-4299-bd7d-5ccf303a9a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:51.434746 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8ba47b-8605-4299-bd7d-5ccf303a9a86 admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:51.438712 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8ba47b-8605-4299-bd7d-5ccf303a9a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:51.439192 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8ba47b-8605-4299-bd7d-5ccf303a9a86 admin admin] PATH_INFO: `/v3/domains` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:51.442047 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8ba47b-8605-4299-bd7d-5ccf303a9a86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:15:51.442224 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8ba47b-8605-4299-bd7d-5ccf303a9a86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:51.456830 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8ba47b-8605-4299-bd7d-5ccf303a9a86 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:51.515688 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd977f76-1c49-45a9-bed7-e9b68bbc12b5 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:51.516997 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 861/1716] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Mar 30 07:15:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:15:51.533638 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd977f76-1c49-45a9-bed7-e9b68bbc12b5 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:51.544546 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e10fe8-9043-4868-a359-18f4d23ced25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:51.545284 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e10fe8-9043-4868-a359-18f4d23ced25 admin admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:51.545564 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e10fe8-9043-4868-a359-18f4d23ced25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:51.548217 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e10fe8-9043-4868-a359-18f4d23ced25 admin admin] PATH_INFO: `/v3/projects` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:51.549178 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e10fe8-9043-4868-a359-18f4d23ced25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:51.552072 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e10fe8-9043-4868-a359-18f4d23ced25 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:51.630822 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8ba47b-8605-4299-bd7d-5ccf303a9a86 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:51.630998 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 856/1717] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Mar 30 07:15:51 2022] POST /identity/v3/projects => generated 379 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:15:51.651350 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8ba47b-8605-4299-bd7d-5ccf303a9a86 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:51.739702 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e10fe8-9043-4868-a359-18f4d23ced25 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:51.749179 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-51e10fe8-9043-4868-a359-18f4d23ced25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:52.048634 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c3d9fc-95ed-4ba6-88e7-c0f70f844c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:52.050647 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c3d9fc-95ed-4ba6-88e7-c0f70f844c3e admin admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:52.052324 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c3d9fc-95ed-4ba6-88e7-c0f70f844c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:52.053994 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c3d9fc-95ed-4ba6-88e7-c0f70f844c3e admin admin] PATH_INFO: `/v3/users` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:52.055517 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c3d9fc-95ed-4ba6-88e7-c0f70f844c3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:52.064727 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c3d9fc-95ed-4ba6-88e7-c0f70f844c3e admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:52.172276 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e10fe8-9043-4868-a359-18f4d23ced25 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:52.180224 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 862/1718] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Mar 30 07:15:51 2022] POST /identity/v3/users => generated 290 bytes in 553 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:15:52.181671 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c3d9fc-95ed-4ba6-88e7-c0f70f844c3e admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:52.187827 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-13c3d9fc-95ed-4ba6-88e7-c0f70f844c3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:52.193324 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ccac71-dc23-4ee1-aa55-dd432bb6d124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:52.209752 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ccac71-dc23-4ee1-aa55-dd432bb6d124 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:52.214537 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ccac71-dc23-4ee1-aa55-dd432bb6d124 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:52.216646 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ccac71-dc23-4ee1-aa55-dd432bb6d124 admin admin] PATH_INFO: `/v3/projects/a056d4fb32aa4058a1613dad74af3ed3` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:52.228532 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ccac71-dc23-4ee1-aa55-dd432bb6d124 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a056d4fb32aa4058a1613dad74af3ed3)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:52.236064 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ccac71-dc23-4ee1-aa55-dd432bb6d124 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:52.237072 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c3d9fc-95ed-4ba6-88e7-c0f70f844c3e admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:52.258524 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a7d5d7-a0eb-4cf2-98fc-8983a2100910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:52.259885 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a7d5d7-a0eb-4cf2-98fc-8983a2100910 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:52.260399 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a7d5d7-a0eb-4cf2-98fc-8983a2100910 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:52.260891 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a7d5d7-a0eb-4cf2-98fc-8983a2100910 admin admin] PATH_INFO: `/v3/projects/3ceb7221fd424b1ebdcaaa1c3e5b52b8` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:52.264149 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a7d5d7-a0eb-4cf2-98fc-8983a2100910 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ceb7221fd424b1ebdcaaa1c3e5b52b8)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:52.267038 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a7d5d7-a0eb-4cf2-98fc-8983a2100910 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:52.406678 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-41ccac71-dc23-4ee1-aa55-dd432bb6d124 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a056d4fb32aa4058a1613dad74af3ed3', 'request_id': 'req-41ccac71-dc23-4ee1-aa55-dd432bb6d124'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:15:52.438899 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-59a7d5d7-a0eb-4cf2-98fc-8983a2100910 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ceb7221fd424b1ebdcaaa1c3e5b52b8', 'request_id': 'req-59a7d5d7-a0eb-4cf2-98fc-8983a2100910'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:15:52.455851 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-41ccac71-dc23-4ee1-aa55-dd432bb6d124 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a056d4fb32aa4058a1613dad74af3ed3', 'request_id': 'req-41ccac71-dc23-4ee1-aa55-dd432bb6d124'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:15:52.456745 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-59a7d5d7-a0eb-4cf2-98fc-8983a2100910 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ceb7221fd424b1ebdcaaa1c3e5b52b8', 'request_id': 'req-59a7d5d7-a0eb-4cf2-98fc-8983a2100910'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:15:52.481154 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-59a7d5d7-a0eb-4cf2-98fc-8983a2100910 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ceb7221fd424b1ebdcaaa1c3e5b52b8', 'request_id': 'req-59a7d5d7-a0eb-4cf2-98fc-8983a2100910'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:15:52.484587 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-41ccac71-dc23-4ee1-aa55-dd432bb6d124 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a056d4fb32aa4058a1613dad74af3ed3', 'request_id': 'req-41ccac71-dc23-4ee1-aa55-dd432bb6d124'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:15:52.530890 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-41ccac71-dc23-4ee1-aa55-dd432bb6d124 admin admin] The token cache is being invalidate because project a056d4fb32aa4058a1613dad74af3ed3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79961) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 07:15:52.534381 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-41ccac71-dc23-4ee1-aa55-dd432bb6d124 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:15:52.537891 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-41ccac71-dc23-4ee1-aa55-dd432bb6d124 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:15:52.544619 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-59a7d5d7-a0eb-4cf2-98fc-8983a2100910 admin admin] The token cache is being invalidate because project 3ceb7221fd424b1ebdcaaa1c3e5b52b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79960) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 07:15:52.545280 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 857/1719] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Mar 30 07:15:51 2022] DELETE /identity/v3/projects/a056d4fb32aa4058a1613dad74af3ed3 => generated 0 bytes in 810 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:15:52.550562 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ccac71-dc23-4ee1-aa55-dd432bb6d124 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:52.555214 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-59a7d5d7-a0eb-4cf2-98fc-8983a2100910 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:15:52.555384 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-41ccac71-dc23-4ee1-aa55-dd432bb6d124 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:52.556586 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-59a7d5d7-a0eb-4cf2-98fc-8983a2100910 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:15:52.570197 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 863/1720] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Mar 30 07:15:52 2022] DELETE /identity/v3/projects/3ceb7221fd424b1ebdcaaa1c3e5b52b8 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:15:52.570511 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a7d5d7-a0eb-4cf2-98fc-8983a2100910 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:52.576416 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-59a7d5d7-a0eb-4cf2-98fc-8983a2100910 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:52.785549 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a7d5d7-a0eb-4cf2-98fc-8983a2100910 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:52.799598 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a291d7-ba2c-44b2-87e5-f5957f547fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:52.801096 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a291d7-ba2c-44b2-87e5-f5957f547fe0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:52.801492 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a291d7-ba2c-44b2-87e5-f5957f547fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:52.801870 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a291d7-ba2c-44b2-87e5-f5957f547fe0 admin admin] PATH_INFO: `/v3/users/70e330aaac8a48f38799a4b386fb6492` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:52.803924 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a291d7-ba2c-44b2-87e5-f5957f547fe0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70e330aaac8a48f38799a4b386fb6492)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:52.809037 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a291d7-ba2c-44b2-87e5-f5957f547fe0 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:52.827170 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ccac71-dc23-4ee1-aa55-dd432bb6d124 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:52.842700 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eb7828-499f-4ffb-80f6-b132f549e97d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:52.843406 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eb7828-499f-4ffb-80f6-b132f549e97d admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:52.843685 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eb7828-499f-4ffb-80f6-b132f549e97d admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:52.843985 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eb7828-499f-4ffb-80f6-b132f549e97d admin admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:52.844874 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eb7828-499f-4ffb-80f6-b132f549e97d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:52.846776 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eb7828-499f-4ffb-80f6-b132f549e97d admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:52.876381 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 858/1721] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:15:52 2022] GET /identity/v3/roles => generated 1420 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:15:52.877947 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cf120b-8a88-4174-a566-3f18e9476952 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:52.878241 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cf120b-8a88-4174-a566-3f18e9476952 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:52.878523 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cf120b-8a88-4174-a566-3f18e9476952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:52.928795 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-52cf120b-8a88-4174-a566-3f18e9476952 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:15:52.930348 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-52cf120b-8a88-4174-a566-3f18e9476952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:52.941824 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-33a291d7-ba2c-44b2-87e5-f5957f547fe0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70e330aaac8a48f38799a4b386fb6492'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:15:52.942568 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-33a291d7-ba2c-44b2-87e5-f5957f547fe0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70e330aaac8a48f38799a4b386fb6492'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:15:52.960260 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 859/1722] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:15:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:15:52.961981 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cf120b-8a88-4174-a566-3f18e9476952 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:52.963589 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-52cf120b-8a88-4174-a566-3f18e9476952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:52.973773 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-33a291d7-ba2c-44b2-87e5-f5957f547fe0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70e330aaac8a48f38799a4b386fb6492'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:15:52.999426 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-33a291d7-ba2c-44b2-87e5-f5957f547fe0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70e330aaac8a48f38799a4b386fb6492'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:15:53.008019 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-33a291d7-ba2c-44b2-87e5-f5957f547fe0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70e330aaac8a48f38799a4b386fb6492'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:15:53.010312 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cf120b-8a88-4174-a566-3f18e9476952 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:53.023916 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc37df2-6e37-4516-82f6-d8bff4a06ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:53.024622 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc37df2-6e37-4516-82f6-d8bff4a06ba6 admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:53.024903 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc37df2-6e37-4516-82f6-d8bff4a06ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:53.025175 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc37df2-6e37-4516-82f6-d8bff4a06ba6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:53.025911 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc37df2-6e37-4516-82f6-d8bff4a06ba6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:53.033606 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc37df2-6e37-4516-82f6-d8bff4a06ba6 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:53.042386 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 864/1723] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Mar 30 07:15:52 2022] DELETE /identity/v3/users/70e330aaac8a48f38799a4b386fb6492 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:15:53.045870 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dedcde-2e4c-45d2-b93c-77dceca4166a None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:53.046717 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dedcde-2e4c-45d2-b93c-77dceca4166a None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:53.046994 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dedcde-2e4c-45d2-b93c-77dceca4166a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:53.061346 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 860/1724] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:15:52 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:15:53.066257 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc37df2-6e37-4516-82f6-d8bff4a06ba6 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:53.116612 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc37df2-6e37-4516-82f6-d8bff4a06ba6 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:53.118184 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-36dedcde-2e4c-45d2-b93c-77dceca4166a None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:15:53.126453 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-36dedcde-2e4c-45d2-b93c-77dceca4166a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:53.333085 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 865/1725] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:15:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:15:53.334222 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dedcde-2e4c-45d2-b93c-77dceca4166a None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:53.337231 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-36dedcde-2e4c-45d2-b93c-77dceca4166a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:53.360930 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e31a465-97a1-44b4-bea2-2f5db96bc1bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:53.361865 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e31a465-97a1-44b4-bea2-2f5db96bc1bd admin admin] REQUEST_METHOD: `PUT` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:53.362193 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e31a465-97a1-44b4-bea2-2f5db96bc1bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:53.362508 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e31a465-97a1-44b4-bea2-2f5db96bc1bd admin admin] PATH_INFO: `/v3/projects/56017e238c18411991786143ddfcc3a3/users/464213e067f84fe493455d80339f0242/roles/5d79031a64754b57ba120367465e2252` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:53.394391 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e31a465-97a1-44b4-bea2-2f5db96bc1bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=56017e238c18411991786143ddfcc3a3, user_id=464213e067f84fe493455d80339f0242, role_id=5d79031a64754b57ba120367465e2252)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:53.403414 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e31a465-97a1-44b4-bea2-2f5db96bc1bd admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:53.442507 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 861/1726] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:15:53 2022] PUT /identity/v3/projects/56017e238c18411991786143ddfcc3a3/users/464213e067f84fe493455d80339f0242/roles/5d79031a64754b57ba120367465e2252 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:15:53.444187 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e31a465-97a1-44b4-bea2-2f5db96bc1bd admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:53.507487 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dedcde-2e4c-45d2-b93c-77dceca4166a None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:53.559077 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e31a465-97a1-44b4-bea2-2f5db96bc1bd admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:53.632399 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8c35a0-77e6-4d7d-a2ad-5fc8eda3e0bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:53.633222 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8c35a0-77e6-4d7d-a2ad-5fc8eda3e0bc admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:53.633605 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8c35a0-77e6-4d7d-a2ad-5fc8eda3e0bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:53.633977 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8c35a0-77e6-4d7d-a2ad-5fc8eda3e0bc admin admin] PATH_INFO: `/v3/domains` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:53.634850 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8c35a0-77e6-4d7d-a2ad-5fc8eda3e0bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:15:53.635317 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8c35a0-77e6-4d7d-a2ad-5fc8eda3e0bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:53.637104 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8c35a0-77e6-4d7d-a2ad-5fc8eda3e0bc admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:53.701536 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 862/1727] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Mar 30 07:15:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:15:53.718316 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1f6c36-98f6-409a-a388-265e786a0afb None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:53.718711 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1f6c36-98f6-409a-a388-265e786a0afb None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:53.718858 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1f6c36-98f6-409a-a388-265e786a0afb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:53.795544 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114bcadd-24fa-4246-90dc-00b7c075126c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72b398c5ed14484d8b7a51fee900597b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:53.798320 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114bcadd-24fa-4246-90dc-00b7c075126c service nova] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:53.798320 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114bcadd-24fa-4246-90dc-00b7c075126c service nova] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:53.798320 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114bcadd-24fa-4246-90dc-00b7c075126c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:53.810129 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-114bcadd-24fa-4246-90dc-00b7c075126c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:53.823930 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114bcadd-24fa-4246-90dc-00b7c075126c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:53.825956 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114bcadd-24fa-4246-90dc-00b7c075126c service nova] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:53.839613 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 866/1728] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:15:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:15:53.842382 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-9a1f6c36-98f6-409a-a388-265e786a0afb None None] MFA Rules not processed for user `464213e067f84fe493455d80339f0242`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:15:53.844326 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-9a1f6c36-98f6-409a-a388-265e786a0afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:53.850964 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114bcadd-24fa-4246-90dc-00b7c075126c service nova] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:53.876844 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114bcadd-24fa-4246-90dc-00b7c075126c service nova] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:53.897598 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d83b29-5094-4a15-a5bc-eb7ef43adc00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:53.898576 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d83b29-5094-4a15-a5bc-eb7ef43adc00 admin admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:53.899009 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d83b29-5094-4a15-a5bc-eb7ef43adc00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:53.899425 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d83b29-5094-4a15-a5bc-eb7ef43adc00 admin admin] PATH_INFO: `/v3/projects` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:53.900459 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d83b29-5094-4a15-a5bc-eb7ef43adc00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:53.902648 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d83b29-5094-4a15-a5bc-eb7ef43adc00 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:53.989513 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 867/1729] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Mar 30 07:15:53 2022] POST /identity/v3/projects => generated 375 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:15:53.994499 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d83b29-5094-4a15-a5bc-eb7ef43adc00 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:54.114853 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 863/1730] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:15:53 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 415 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:15:54.119172 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1f6c36-98f6-409a-a388-265e786a0afb None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:54.150736 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1f6c36-98f6-409a-a388-265e786a0afb None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:54.234368 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d83b29-5094-4a15-a5bc-eb7ef43adc00 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:54.254409 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fc3773-b86a-4e65-a626-f139a7193e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:54.254814 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fc3773-b86a-4e65-a626-f139a7193e0b admin admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:54.255070 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fc3773-b86a-4e65-a626-f139a7193e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:54.255343 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fc3773-b86a-4e65-a626-f139a7193e0b admin admin] PATH_INFO: `/v3/users` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:54.256283 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fc3773-b86a-4e65-a626-f139a7193e0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:54.258236 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fc3773-b86a-4e65-a626-f139a7193e0b admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:54.336469 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 868/1731] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Mar 30 07:15:53 2022] POST /identity/v3/users => generated 288 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:15:54.343181 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fc3773-b86a-4e65-a626-f139a7193e0b admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:54.360821 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8b04ee-3cf1-407c-b760-f788813f290e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:54.361804 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8b04ee-3cf1-407c-b760-f788813f290e admin admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:54.362461 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8b04ee-3cf1-407c-b760-f788813f290e admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:54.362542 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8b04ee-3cf1-407c-b760-f788813f290e admin admin] PATH_INFO: `/v3/projects` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:54.364349 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8b04ee-3cf1-407c-b760-f788813f290e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:54.366449 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8b04ee-3cf1-407c-b760-f788813f290e admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:54.369609 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fc3773-b86a-4e65-a626-f139a7193e0b admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:54.381861 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d419ed2-7a2f-455c-9093-cc8c953c0f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:54.381861 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d419ed2-7a2f-455c-9093-cc8c953c0f08 admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:54.382173 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d419ed2-7a2f-455c-9093-cc8c953c0f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:54.382501 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d419ed2-7a2f-455c-9093-cc8c953c0f08 admin admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:54.383437 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d419ed2-7a2f-455c-9093-cc8c953c0f08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:54.384994 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d419ed2-7a2f-455c-9093-cc8c953c0f08 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:54.410015 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 869/1732] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:15:54 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:15:54.412118 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d419ed2-7a2f-455c-9093-cc8c953c0f08 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:54.435329 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 864/1733] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Mar 30 07:15:54 2022] POST /identity/v3/projects => generated 377 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 07:15:54.439774 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8b04ee-3cf1-407c-b760-f788813f290e admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:54.446033 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d419ed2-7a2f-455c-9093-cc8c953c0f08 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:54.583351 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8b04ee-3cf1-407c-b760-f788813f290e admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:54.607608 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c9477c-5064-4f4c-9e09-9de3a342e970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:54.608830 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c9477c-5064-4f4c-9e09-9de3a342e970 admin admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:54.609112 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c9477c-5064-4f4c-9e09-9de3a342e970 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:54.609378 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c9477c-5064-4f4c-9e09-9de3a342e970 admin admin] PATH_INFO: `/v3/users` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:54.610268 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c9477c-5064-4f4c-9e09-9de3a342e970 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:54.614032 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c9477c-5064-4f4c-9e09-9de3a342e970 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:54.617612 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db632d47-d756-4739-8ca1-bccc7540eb3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:54.618850 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db632d47-d756-4739-8ca1-bccc7540eb3f admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:54.622290 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db632d47-d756-4739-8ca1-bccc7540eb3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:54.622552 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db632d47-d756-4739-8ca1-bccc7540eb3f admin admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:54.624842 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db632d47-d756-4739-8ca1-bccc7540eb3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:54.629226 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db632d47-d756-4739-8ca1-bccc7540eb3f admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:54.654507 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 865/1734] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Mar 30 07:15:54 2022] POST /identity/v3/users => generated 289 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 07:15:54.655721 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c9477c-5064-4f4c-9e09-9de3a342e970 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:54.666074 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 870/1735] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:15:54 2022] GET /identity/v3/roles => generated 1420 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:15:54.669469 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db632d47-d756-4739-8ca1-bccc7540eb3f admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:54.673264 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c9477c-5064-4f4c-9e09-9de3a342e970 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:54.703192 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb011407-8674-41c9-a2d1-5e13ce116a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:54.706628 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb011407-8674-41c9-a2d1-5e13ce116a67 admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:54.707133 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb011407-8674-41c9-a2d1-5e13ce116a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:54.708646 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb011407-8674-41c9-a2d1-5e13ce116a67 admin admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:54.709437 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb011407-8674-41c9-a2d1-5e13ce116a67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:54.711512 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb011407-8674-41c9-a2d1-5e13ce116a67 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:54.718647 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db632d47-d756-4739-8ca1-bccc7540eb3f admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:54.739050 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 866/1736] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:15:54 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:15:54.739272 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7662c36-1024-4491-a0a2-5ff59d529618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:54.740007 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7662c36-1024-4491-a0a2-5ff59d529618 admin admin] REQUEST_METHOD: `PUT` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:54.740261 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb011407-8674-41c9-a2d1-5e13ce116a67 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:54.745657 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7662c36-1024-4491-a0a2-5ff59d529618 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:54.747205 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7662c36-1024-4491-a0a2-5ff59d529618 admin admin] PATH_INFO: `/v3/projects/4c36bf930e2e48b3b529cc2f1fa1b4a1/users/31a7cb97ea454c5eb50adfa15cd69058/roles/5d79031a64754b57ba120367465e2252` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:54.784806 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb011407-8674-41c9-a2d1-5e13ce116a67 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:54.787158 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7662c36-1024-4491-a0a2-5ff59d529618 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c36bf930e2e48b3b529cc2f1fa1b4a1, user_id=31a7cb97ea454c5eb50adfa15cd69058, role_id=5d79031a64754b57ba120367465e2252)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:54.795166 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7662c36-1024-4491-a0a2-5ff59d529618 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:54.799159 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c391b55-d9c7-4d57-82f3-d14f479f0534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:54.800041 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c391b55-d9c7-4d57-82f3-d14f479f0534 admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:54.800329 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c391b55-d9c7-4d57-82f3-d14f479f0534 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:54.800602 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c391b55-d9c7-4d57-82f3-d14f479f0534 admin admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:54.801339 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c391b55-d9c7-4d57-82f3-d14f479f0534 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:54.807942 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c391b55-d9c7-4d57-82f3-d14f479f0534 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:54.831451 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 871/1737] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:15:54 2022] PUT /identity/v3/projects/4c36bf930e2e48b3b529cc2f1fa1b4a1/users/31a7cb97ea454c5eb50adfa15cd69058/roles/5d79031a64754b57ba120367465e2252 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:15:54.835367 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8203309c-717b-4f45-9588-12767e9bd6d2 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:54.835853 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8203309c-717b-4f45-9588-12767e9bd6d2 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:54.836327 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8203309c-717b-4f45-9588-12767e9bd6d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:54.852481 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 867/1738] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:15:54 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:15:54.856243 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c391b55-d9c7-4d57-82f3-d14f479f0534 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:54.872681 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c391b55-d9c7-4d57-82f3-d14f479f0534 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:54.903409 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-8203309c-717b-4f45-9588-12767e9bd6d2 None None] MFA Rules not processed for user `31a7cb97ea454c5eb50adfa15cd69058`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:15:54.905123 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-8203309c-717b-4f45-9588-12767e9bd6d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:54.988850 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e721e166-d557-43be-80e5-a6def173b3b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:54.990207 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e721e166-d557-43be-80e5-a6def173b3b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:54.990872 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e721e166-d557-43be-80e5-a6def173b3b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:54.990872 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e721e166-d557-43be-80e5-a6def173b3b7 admin admin] PATH_INFO: `/v3/projects/fe32a888f4ad4ea2b4e44254db9e7524/users/4f0995ac812a4fd79b00d7c1b580166a/roles/5d79031a64754b57ba120367465e2252` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:55.025875 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e721e166-d557-43be-80e5-a6def173b3b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe32a888f4ad4ea2b4e44254db9e7524, user_id=4f0995ac812a4fd79b00d7c1b580166a, role_id=5d79031a64754b57ba120367465e2252)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:55.030113 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e721e166-d557-43be-80e5-a6def173b3b7 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:55.056435 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 872/1739] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:15:54 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:15:55.072899 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 868/1740] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:15:54 2022] PUT /identity/v3/projects/fe32a888f4ad4ea2b4e44254db9e7524/users/4f0995ac812a4fd79b00d7c1b580166a/roles/5d79031a64754b57ba120367465e2252 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:15:55.079765 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8ebebb-fefa-433a-9ad6-c6cd7a44c083 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:55.082397 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8ebebb-fefa-433a-9ad6-c6cd7a44c083 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:55.082809 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8ebebb-fefa-433a-9ad6-c6cd7a44c083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:55.138286 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-6f8ebebb-fefa-433a-9ad6-c6cd7a44c083 None None] MFA Rules not processed for user `4f0995ac812a4fd79b00d7c1b580166a`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:15:55.139972 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-6f8ebebb-fefa-433a-9ad6-c6cd7a44c083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:55.250751 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 873/1741] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:15:55 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:15:55.255117 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e721e166-d557-43be-80e5-a6def173b3b7 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:55.345529 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e721e166-d557-43be-80e5-a6def173b3b7 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:55.359632 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b964463-d3ce-4873-b7e8-90507eb2375c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:55.359632 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b964463-d3ce-4873-b7e8-90507eb2375c admin admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:55.359632 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b964463-d3ce-4873-b7e8-90507eb2375c admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:55.359632 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b964463-d3ce-4873-b7e8-90507eb2375c admin admin] PATH_INFO: `/v3/projects` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:55.360062 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b964463-d3ce-4873-b7e8-90507eb2375c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:55.360062 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b964463-d3ce-4873-b7e8-90507eb2375c admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:55.370249 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8ebebb-fefa-433a-9ad6-c6cd7a44c083 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:55.372776 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-6f8ebebb-fefa-433a-9ad6-c6cd7a44c083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:55.391213 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 869/1742] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Mar 30 07:15:55 2022] POST /identity/v3/projects => generated 379 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:15:55.392788 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b964463-d3ce-4873-b7e8-90507eb2375c admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:55.531430 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b964463-d3ce-4873-b7e8-90507eb2375c admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:55.539179 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80be58eb-fb14-4732-9123-5826a63ad3c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:55.539985 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80be58eb-fb14-4732-9123-5826a63ad3c7 admin admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:55.540273 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80be58eb-fb14-4732-9123-5826a63ad3c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:55.540559 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80be58eb-fb14-4732-9123-5826a63ad3c7 admin admin] PATH_INFO: `/v3/users` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:55.541526 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80be58eb-fb14-4732-9123-5826a63ad3c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:55.544394 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80be58eb-fb14-4732-9123-5826a63ad3c7 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:55.547406 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8ebebb-fefa-433a-9ad6-c6cd7a44c083 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:55.577256 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 870/1743] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Mar 30 07:15:55 2022] POST /identity/v3/users => generated 296 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 07:15:55.581370 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80be58eb-fb14-4732-9123-5826a63ad3c7 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:55.593434 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80be58eb-fb14-4732-9123-5826a63ad3c7 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:55.604572 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ce50e8-11bd-4509-b0ac-924f9bc757c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:55.605553 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ce50e8-11bd-4509-b0ac-924f9bc757c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:55.606095 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ce50e8-11bd-4509-b0ac-924f9bc757c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:55.606831 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ce50e8-11bd-4509-b0ac-924f9bc757c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:55.607724 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ce50e8-11bd-4509-b0ac-924f9bc757c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:55.609687 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ce50e8-11bd-4509-b0ac-924f9bc757c9 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:55.625947 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 871/1744] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:15:55 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:15:55.628492 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ce50e8-11bd-4509-b0ac-924f9bc757c9 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:55.651076 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ce50e8-11bd-4509-b0ac-924f9bc757c9 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:55.664719 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50629fd-f700-4693-9f62-8788e380dfdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:55.668120 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50629fd-f700-4693-9f62-8788e380dfdf admin admin] REQUEST_METHOD: `PUT` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:55.668457 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50629fd-f700-4693-9f62-8788e380dfdf admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:55.669241 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cc60ad-d394-49ed-873c-5202e1e86e93 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72b398c5ed14484d8b7a51fee900597b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:55.669508 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50629fd-f700-4693-9f62-8788e380dfdf admin admin] PATH_INFO: `/v3/projects/afcd4fc046cd411c9b0ba52cfd131331/users/f1669554db804a6a97fad6e331df7ecd/roles/1c39b9ab8cfd4c0ea71845831920a845` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:55.670374 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc60ad-d394-49ed-873c-5202e1e86e93 service nova] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:55.670753 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc60ad-d394-49ed-873c-5202e1e86e93 service nova] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:55.671244 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc60ad-d394-49ed-873c-5202e1e86e93 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:55.703755 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50629fd-f700-4693-9f62-8788e380dfdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=afcd4fc046cd411c9b0ba52cfd131331, user_id=f1669554db804a6a97fad6e331df7ecd, role_id=1c39b9ab8cfd4c0ea71845831920a845)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:55.707842 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50629fd-f700-4693-9f62-8788e380dfdf admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:55.739852 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 872/1745] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:15:55 2022] PUT /identity/v3/projects/afcd4fc046cd411c9b0ba52cfd131331/users/f1669554db804a6a97fad6e331df7ecd/roles/1c39b9ab8cfd4c0ea71845831920a845 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:15:55.743345 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50629fd-f700-4693-9f62-8788e380dfdf admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:55.748257 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cc60ad-d394-49ed-873c-5202e1e86e93 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:55.750093 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cc60ad-d394-49ed-873c-5202e1e86e93 service nova] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:55.764619 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 874/1746] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:15:55 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 30 07:15:55.808065 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cc60ad-d394-49ed-873c-5202e1e86e93 service nova] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:55.809916 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-49cc60ad-d394-49ed-873c-5202e1e86e93 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:55.835389 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cc60ad-d394-49ed-873c-5202e1e86e93 service nova] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:55.911989 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50629fd-f700-4693-9f62-8788e380dfdf admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:55.927422 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be749a6f-259e-46ea-b7bc-49515a83f21c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:55.928309 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be749a6f-259e-46ea-b7bc-49515a83f21c admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:55.928765 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be749a6f-259e-46ea-b7bc-49515a83f21c admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:55.929208 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be749a6f-259e-46ea-b7bc-49515a83f21c admin admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:55.933131 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be749a6f-259e-46ea-b7bc-49515a83f21c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:55.937698 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be749a6f-259e-46ea-b7bc-49515a83f21c admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:55.969233 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 873/1747] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:15:55 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:15:55.982354 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be749a6f-259e-46ea-b7bc-49515a83f21c admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:56.012431 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d309ab-59cf-4fc2-b9d8-21c4ffe0d216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:56.014071 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d309ab-59cf-4fc2-b9d8-21c4ffe0d216 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:56.014421 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d309ab-59cf-4fc2-b9d8-21c4ffe0d216 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:56.014759 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d309ab-59cf-4fc2-b9d8-21c4ffe0d216 admin admin] PATH_INFO: `/v3/projects/7cbefe28e05841d1834721f8808d15f1` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:56.016253 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d309ab-59cf-4fc2-b9d8-21c4ffe0d216 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cbefe28e05841d1834721f8808d15f1)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:56.018917 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d309ab-59cf-4fc2-b9d8-21c4ffe0d216 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:56.065353 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be749a6f-259e-46ea-b7bc-49515a83f21c admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:56.089551 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0efea9-593d-49c5-a147-6fbc3ab1b155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:56.093188 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0efea9-593d-49c5-a147-6fbc3ab1b155 admin admin] REQUEST_METHOD: `PUT` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:56.093983 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0efea9-593d-49c5-a147-6fbc3ab1b155 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:56.094273 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0efea9-593d-49c5-a147-6fbc3ab1b155 admin admin] PATH_INFO: `/v3/projects/afcd4fc046cd411c9b0ba52cfd131331/users/f1669554db804a6a97fad6e331df7ecd/roles/1c39b9ab8cfd4c0ea71845831920a845` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:56.101869 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0efea9-593d-49c5-a147-6fbc3ab1b155 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afcd4fc046cd411c9b0ba52cfd131331, user_id=f1669554db804a6a97fad6e331df7ecd, role_id=1c39b9ab8cfd4c0ea71845831920a845)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:56.112841 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0efea9-593d-49c5-a147-6fbc3ab1b155 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:56.141250 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-f7d309ab-59cf-4fc2-b9d8-21c4ffe0d216 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cbefe28e05841d1834721f8808d15f1', 'request_id': 'req-f7d309ab-59cf-4fc2-b9d8-21c4ffe0d216'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:15:56.141967 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 874/1748] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:15:55 2022] PUT /identity/v3/projects/afcd4fc046cd411c9b0ba52cfd131331/users/f1669554db804a6a97fad6e331df7ecd/roles/1c39b9ab8cfd4c0ea71845831920a845 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:15:56.144624 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0efea9-593d-49c5-a147-6fbc3ab1b155 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:56.162272 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-f7d309ab-59cf-4fc2-b9d8-21c4ffe0d216 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cbefe28e05841d1834721f8808d15f1', 'request_id': 'req-f7d309ab-59cf-4fc2-b9d8-21c4ffe0d216'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:15:56.173115 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-f7d309ab-59cf-4fc2-b9d8-21c4ffe0d216 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cbefe28e05841d1834721f8808d15f1', 'request_id': 'req-f7d309ab-59cf-4fc2-b9d8-21c4ffe0d216'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:15:56.221407 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-f7d309ab-59cf-4fc2-b9d8-21c4ffe0d216 admin admin] The token cache is being invalidate because project 7cbefe28e05841d1834721f8808d15f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79960) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 07:15:56.221837 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-f7d309ab-59cf-4fc2-b9d8-21c4ffe0d216 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:15:56.222603 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-f7d309ab-59cf-4fc2-b9d8-21c4ffe0d216 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:15:56.227864 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 875/1749] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Mar 30 07:15:55 2022] DELETE /identity/v3/projects/7cbefe28e05841d1834721f8808d15f1 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:15:56.228638 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad60751d-c39d-4ea3-a9ab-3ffce0ba75be None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:56.230120 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad60751d-c39d-4ea3-a9ab-3ffce0ba75be None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:56.232017 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad60751d-c39d-4ea3-a9ab-3ffce0ba75be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:56.314142 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-ad60751d-c39d-4ea3-a9ab-3ffce0ba75be None None] MFA Rules not processed for user `f1669554db804a6a97fad6e331df7ecd`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:15:56.315495 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-ad60751d-c39d-4ea3-a9ab-3ffce0ba75be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:56.327252 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0efea9-593d-49c5-a147-6fbc3ab1b155 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:56.341369 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00584d87-af24-47ba-8d66-633decd53b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:56.343723 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00584d87-af24-47ba-8d66-633decd53b40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:56.345014 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00584d87-af24-47ba-8d66-633decd53b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:56.346251 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00584d87-af24-47ba-8d66-633decd53b40 admin admin] PATH_INFO: `/v3/users/31a7cb97ea454c5eb50adfa15cd69058` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:56.350254 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00584d87-af24-47ba-8d66-633decd53b40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31a7cb97ea454c5eb50adfa15cd69058)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:56.352312 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00584d87-af24-47ba-8d66-633decd53b40 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:56.505971 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-00584d87-af24-47ba-8d66-633decd53b40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31a7cb97ea454c5eb50adfa15cd69058'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:15:56.507100 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-00584d87-af24-47ba-8d66-633decd53b40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31a7cb97ea454c5eb50adfa15cd69058'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:15:56.509529 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-00584d87-af24-47ba-8d66-633decd53b40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31a7cb97ea454c5eb50adfa15cd69058'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:15:56.533103 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-00584d87-af24-47ba-8d66-633decd53b40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31a7cb97ea454c5eb50adfa15cd69058'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:15:56.542927 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 876/1750] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:15:56 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:15:56.542927 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde116d-f46c-4098-a1f5-1ab66203f2dc None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:56.542927 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde116d-f46c-4098-a1f5-1ab66203f2dc None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:56.542927 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde116d-f46c-4098-a1f5-1ab66203f2dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:56.562886 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-00584d87-af24-47ba-8d66-633decd53b40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31a7cb97ea454c5eb50adfa15cd69058'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:15:56.567766 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-ccde116d-f46c-4098-a1f5-1ab66203f2dc None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:15:56.569315 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-ccde116d-f46c-4098-a1f5-1ab66203f2dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:56.580801 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 877/1751] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:15:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:15:56.582254 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccde116d-f46c-4098-a1f5-1ab66203f2dc None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:56.584248 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-ccde116d-f46c-4098-a1f5-1ab66203f2dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:56.620859 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 875/1752] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Mar 30 07:15:56 2022] DELETE /identity/v3/users/31a7cb97ea454c5eb50adfa15cd69058 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:15:56.627522 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aa76b4-2678-4d40-9dd7-c543d99cbb78 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:56.630205 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aa76b4-2678-4d40-9dd7-c543d99cbb78 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:56.630586 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aa76b4-2678-4d40-9dd7-c543d99cbb78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:56.676449 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccde116d-f46c-4098-a1f5-1ab66203f2dc None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:56.693899 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-20aa76b4-2678-4d40-9dd7-c543d99cbb78 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:15:56.701837 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-20aa76b4-2678-4d40-9dd7-c543d99cbb78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:56.749682 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1fcdb6-d3f4-469c-816b-3f5c5f0d4d71 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e2fda180e8d448d895c40cdad34bc4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:56.750395 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1fcdb6-d3f4-469c-816b-3f5c5f0d4d71 service cinder] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:56.750677 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1fcdb6-d3f4-469c-816b-3f5c5f0d4d71 service cinder] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:56.750951 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1fcdb6-d3f4-469c-816b-3f5c5f0d4d71 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:56.753062 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-df1fcdb6-d3f4-469c-816b-3f5c5f0d4d71 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:56.846354 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 876/1753] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:15:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:15:56.852408 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd30d0-d316-4676-b4bf-3c05e998bf2e None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:56.854243 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd30d0-d316-4676-b4bf-3c05e998bf2e None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:56.856245 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd30d0-d316-4676-b4bf-3c05e998bf2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:56.863100 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1fcdb6-d3f4-469c-816b-3f5c5f0d4d71 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:56.865004 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1fcdb6-d3f4-469c-816b-3f5c5f0d4d71 service cinder] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:56.877675 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 878/1754] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:15:56 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:15:56.879472 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1fcdb6-d3f4-469c-816b-3f5c5f0d4d71 service cinder] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:56.895332 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1fcdb6-d3f4-469c-816b-3f5c5f0d4d71 service cinder] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:56.896586 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-04cd30d0-d316-4676-b4bf-3c05e998bf2e None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:15:56.900501 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-04cd30d0-d316-4676-b4bf-3c05e998bf2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:56.903727 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a255460-3e6f-41a3-bb62-b9fc6c66cc44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:56.907246 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a255460-3e6f-41a3-bb62-b9fc6c66cc44 admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:56.907830 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a255460-3e6f-41a3-bb62-b9fc6c66cc44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:56.908451 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a255460-3e6f-41a3-bb62-b9fc6c66cc44 admin admin] PATH_INFO: `/v3/domains` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:56.909715 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a255460-3e6f-41a3-bb62-b9fc6c66cc44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:15:56.910245 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a255460-3e6f-41a3-bb62-b9fc6c66cc44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:56.912355 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a255460-3e6f-41a3-bb62-b9fc6c66cc44 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:56.921587 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 877/1755] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:15:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:15:56.937722 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 879/1756] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Mar 30 07:15:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:15:56.938348 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cd30d0-d316-4676-b4bf-3c05e998bf2e None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:56.957733 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cd30d0-d316-4676-b4bf-3c05e998bf2e None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:56.971280 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a255460-3e6f-41a3-bb62-b9fc6c66cc44 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:56.971713 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9e07e9-185a-451f-bedc-a60d63630db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:56.972417 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9e07e9-185a-451f-bedc-a60d63630db6 admin admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:56.972699 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9e07e9-185a-451f-bedc-a60d63630db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:56.972973 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9e07e9-185a-451f-bedc-a60d63630db6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:56.973678 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9e07e9-185a-451f-bedc-a60d63630db6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:56.976036 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9e07e9-185a-451f-bedc-a60d63630db6 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:56.984953 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a255460-3e6f-41a3-bb62-b9fc6c66cc44 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:56.996461 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5708f5b0-d2a5-4cd1-ba57-4eb1204c6fd4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e2fda180e8d448d895c40cdad34bc4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:56.998123 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5708f5b0-d2a5-4cd1-ba57-4eb1204c6fd4 service cinder] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:56.998832 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5708f5b0-d2a5-4cd1-ba57-4eb1204c6fd4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:56.999132 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5708f5b0-d2a5-4cd1-ba57-4eb1204c6fd4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:57.004396 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-5708f5b0-d2a5-4cd1-ba57-4eb1204c6fd4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:57.057530 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 878/1757] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Mar 30 07:15:56 2022] POST /identity/v3/projects => generated 369 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 07:15:57.058279 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9e07e9-185a-451f-bedc-a60d63630db6 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:57.075386 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-8c9e07e9-185a-451f-bedc-a60d63630db6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:57.168557 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5708f5b0-d2a5-4cd1-ba57-4eb1204c6fd4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:57.170981 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5708f5b0-d2a5-4cd1-ba57-4eb1204c6fd4 service cinder] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:57.202240 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 880/1758] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:15:56 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 30 07:15:57.204026 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d9f8a-4b71-4299-89fe-ed411ce8304d None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:57.205131 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d9f8a-4b71-4299-89fe-ed411ce8304d None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:57.205416 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d9f8a-4b71-4299-89fe-ed411ce8304d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:57.210807 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9e07e9-185a-451f-bedc-a60d63630db6 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:57.224023 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7904f0-c74c-4414-aaa7-8353a890cec1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3802cb341445f994b9204744060ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:57.224791 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7904f0-c74c-4414-aaa7-8353a890cec1 service neutron] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:57.224971 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7904f0-c74c-4414-aaa7-8353a890cec1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:57.225246 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7904f0-c74c-4414-aaa7-8353a890cec1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:57.229356 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-280d9f8a-4b71-4299-89fe-ed411ce8304d None None] MFA Rules not processed for user `8dd9d32c47014294a367654b57c96f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:15:57.230856 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-280d9f8a-4b71-4299-89fe-ed411ce8304d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:57.382219 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 881/1759] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:15:57 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:15:57.383126 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280d9f8a-4b71-4299-89fe-ed411ce8304d None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:57.473485 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7904f0-c74c-4414-aaa7-8353a890cec1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:57.474968 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7904f0-c74c-4414-aaa7-8353a890cec1 service neutron] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:57.505236 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 879/1760] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:15:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:15:57.506520 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca1ef8-5229-42ef-8961-43e630fc74e9 None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:57.507125 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca1ef8-5229-42ef-8961-43e630fc74e9 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:57.507286 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca1ef8-5229-42ef-8961-43e630fc74e9 None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:57.510003 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 880/1761] 10.222.0.20 () {54 vars in 921 bytes} [Wed Mar 30 07:15:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:15:57.586685 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280d9f8a-4b71-4299-89fe-ed411ce8304d None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:57.596517 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ec99a-04c9-47a2-a82a-ab3df5eee1c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:57.600063 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ec99a-04c9-47a2-a82a-ab3df5eee1c5 admin admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:57.601246 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ec99a-04c9-47a2-a82a-ab3df5eee1c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:57.601754 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ec99a-04c9-47a2-a82a-ab3df5eee1c5 admin admin] PATH_INFO: `/v3/users` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:57.603594 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303ec99a-04c9-47a2-a82a-ab3df5eee1c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:57.603722 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40b38aa-f596-40d5-a0db-9db1d5206eac None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:57.604218 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40b38aa-f596-40d5-a0db-9db1d5206eac None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:57.604317 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40b38aa-f596-40d5-a0db-9db1d5206eac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:57.606743 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303ec99a-04c9-47a2-a82a-ab3df5eee1c5 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:57.637516 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-a40b38aa-f596-40d5-a0db-9db1d5206eac None None] MFA Rules not processed for user `72b398c5ed14484d8b7a51fee900597b`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:15:57.641452 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-a40b38aa-f596-40d5-a0db-9db1d5206eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:57.642658 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 882/1762] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Mar 30 07:15:57 2022] POST /identity/v3/users => generated 285 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:15:57.650458 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ec99a-04c9-47a2-a82a-ab3df5eee1c5 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:57.672194 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ec99a-04c9-47a2-a82a-ab3df5eee1c5 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:57.688714 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dd9123-ee74-49d0-8488-be3b57d27724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:57.689432 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dd9123-ee74-49d0-8488-be3b57d27724 admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:57.689704 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dd9123-ee74-49d0-8488-be3b57d27724 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:57.689972 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dd9123-ee74-49d0-8488-be3b57d27724 admin admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:57.690850 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dd9123-ee74-49d0-8488-be3b57d27724 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:57.692528 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dd9123-ee74-49d0-8488-be3b57d27724 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:57.720336 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 883/1763] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:15:57 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:15:57.721932 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dd9123-ee74-49d0-8488-be3b57d27724 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:57.749163 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dd9123-ee74-49d0-8488-be3b57d27724 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:57.757561 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 881/1764] 10.222.0.20 () {58 vars in 1018 bytes} [Wed Mar 30 07:15:57 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:15:57.762497 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addb5052-a113-455b-9be4-093b7335cec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:57.763307 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addb5052-a113-455b-9be4-093b7335cec2 admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:57.763707 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addb5052-a113-455b-9be4-093b7335cec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:57.764140 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addb5052-a113-455b-9be4-093b7335cec2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:57.765030 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addb5052-a113-455b-9be4-093b7335cec2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:57.766876 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addb5052-a113-455b-9be4-093b7335cec2 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:57.779564 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 884/1765] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:15:57 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:15:57.783745 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40b38aa-f596-40d5-a0db-9db1d5206eac None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:57.796023 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40b38aa-f596-40d5-a0db-9db1d5206eac None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:57.804379 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81995d7e-bd27-4150-b097-3eee1719db24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:57.805459 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81995d7e-bd27-4150-b097-3eee1719db24 admin admin] REQUEST_METHOD: `PUT` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:57.805890 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81995d7e-bd27-4150-b097-3eee1719db24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:57.806160 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81995d7e-bd27-4150-b097-3eee1719db24 admin admin] PATH_INFO: `/v3/projects/a276bf3abcf749a39e77fb1f04e11edf/users/a248e0d1f586454b80522ca7ab36343d/roles/5d79031a64754b57ba120367465e2252` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:57.822193 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81995d7e-bd27-4150-b097-3eee1719db24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a276bf3abcf749a39e77fb1f04e11edf, user_id=a248e0d1f586454b80522ca7ab36343d, role_id=5d79031a64754b57ba120367465e2252)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:57.825781 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81995d7e-bd27-4150-b097-3eee1719db24 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:57.846732 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 882/1766] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:15:57 2022] PUT /identity/v3/projects/a276bf3abcf749a39e77fb1f04e11edf/users/a248e0d1f586454b80522ca7ab36343d/roles/5d79031a64754b57ba120367465e2252 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 07:15:57.858141 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab5c087-2368-43eb-b298-50976586f52d None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:57.858141 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab5c087-2368-43eb-b298-50976586f52d None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:57.858341 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab5c087-2368-43eb-b298-50976586f52d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:57.891648 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-6ab5c087-2368-43eb-b298-50976586f52d None None] MFA Rules not processed for user `a248e0d1f586454b80522ca7ab36343d`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:15:57.893069 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-6ab5c087-2368-43eb-b298-50976586f52d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:57.977045 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 885/1767] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:15:57 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:15:57.981894 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81995d7e-bd27-4150-b097-3eee1719db24 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:58.072342 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81995d7e-bd27-4150-b097-3eee1719db24 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:58.078637 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12b838a-b6c2-4564-bbee-d89065efc04c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:58.079319 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12b838a-b6c2-4564-bbee-d89065efc04c admin admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:58.079595 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12b838a-b6c2-4564-bbee-d89065efc04c admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:58.079898 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12b838a-b6c2-4564-bbee-d89065efc04c admin admin] PATH_INFO: `/v3/projects` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:58.080814 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12b838a-b6c2-4564-bbee-d89065efc04c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:58.083418 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12b838a-b6c2-4564-bbee-d89065efc04c admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:58.139206 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 883/1768] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Mar 30 07:15:57 2022] POST /identity/v3/projects => generated 369 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:15:58.143320 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab5c087-2368-43eb-b298-50976586f52d None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:58.158119 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab5c087-2368-43eb-b298-50976586f52d None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:58.244498 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12b838a-b6c2-4564-bbee-d89065efc04c admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:58.246235 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9593aff-4ead-411d-bcec-bd174158df87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:58.246619 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-b12b838a-b6c2-4564-bbee-d89065efc04c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:58.247194 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9593aff-4ead-411d-bcec-bd174158df87 admin admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:58.247482 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9593aff-4ead-411d-bcec-bd174158df87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:58.247757 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9593aff-4ead-411d-bcec-bd174158df87 admin admin] PATH_INFO: `/v3/users` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:58.248485 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9593aff-4ead-411d-bcec-bd174158df87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:58.251051 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9593aff-4ead-411d-bcec-bd174158df87 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:58.286657 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 886/1769] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Mar 30 07:15:58 2022] POST /identity/v3/users => generated 291 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:15:58.290325 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9593aff-4ead-411d-bcec-bd174158df87 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:58.303249 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9593aff-4ead-411d-bcec-bd174158df87 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:58.308606 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491602e6-5476-410a-aa87-5e0ccfbb2890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:58.309546 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491602e6-5476-410a-aa87-5e0ccfbb2890 admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:58.310021 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491602e6-5476-410a-aa87-5e0ccfbb2890 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:58.310268 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491602e6-5476-410a-aa87-5e0ccfbb2890 admin admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:58.311197 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491602e6-5476-410a-aa87-5e0ccfbb2890 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:58.312782 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491602e6-5476-410a-aa87-5e0ccfbb2890 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:58.326374 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 887/1770] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:15:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:15:58.328616 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491602e6-5476-410a-aa87-5e0ccfbb2890 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:58.342929 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491602e6-5476-410a-aa87-5e0ccfbb2890 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:58.351706 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12b838a-b6c2-4564-bbee-d89065efc04c admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:58.352151 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbcbd42-5952-4230-af3e-d995968c0264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:58.353455 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbcbd42-5952-4230-af3e-d995968c0264 admin admin] REQUEST_METHOD: `PUT` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:58.353768 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbcbd42-5952-4230-af3e-d995968c0264 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:58.354189 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbcbd42-5952-4230-af3e-d995968c0264 admin admin] PATH_INFO: `/v3/projects/6859ff608e7e48a6bde9bd21b6a49865/users/64a97e31688f4836bd1fbacd9b08ab6e/roles/1c39b9ab8cfd4c0ea71845831920a845` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:58.362064 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a3de6a-41b3-4a4b-829f-98ab7bb888f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72b398c5ed14484d8b7a51fee900597b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:58.362758 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a3de6a-41b3-4a4b-829f-98ab7bb888f7 service nova] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:58.363363 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a3de6a-41b3-4a4b-829f-98ab7bb888f7 service nova] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:58.363735 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a3de6a-41b3-4a4b-829f-98ab7bb888f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:58.375328 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbcbd42-5952-4230-af3e-d995968c0264 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6859ff608e7e48a6bde9bd21b6a49865, user_id=64a97e31688f4836bd1fbacd9b08ab6e, role_id=1c39b9ab8cfd4c0ea71845831920a845)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:58.381677 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbcbd42-5952-4230-af3e-d995968c0264 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:58.397272 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a3de6a-41b3-4a4b-829f-98ab7bb888f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:58.401396 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a3de6a-41b3-4a4b-829f-98ab7bb888f7 service nova] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:58.407359 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 888/1771] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:15:58 2022] PUT /identity/v3/projects/6859ff608e7e48a6bde9bd21b6a49865/users/64a97e31688f4836bd1fbacd9b08ab6e/roles/1c39b9ab8cfd4c0ea71845831920a845 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:15:58.408014 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbcbd42-5952-4230-af3e-d995968c0264 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:58.413336 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-4dbcbd42-5952-4230-af3e-d995968c0264 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:58.431835 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 884/1772] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:15:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:15:58.435096 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a3de6a-41b3-4a4b-829f-98ab7bb888f7 service nova] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:58.460436 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a3de6a-41b3-4a4b-829f-98ab7bb888f7 service nova] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:58.508398 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbcbd42-5952-4230-af3e-d995968c0264 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:58.517865 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57612aa7-2f31-40ea-899f-77d51410339f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:58.521120 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57612aa7-2f31-40ea-899f-77d51410339f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:58.521423 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57612aa7-2f31-40ea-899f-77d51410339f admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:58.522152 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57612aa7-2f31-40ea-899f-77d51410339f admin admin] PATH_INFO: `/v3/projects/4c36bf930e2e48b3b529cc2f1fa1b4a1` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:58.523641 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57612aa7-2f31-40ea-899f-77d51410339f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c36bf930e2e48b3b529cc2f1fa1b4a1)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:58.527147 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57612aa7-2f31-40ea-899f-77d51410339f admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:58.583026 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b014ac88-17db-4915-8282-e94e5615d6c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:58.583743 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014ac88-17db-4915-8282-e94e5615d6c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:58.584133 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014ac88-17db-4915-8282-e94e5615d6c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:58.584399 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014ac88-17db-4915-8282-e94e5615d6c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:58.585126 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b014ac88-17db-4915-8282-e94e5615d6c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:58.587757 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b014ac88-17db-4915-8282-e94e5615d6c1 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:58.617177 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-57612aa7-2f31-40ea-899f-77d51410339f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c36bf930e2e48b3b529cc2f1fa1b4a1', 'request_id': 'req-57612aa7-2f31-40ea-899f-77d51410339f'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:15:58.620042 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 885/1773] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:15:58 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:15:58.628534 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b014ac88-17db-4915-8282-e94e5615d6c1 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:58.641571 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-57612aa7-2f31-40ea-899f-77d51410339f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c36bf930e2e48b3b529cc2f1fa1b4a1', 'request_id': 'req-57612aa7-2f31-40ea-899f-77d51410339f'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:15:58.642674 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b014ac88-17db-4915-8282-e94e5615d6c1 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:58.649687 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-57612aa7-2f31-40ea-899f-77d51410339f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c36bf930e2e48b3b529cc2f1fa1b4a1', 'request_id': 'req-57612aa7-2f31-40ea-899f-77d51410339f'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:15:58.665388 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-57612aa7-2f31-40ea-899f-77d51410339f admin admin] The token cache is being invalidate because project 4c36bf930e2e48b3b529cc2f1fa1b4a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79960) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 07:15:58.665978 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-57612aa7-2f31-40ea-899f-77d51410339f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:15:58.666876 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-57612aa7-2f31-40ea-899f-77d51410339f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:15:58.674618 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 889/1774] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Mar 30 07:15:58 2022] DELETE /identity/v3/projects/4c36bf930e2e48b3b529cc2f1fa1b4a1 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:15:58.676512 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788611e6-b64b-4b66-812e-e03e5977190e None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:58.676997 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788611e6-b64b-4b66-812e-e03e5977190e None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:58.677434 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788611e6-b64b-4b66-812e-e03e5977190e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:58.710230 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-788611e6-b64b-4b66-812e-e03e5977190e None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:15:58.713250 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-788611e6-b64b-4b66-812e-e03e5977190e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:58.735930 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16e4438-d0a1-4e63-9eb3-f3905b5575be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:58.736844 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16e4438-d0a1-4e63-9eb3-f3905b5575be admin admin] REQUEST_METHOD: `PUT` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:58.737162 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16e4438-d0a1-4e63-9eb3-f3905b5575be admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:58.737520 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16e4438-d0a1-4e63-9eb3-f3905b5575be admin admin] PATH_INFO: `/v3/projects/6859ff608e7e48a6bde9bd21b6a49865/users/64a97e31688f4836bd1fbacd9b08ab6e/roles/1c39b9ab8cfd4c0ea71845831920a845` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:58.739995 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16e4438-d0a1-4e63-9eb3-f3905b5575be admin admin] RBAC: Authorizing `identity:create_grant(project_id=6859ff608e7e48a6bde9bd21b6a49865, user_id=64a97e31688f4836bd1fbacd9b08ab6e, role_id=1c39b9ab8cfd4c0ea71845831920a845)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:58.742835 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16e4438-d0a1-4e63-9eb3-f3905b5575be admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:58.758545 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 886/1775] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:15:58 2022] PUT /identity/v3/projects/6859ff608e7e48a6bde9bd21b6a49865/users/64a97e31688f4836bd1fbacd9b08ab6e/roles/1c39b9ab8cfd4c0ea71845831920a845 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:15:58.772749 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca6171b-8538-4ef8-be15-ff8c1625dbc3 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:58.773780 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca6171b-8538-4ef8-be15-ff8c1625dbc3 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:58.774125 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca6171b-8538-4ef8-be15-ff8c1625dbc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:58.804378 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 890/1776] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:15:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:15:58.812903 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46fdfb1-7ffb-456f-8777-8468b104d607 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:58.813386 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46fdfb1-7ffb-456f-8777-8468b104d607 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:58.813730 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46fdfb1-7ffb-456f-8777-8468b104d607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:58.817032 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-1ca6171b-8538-4ef8-be15-ff8c1625dbc3 None None] MFA Rules not processed for user `64a97e31688f4836bd1fbacd9b08ab6e`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:15:58.818498 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-1ca6171b-8538-4ef8-be15-ff8c1625dbc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:58.836091 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-e46fdfb1-7ffb-456f-8777-8468b104d607 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:15:58.837361 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-e46fdfb1-7ffb-456f-8777-8468b104d607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:58.946829 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 891/1777] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:15:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 07:15:58.947032 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 887/1778] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:15:58 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:15:58.948851 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46fdfb1-7ffb-456f-8777-8468b104d607 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:58.966083 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46fdfb1-7ffb-456f-8777-8468b104d607 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:58.968884 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca6171b-8538-4ef8-be15-ff8c1625dbc3 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:58.970485 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-1ca6171b-8538-4ef8-be15-ff8c1625dbc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:58.983041 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8050e1-877a-4b4b-9d0b-14839049a144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:58.983742 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8050e1-877a-4b4b-9d0b-14839049a144 admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:58.985811 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8050e1-877a-4b4b-9d0b-14839049a144 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:58.987711 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8050e1-877a-4b4b-9d0b-14839049a144 admin admin] PATH_INFO: `/v3/domains` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:58.988500 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8050e1-877a-4b4b-9d0b-14839049a144 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:15:58.989512 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8050e1-877a-4b4b-9d0b-14839049a144 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:58.991847 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8050e1-877a-4b4b-9d0b-14839049a144 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:59.012288 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 892/1779] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Mar 30 07:15:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:15:59.017731 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8050e1-877a-4b4b-9d0b-14839049a144 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:59.037354 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8050e1-877a-4b4b-9d0b-14839049a144 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:59.042404 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c94637-8938-4a73-a874-b261678a449d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:59.043864 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c94637-8938-4a73-a874-b261678a449d admin admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:59.044225 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c94637-8938-4a73-a874-b261678a449d admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:59.044581 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c94637-8938-4a73-a874-b261678a449d admin admin] PATH_INFO: `/v3/projects` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:59.045345 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c94637-8938-4a73-a874-b261678a449d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:59.048162 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c94637-8938-4a73-a874-b261678a449d admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:59.094939 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 893/1780] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Mar 30 07:15:59 2022] POST /identity/v3/projects => generated 373 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:15:59.099436 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca6171b-8538-4ef8-be15-ff8c1625dbc3 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:59.100812 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c94637-8938-4a73-a874-b261678a449d admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:59.154224 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f2f680-9ead-4dc8-ba6d-72115a4c585b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e2fda180e8d448d895c40cdad34bc4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:59.155029 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f2f680-9ead-4dc8-ba6d-72115a4c585b service cinder] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:59.155369 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f2f680-9ead-4dc8-ba6d-72115a4c585b service cinder] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:59.155698 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f2f680-9ead-4dc8-ba6d-72115a4c585b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:59.173504 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c94637-8938-4a73-a874-b261678a449d admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:59.180522 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ce69b7-c54c-4400-a612-c18075f23490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:59.181623 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ce69b7-c54c-4400-a612-c18075f23490 admin admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:59.181797 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ce69b7-c54c-4400-a612-c18075f23490 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:59.182067 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ce69b7-c54c-4400-a612-c18075f23490 admin admin] PATH_INFO: `/v3/users` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:59.182757 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ce69b7-c54c-4400-a612-c18075f23490 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:59.184734 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ce69b7-c54c-4400-a612-c18075f23490 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:59.216008 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 894/1781] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Mar 30 07:15:59 2022] POST /identity/v3/users => generated 287 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:15:59.217091 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ce69b7-c54c-4400-a612-c18075f23490 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:59.227263 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ce69b7-c54c-4400-a612-c18075f23490 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:59.233219 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4901585-f0e0-4732-a26b-c8bcf74a7635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:59.233903 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4901585-f0e0-4732-a26b-c8bcf74a7635 admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:59.234179 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4901585-f0e0-4732-a26b-c8bcf74a7635 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:59.234450 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4901585-f0e0-4732-a26b-c8bcf74a7635 admin admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:59.234752 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f2f680-9ead-4dc8-ba6d-72115a4c585b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:59.235175 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4901585-f0e0-4732-a26b-c8bcf74a7635 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:59.236465 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f2f680-9ead-4dc8-ba6d-72115a4c585b service cinder] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:59.236793 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4901585-f0e0-4732-a26b-c8bcf74a7635 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:59.248873 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 888/1782] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:15:58 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 30 07:15:59.264207 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f2f680-9ead-4dc8-ba6d-72115a4c585b service cinder] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:59.264890 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 895/1783] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:15:59 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:15:59.282584 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f2f680-9ead-4dc8-ba6d-72115a4c585b service cinder] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:59.291271 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df29e2bf-78ce-4498-92a4-bde14bc287a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:59.292879 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df29e2bf-78ce-4498-92a4-bde14bc287a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:59.293171 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df29e2bf-78ce-4498-92a4-bde14bc287a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:59.293482 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df29e2bf-78ce-4498-92a4-bde14bc287a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:59.294500 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df29e2bf-78ce-4498-92a4-bde14bc287a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:59.296327 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df29e2bf-78ce-4498-92a4-bde14bc287a3 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:59.308260 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 889/1784] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:15:59 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 30 07:15:59.314735 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4901585-f0e0-4732-a26b-c8bcf74a7635 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:59.324977 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df29e2bf-78ce-4498-92a4-bde14bc287a3 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:59.327146 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-df29e2bf-78ce-4498-92a4-bde14bc287a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:59.329742 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4901585-f0e0-4732-a26b-c8bcf74a7635 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:59.337531 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731c7203-1c72-4d4e-8137-cca34d326630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:59.339105 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c7203-1c72-4d4e-8137-cca34d326630 admin admin] REQUEST_METHOD: `PUT` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:59.339385 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c7203-1c72-4d4e-8137-cca34d326630 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:59.340135 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c7203-1c72-4d4e-8137-cca34d326630 admin admin] PATH_INFO: `/v3/projects/382811b7501c4556b93c2d28e9ce9e8f/users/43e34689177f4669834ec664f0656d7c/roles/5d79031a64754b57ba120367465e2252` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:59.342413 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df29e2bf-78ce-4498-92a4-bde14bc287a3 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:59.347856 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e377bd4-5ead-41e0-8a5b-b96623dc338a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e2fda180e8d448d895c40cdad34bc4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:59.348050 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e377bd4-5ead-41e0-8a5b-b96623dc338a service cinder] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:59.348296 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e377bd4-5ead-41e0-8a5b-b96623dc338a service cinder] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:59.348606 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e377bd4-5ead-41e0-8a5b-b96623dc338a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:59.350810 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-3e377bd4-5ead-41e0-8a5b-b96623dc338a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:59.363796 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731c7203-1c72-4d4e-8137-cca34d326630 admin admin] RBAC: Authorizing `identity:create_grant(project_id=382811b7501c4556b93c2d28e9ce9e8f, user_id=43e34689177f4669834ec664f0656d7c, role_id=5d79031a64754b57ba120367465e2252)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:59.388655 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731c7203-1c72-4d4e-8137-cca34d326630 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:59.420296 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 896/1785] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:15:59 2022] PUT /identity/v3/projects/382811b7501c4556b93c2d28e9ce9e8f/users/43e34689177f4669834ec664f0656d7c/roles/5d79031a64754b57ba120367465e2252 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:15:59.431547 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e731cd1c-ad56-454d-ab2b-85574794cc3a None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:59.431984 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e731cd1c-ad56-454d-ab2b-85574794cc3a None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:59.432216 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e731cd1c-ad56-454d-ab2b-85574794cc3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:59.440491 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e377bd4-5ead-41e0-8a5b-b96623dc338a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:59.442743 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e377bd4-5ead-41e0-8a5b-b96623dc338a service cinder] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:59.454521 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 890/1786] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:15:59 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 30 07:15:59.471724 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-e731cd1c-ad56-454d-ab2b-85574794cc3a None None] MFA Rules not processed for user `43e34689177f4669834ec664f0656d7c`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:15:59.477824 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-e731cd1c-ad56-454d-ab2b-85574794cc3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:15:59.549333 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 897/1787] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:15:59 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:15:59.553932 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e377bd4-5ead-41e0-8a5b-b96623dc338a service cinder] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:59.564762 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e377bd4-5ead-41e0-8a5b-b96623dc338a service cinder] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:59.621668 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654d1478-d5e3-4fad-97ff-9bd5dd0c2646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:59.622626 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654d1478-d5e3-4fad-97ff-9bd5dd0c2646 admin admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:59.622887 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654d1478-d5e3-4fad-97ff-9bd5dd0c2646 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:59.623001 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654d1478-d5e3-4fad-97ff-9bd5dd0c2646 admin admin] PATH_INFO: `/v3/projects` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:59.624917 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654d1478-d5e3-4fad-97ff-9bd5dd0c2646 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:59.627025 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654d1478-d5e3-4fad-97ff-9bd5dd0c2646 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:59.659700 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 891/1788] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Mar 30 07:15:59 2022] POST /identity/v3/projects => generated 373 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:15:59.664149 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e731cd1c-ad56-454d-ab2b-85574794cc3a None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:59.675495 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e731cd1c-ad56-454d-ab2b-85574794cc3a None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:59.740202 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748f2da4-68a2-4fdd-9415-6d1383fbaf9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:59.741051 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f2da4-68a2-4fdd-9415-6d1383fbaf9b admin admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:59.741424 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f2da4-68a2-4fdd-9415-6d1383fbaf9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:59.741788 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f2da4-68a2-4fdd-9415-6d1383fbaf9b admin admin] PATH_INFO: `/v3/users` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:59.742714 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748f2da4-68a2-4fdd-9415-6d1383fbaf9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:59.745385 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748f2da4-68a2-4fdd-9415-6d1383fbaf9b admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:59.775852 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 898/1789] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Mar 30 07:15:59 2022] POST /identity/v3/users => generated 293 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:15:59.778289 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654d1478-d5e3-4fad-97ff-9bd5dd0c2646 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:59.790026 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654d1478-d5e3-4fad-97ff-9bd5dd0c2646 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:59.794663 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acda49c7-f20f-44cf-963f-faafc617f112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:59.795328 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda49c7-f20f-44cf-963f-faafc617f112 admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:59.795607 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda49c7-f20f-44cf-963f-faafc617f112 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:59.795918 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda49c7-f20f-44cf-963f-faafc617f112 admin admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:59.796653 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acda49c7-f20f-44cf-963f-faafc617f112 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:59.798323 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acda49c7-f20f-44cf-963f-faafc617f112 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:59.809045 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 892/1790] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:15:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:15:59.813799 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748f2da4-68a2-4fdd-9415-6d1383fbaf9b admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:59.827385 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748f2da4-68a2-4fdd-9415-6d1383fbaf9b admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:59.832569 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96c5c55-ca7d-4ee3-9a7f-7a46dfc1ea28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:59.833459 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c5c55-ca7d-4ee3-9a7f-7a46dfc1ea28 admin admin] REQUEST_METHOD: `PUT` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:59.833742 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c5c55-ca7d-4ee3-9a7f-7a46dfc1ea28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:59.834018 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c5c55-ca7d-4ee3-9a7f-7a46dfc1ea28 admin admin] PATH_INFO: `/v3/projects/026f0f5c0dd547a1bed7cfa265bb5f11/users/d4c75e3ed7624fc8a60c7449510420af/roles/1c39b9ab8cfd4c0ea71845831920a845` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:59.849275 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96c5c55-ca7d-4ee3-9a7f-7a46dfc1ea28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=026f0f5c0dd547a1bed7cfa265bb5f11, user_id=d4c75e3ed7624fc8a60c7449510420af, role_id=1c39b9ab8cfd4c0ea71845831920a845)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:59.851991 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96c5c55-ca7d-4ee3-9a7f-7a46dfc1ea28 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:59.868228 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 899/1791] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:15:59 2022] PUT /identity/v3/projects/026f0f5c0dd547a1bed7cfa265bb5f11/users/d4c75e3ed7624fc8a60c7449510420af/roles/1c39b9ab8cfd4c0ea71845831920a845 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:15:59.873039 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acda49c7-f20f-44cf-963f-faafc617f112 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:59.883761 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acda49c7-f20f-44cf-963f-faafc617f112 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:59.940326 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d015911c-f8ec-4dfc-a956-147837dbffcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:59.941007 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d015911c-f8ec-4dfc-a956-147837dbffcb admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:59.941303 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d015911c-f8ec-4dfc-a956-147837dbffcb admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:59.941573 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d015911c-f8ec-4dfc-a956-147837dbffcb admin admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:59.942308 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d015911c-f8ec-4dfc-a956-147837dbffcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:59.943970 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d015911c-f8ec-4dfc-a956-147837dbffcb admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:59.956931 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 893/1792] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:15:59 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:15:59.961302 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96c5c55-ca7d-4ee3-9a7f-7a46dfc1ea28 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:15:59.971831 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96c5c55-ca7d-4ee3-9a7f-7a46dfc1ea28 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:15:59.976543 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43fda0d-ec7a-4839-b789-a6291f4ac9a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:15:59.977432 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43fda0d-ec7a-4839-b789-a6291f4ac9a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:15:59.977715 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43fda0d-ec7a-4839-b789-a6291f4ac9a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:15:59.977991 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43fda0d-ec7a-4839-b789-a6291f4ac9a1 admin admin] PATH_INFO: `/v3/projects/026f0f5c0dd547a1bed7cfa265bb5f11/users/d4c75e3ed7624fc8a60c7449510420af/roles/1c39b9ab8cfd4c0ea71845831920a845` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:15:59.980041 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43fda0d-ec7a-4839-b789-a6291f4ac9a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=026f0f5c0dd547a1bed7cfa265bb5f11, user_id=d4c75e3ed7624fc8a60c7449510420af, role_id=1c39b9ab8cfd4c0ea71845831920a845)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:15:59.983411 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43fda0d-ec7a-4839-b789-a6291f4ac9a1 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:15:59.993997 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 900/1793] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:15:59 2022] PUT /identity/v3/projects/026f0f5c0dd547a1bed7cfa265bb5f11/users/d4c75e3ed7624fc8a60c7449510420af/roles/1c39b9ab8cfd4c0ea71845831920a845 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 07:16:00.004549 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a842d-c07c-482f-8566-7267fee14977 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:00.004831 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a842d-c07c-482f-8566-7267fee14977 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:00.005105 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a842d-c07c-482f-8566-7267fee14977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:00.032281 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-164a842d-c07c-482f-8566-7267fee14977 None None] MFA Rules not processed for user `d4c75e3ed7624fc8a60c7449510420af`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:16:00.033484 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-164a842d-c07c-482f-8566-7267fee14977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:00.117364 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 894/1794] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:16:00 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:16:00.125930 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43fda0d-ec7a-4839-b789-a6291f4ac9a1 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:00.181399 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43fda0d-ec7a-4839-b789-a6291f4ac9a1 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:00.185241 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcf4421-ab2d-49b0-92ed-559bf069f7b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e2fda180e8d448d895c40cdad34bc4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:00.185897 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcf4421-ab2d-49b0-92ed-559bf069f7b1 service cinder] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:00.186175 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcf4421-ab2d-49b0-92ed-559bf069f7b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:00.186448 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcf4421-ab2d-49b0-92ed-559bf069f7b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:00.195577 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcf4421-ab2d-49b0-92ed-559bf069f7b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:00.197039 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcf4421-ab2d-49b0-92ed-559bf069f7b1 service cinder] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:00.206368 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 901/1795] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:16:00 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:16:00.738536 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164a842d-c07c-482f-8566-7267fee14977 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:00.827595 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164a842d-c07c-482f-8566-7267fee14977 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:00.836603 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdc3d13-bf48-4230-8bc9-21596f5addd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:00.837759 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdc3d13-bf48-4230-8bc9-21596f5addd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:00.838040 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdc3d13-bf48-4230-8bc9-21596f5addd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:00.838309 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdc3d13-bf48-4230-8bc9-21596f5addd6 admin admin] PATH_INFO: `/v3/users/43e34689177f4669834ec664f0656d7c` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:00.839522 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdc3d13-bf48-4230-8bc9-21596f5addd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43e34689177f4669834ec664f0656d7c)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:00.841730 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdc3d13-bf48-4230-8bc9-21596f5addd6 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:00.897834 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-1cdc3d13-bf48-4230-8bc9-21596f5addd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43e34689177f4669834ec664f0656d7c'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:00.898481 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-1cdc3d13-bf48-4230-8bc9-21596f5addd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43e34689177f4669834ec664f0656d7c'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:00.899668 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-1cdc3d13-bf48-4230-8bc9-21596f5addd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43e34689177f4669834ec664f0656d7c'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:00.910211 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-1cdc3d13-bf48-4230-8bc9-21596f5addd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43e34689177f4669834ec664f0656d7c'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:00.918798 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-1cdc3d13-bf48-4230-8bc9-21596f5addd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43e34689177f4669834ec664f0656d7c'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:00.959010 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 895/1796] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Mar 30 07:16:00 2022] DELETE /identity/v3/users/43e34689177f4669834ec664f0656d7c => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:16:00.960784 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134fcf6f-54ea-48cf-b9b5-b1b522de78b7 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:00.961945 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134fcf6f-54ea-48cf-b9b5-b1b522de78b7 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:00.962231 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134fcf6f-54ea-48cf-b9b5-b1b522de78b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:00.982400 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-134fcf6f-54ea-48cf-b9b5-b1b522de78b7 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:16:00.983637 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-134fcf6f-54ea-48cf-b9b5-b1b522de78b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:01.058315 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 902/1797] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:16:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:16:01.066207 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdc3d13-bf48-4230-8bc9-21596f5addd6 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:01.068560 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-1cdc3d13-bf48-4230-8bc9-21596f5addd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:01.145958 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdc3d13-bf48-4230-8bc9-21596f5addd6 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:01.164376 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f4e1a3-4739-4b34-a8a2-39a2ca06c0d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3802cb341445f994b9204744060ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:01.165101 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f4e1a3-4739-4b34-a8a2-39a2ca06c0d6 service neutron] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:01.165474 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f4e1a3-4739-4b34-a8a2-39a2ca06c0d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:01.165754 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f4e1a3-4739-4b34-a8a2-39a2ca06c0d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:01.179172 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f4e1a3-4739-4b34-a8a2-39a2ca06c0d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:01.180786 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f4e1a3-4739-4b34-a8a2-39a2ca06c0d6 service neutron] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:01.192329 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 896/1798] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:16:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:16:01.622662 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134fcf6f-54ea-48cf-b9b5-b1b522de78b7 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:01.624448 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-134fcf6f-54ea-48cf-b9b5-b1b522de78b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:01.638943 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134fcf6f-54ea-48cf-b9b5-b1b522de78b7 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:01.644653 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5524fd-bd1d-4cc7-a382-ef0c682f44d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:01.645555 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5524fd-bd1d-4cc7-a382-ef0c682f44d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:01.645834 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5524fd-bd1d-4cc7-a382-ef0c682f44d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:01.646104 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5524fd-bd1d-4cc7-a382-ef0c682f44d6 admin admin] PATH_INFO: `/v3/projects/382811b7501c4556b93c2d28e9ce9e8f` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:01.647295 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5524fd-bd1d-4cc7-a382-ef0c682f44d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=382811b7501c4556b93c2d28e9ce9e8f)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:01.649485 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5524fd-bd1d-4cc7-a382-ef0c682f44d6 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:01.711474 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-4b5524fd-bd1d-4cc7-a382-ef0c682f44d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '382811b7501c4556b93c2d28e9ce9e8f', 'request_id': 'req-4b5524fd-bd1d-4cc7-a382-ef0c682f44d6'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:01.722057 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-4b5524fd-bd1d-4cc7-a382-ef0c682f44d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '382811b7501c4556b93c2d28e9ce9e8f', 'request_id': 'req-4b5524fd-bd1d-4cc7-a382-ef0c682f44d6'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:01.728400 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-4b5524fd-bd1d-4cc7-a382-ef0c682f44d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '382811b7501c4556b93c2d28e9ce9e8f', 'request_id': 'req-4b5524fd-bd1d-4cc7-a382-ef0c682f44d6'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:01.740272 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-4b5524fd-bd1d-4cc7-a382-ef0c682f44d6 admin admin] The token cache is being invalidate because project 382811b7501c4556b93c2d28e9ce9e8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79960) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 07:16:01.740575 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-4b5524fd-bd1d-4cc7-a382-ef0c682f44d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:01.741213 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-4b5524fd-bd1d-4cc7-a382-ef0c682f44d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:01.742750 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 903/1799] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Mar 30 07:16:01 2022] DELETE /identity/v3/projects/382811b7501c4556b93c2d28e9ce9e8f => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:16:01.746984 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f4e1a3-4739-4b34-a8a2-39a2ca06c0d6 service neutron] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:01.756990 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f4e1a3-4739-4b34-a8a2-39a2ca06c0d6 service neutron] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:01.810997 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3490ca3-9494-4dec-8088-4a1dd1b10fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:01.811988 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3490ca3-9494-4dec-8088-4a1dd1b10fd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:01.812279 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3490ca3-9494-4dec-8088-4a1dd1b10fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:01.812548 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3490ca3-9494-4dec-8088-4a1dd1b10fd4 admin admin] PATH_INFO: `/v3/users/d4c75e3ed7624fc8a60c7449510420af` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:01.813730 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3490ca3-9494-4dec-8088-4a1dd1b10fd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4c75e3ed7624fc8a60c7449510420af)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:01.815655 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3490ca3-9494-4dec-8088-4a1dd1b10fd4 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:01.869996 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-b3490ca3-9494-4dec-8088-4a1dd1b10fd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4c75e3ed7624fc8a60c7449510420af'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:01.870679 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-b3490ca3-9494-4dec-8088-4a1dd1b10fd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4c75e3ed7624fc8a60c7449510420af'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:01.871567 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-b3490ca3-9494-4dec-8088-4a1dd1b10fd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4c75e3ed7624fc8a60c7449510420af'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:01.880139 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-b3490ca3-9494-4dec-8088-4a1dd1b10fd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4c75e3ed7624fc8a60c7449510420af'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:01.887443 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-b3490ca3-9494-4dec-8088-4a1dd1b10fd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4c75e3ed7624fc8a60c7449510420af'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:01.913204 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 897/1800] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Mar 30 07:16:01 2022] DELETE /identity/v3/users/d4c75e3ed7624fc8a60c7449510420af => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:16:02.185627 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5524fd-bd1d-4cc7-a382-ef0c682f44d6 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:02.187184 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-4b5524fd-bd1d-4cc7-a382-ef0c682f44d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:02.206861 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5524fd-bd1d-4cc7-a382-ef0c682f44d6 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:02.263757 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c438b4c-3a70-48d5-9eff-db07c3dca055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:02.264664 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c438b4c-3a70-48d5-9eff-db07c3dca055 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:02.264966 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c438b4c-3a70-48d5-9eff-db07c3dca055 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:02.265240 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c438b4c-3a70-48d5-9eff-db07c3dca055 admin admin] PATH_INFO: `/v3/projects/026f0f5c0dd547a1bed7cfa265bb5f11` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:02.266546 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c438b4c-3a70-48d5-9eff-db07c3dca055 admin admin] RBAC: Authorizing `identity:delete_project(project_id=026f0f5c0dd547a1bed7cfa265bb5f11)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:02.268509 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c438b4c-3a70-48d5-9eff-db07c3dca055 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:02.323182 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-9c438b4c-3a70-48d5-9eff-db07c3dca055 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '026f0f5c0dd547a1bed7cfa265bb5f11', 'request_id': 'req-9c438b4c-3a70-48d5-9eff-db07c3dca055'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:02.334091 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-9c438b4c-3a70-48d5-9eff-db07c3dca055 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '026f0f5c0dd547a1bed7cfa265bb5f11', 'request_id': 'req-9c438b4c-3a70-48d5-9eff-db07c3dca055'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:02.340381 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-9c438b4c-3a70-48d5-9eff-db07c3dca055 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '026f0f5c0dd547a1bed7cfa265bb5f11', 'request_id': 'req-9c438b4c-3a70-48d5-9eff-db07c3dca055'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:02.351297 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-9c438b4c-3a70-48d5-9eff-db07c3dca055 admin admin] The token cache is being invalidate because project 026f0f5c0dd547a1bed7cfa265bb5f11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79960) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 07:16:02.351664 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-9c438b4c-3a70-48d5-9eff-db07c3dca055 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:02.352383 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-9c438b4c-3a70-48d5-9eff-db07c3dca055 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:02.353992 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 904/1801] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Mar 30 07:16:02 2022] DELETE /identity/v3/projects/026f0f5c0dd547a1bed7cfa265bb5f11 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:16:02.359383 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5730b4-c7d7-480c-957f-8e018cf11a64 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:02.359666 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5730b4-c7d7-480c-957f-8e018cf11a64 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:02.359991 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5730b4-c7d7-480c-957f-8e018cf11a64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:02.378243 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-7c5730b4-c7d7-480c-957f-8e018cf11a64 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:16:02.379427 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-7c5730b4-c7d7-480c-957f-8e018cf11a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:02.441611 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 898/1802] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:16:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:16:02.449711 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8f9933-fe5d-44b7-bff3-f703cee41a1e None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:02.450049 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8f9933-fe5d-44b7-bff3-f703cee41a1e None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:02.450573 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8f9933-fe5d-44b7-bff3-f703cee41a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:02.470672 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-cc8f9933-fe5d-44b7-bff3-f703cee41a1e None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:16:02.471928 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-cc8f9933-fe5d-44b7-bff3-f703cee41a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:02.480164 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 905/1803] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:16:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:16:02.490848 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5730b4-c7d7-480c-957f-8e018cf11a64 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:02.497495 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5730b4-c7d7-480c-957f-8e018cf11a64 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:02.502090 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c319432-45c8-47bf-8b40-7c7a381a1be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:02.502764 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c319432-45c8-47bf-8b40-7c7a381a1be6 admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:02.503048 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c319432-45c8-47bf-8b40-7c7a381a1be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:02.503323 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c319432-45c8-47bf-8b40-7c7a381a1be6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:02.504103 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c319432-45c8-47bf-8b40-7c7a381a1be6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:16:02.504407 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c319432-45c8-47bf-8b40-7c7a381a1be6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:02.505992 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c319432-45c8-47bf-8b40-7c7a381a1be6 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:02.518707 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 899/1804] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Mar 30 07:16:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:16:02.522971 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8f9933-fe5d-44b7-bff3-f703cee41a1e None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:02.532142 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8f9933-fe5d-44b7-bff3-f703cee41a1e None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:02.536647 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222525e1-6e8e-43b4-a0f3-caa1ac4aaeb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:02.537302 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222525e1-6e8e-43b4-a0f3-caa1ac4aaeb0 admin admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:02.537582 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222525e1-6e8e-43b4-a0f3-caa1ac4aaeb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:02.537880 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222525e1-6e8e-43b4-a0f3-caa1ac4aaeb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:02.538532 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222525e1-6e8e-43b4-a0f3-caa1ac4aaeb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:02.540436 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222525e1-6e8e-43b4-a0f3-caa1ac4aaeb0 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:02.566740 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 906/1805] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Mar 30 07:16:02 2022] POST /identity/v3/projects => generated 363 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:16:02.571355 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c319432-45c8-47bf-8b40-7c7a381a1be6 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:02.582640 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c319432-45c8-47bf-8b40-7c7a381a1be6 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:02.653644 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463ded17-4b70-497e-becb-583ab48c71a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:02.653644 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463ded17-4b70-497e-becb-583ab48c71a6 admin admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:02.653644 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463ded17-4b70-497e-becb-583ab48c71a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:02.653644 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463ded17-4b70-497e-becb-583ab48c71a6 admin admin] PATH_INFO: `/v3/users` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:02.654432 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463ded17-4b70-497e-becb-583ab48c71a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:02.656409 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463ded17-4b70-497e-becb-583ab48c71a6 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:02.684596 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222525e1-6e8e-43b4-a0f3-caa1ac4aaeb0 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:02.691158 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 900/1806] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Mar 30 07:16:02 2022] POST /identity/v3/users => generated 282 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 07:16:02.696370 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222525e1-6e8e-43b4-a0f3-caa1ac4aaeb0 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:02.701320 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784958c1-4a9e-4ed6-af0e-fc3316ecd9f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:02.701991 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784958c1-4a9e-4ed6-af0e-fc3316ecd9f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:02.702333 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784958c1-4a9e-4ed6-af0e-fc3316ecd9f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:02.702602 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784958c1-4a9e-4ed6-af0e-fc3316ecd9f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:02.703324 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784958c1-4a9e-4ed6-af0e-fc3316ecd9f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:02.704954 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784958c1-4a9e-4ed6-af0e-fc3316ecd9f0 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:02.717488 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 907/1807] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:16:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:16:02.722433 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463ded17-4b70-497e-becb-583ab48c71a6 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:02.734787 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463ded17-4b70-497e-becb-583ab48c71a6 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:02.740272 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecea080-6fc2-45d1-8f17-098971f3daa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:02.741213 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecea080-6fc2-45d1-8f17-098971f3daa6 admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:02.741736 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecea080-6fc2-45d1-8f17-098971f3daa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:02.742093 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecea080-6fc2-45d1-8f17-098971f3daa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:02.743680 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecea080-6fc2-45d1-8f17-098971f3daa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:02.745398 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecea080-6fc2-45d1-8f17-098971f3daa6 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:02.764285 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 901/1808] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:16:02 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:16:02.768357 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784958c1-4a9e-4ed6-af0e-fc3316ecd9f0 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:02.779472 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784958c1-4a9e-4ed6-af0e-fc3316ecd9f0 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:02.784292 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a19f64f-cd5d-4738-8763-4dba4826b952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:02.785257 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a19f64f-cd5d-4738-8763-4dba4826b952 admin admin] REQUEST_METHOD: `PUT` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:02.785607 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a19f64f-cd5d-4738-8763-4dba4826b952 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:02.785947 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a19f64f-cd5d-4738-8763-4dba4826b952 admin admin] PATH_INFO: `/v3/projects/a5abb4822faa4316bf04e2fc0ed54e26/users/7b8038415d0444c7a234f757183eb2ff/roles/5d79031a64754b57ba120367465e2252` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:02.803731 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a19f64f-cd5d-4738-8763-4dba4826b952 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5abb4822faa4316bf04e2fc0ed54e26, user_id=7b8038415d0444c7a234f757183eb2ff, role_id=5d79031a64754b57ba120367465e2252)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:02.806478 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a19f64f-cd5d-4738-8763-4dba4826b952 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:02.835845 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 908/1809] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:16:02 2022] PUT /identity/v3/projects/a5abb4822faa4316bf04e2fc0ed54e26/users/7b8038415d0444c7a234f757183eb2ff/roles/5d79031a64754b57ba120367465e2252 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:16:02.837529 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07db7f6a-99c3-4d0d-b5ce-71dc7991a386 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:02.837812 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07db7f6a-99c3-4d0d-b5ce-71dc7991a386 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:02.838089 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07db7f6a-99c3-4d0d-b5ce-71dc7991a386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:02.870784 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-07db7f6a-99c3-4d0d-b5ce-71dc7991a386 None None] MFA Rules not processed for user `7b8038415d0444c7a234f757183eb2ff`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:16:02.872175 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-07db7f6a-99c3-4d0d-b5ce-71dc7991a386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:02.943414 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 902/1810] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:16:02 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 07:16:02.948045 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a19f64f-cd5d-4738-8763-4dba4826b952 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:03.014938 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a19f64f-cd5d-4738-8763-4dba4826b952 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:03.019627 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac33720-776d-4c3f-b0e7-981fef2c192a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:03.020322 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac33720-776d-4c3f-b0e7-981fef2c192a admin admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:03.020612 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac33720-776d-4c3f-b0e7-981fef2c192a admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:03.020880 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac33720-776d-4c3f-b0e7-981fef2c192a admin admin] PATH_INFO: `/v3/projects` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:03.021582 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac33720-776d-4c3f-b0e7-981fef2c192a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:03.023489 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac33720-776d-4c3f-b0e7-981fef2c192a admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:03.054455 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 909/1811] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Mar 30 07:16:02 2022] POST /identity/v3/projects => generated 363 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:16:03.055739 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07db7f6a-99c3-4d0d-b5ce-71dc7991a386 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:03.057954 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac33720-776d-4c3f-b0e7-981fef2c192a admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:03.060127 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-aac33720-776d-4c3f-b0e7-981fef2c192a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:03.067629 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07db7f6a-99c3-4d0d-b5ce-71dc7991a386 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:03.123160 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429f0c64-2a89-41f3-8a3a-f1c8e5231994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:03.123888 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429f0c64-2a89-41f3-8a3a-f1c8e5231994 admin admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:03.124180 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429f0c64-2a89-41f3-8a3a-f1c8e5231994 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:03.124456 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429f0c64-2a89-41f3-8a3a-f1c8e5231994 admin admin] PATH_INFO: `/v3/users` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:03.125146 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429f0c64-2a89-41f3-8a3a-f1c8e5231994 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:03.127096 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429f0c64-2a89-41f3-8a3a-f1c8e5231994 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:03.130279 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac33720-776d-4c3f-b0e7-981fef2c192a admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:03.135753 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb172ce8-87e5-40b8-a9cb-3978fa81ebc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:03.136679 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb172ce8-87e5-40b8-a9cb-3978fa81ebc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:03.136962 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb172ce8-87e5-40b8-a9cb-3978fa81ebc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:03.137236 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb172ce8-87e5-40b8-a9cb-3978fa81ebc9 admin admin] PATH_INFO: `/v3/users/a248e0d1f586454b80522ca7ab36343d` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:03.138670 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb172ce8-87e5-40b8-a9cb-3978fa81ebc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a248e0d1f586454b80522ca7ab36343d)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:03.140872 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb172ce8-87e5-40b8-a9cb-3978fa81ebc9 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:03.150117 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 903/1812] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Mar 30 07:16:03 2022] POST /identity/v3/users => generated 288 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:16:03.154322 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429f0c64-2a89-41f3-8a3a-f1c8e5231994 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:03.164354 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429f0c64-2a89-41f3-8a3a-f1c8e5231994 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:03.169953 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606ef6e5-227d-4e09-a822-167e80370990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:03.170767 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606ef6e5-227d-4e09-a822-167e80370990 admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:03.171204 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606ef6e5-227d-4e09-a822-167e80370990 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:03.171491 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606ef6e5-227d-4e09-a822-167e80370990 admin admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:03.172357 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606ef6e5-227d-4e09-a822-167e80370990 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:03.174089 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606ef6e5-227d-4e09-a822-167e80370990 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:03.192064 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 904/1813] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:16:03 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 30 07:16:03.193563 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606ef6e5-227d-4e09-a822-167e80370990 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:03.197267 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-cb172ce8-87e5-40b8-a9cb-3978fa81ebc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a248e0d1f586454b80522ca7ab36343d'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:03.198151 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-cb172ce8-87e5-40b8-a9cb-3978fa81ebc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a248e0d1f586454b80522ca7ab36343d'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:03.206578 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606ef6e5-227d-4e09-a822-167e80370990 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:03.211698 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdda39e-b48f-4622-82bf-258c993deb5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:03.212803 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdda39e-b48f-4622-82bf-258c993deb5b admin admin] REQUEST_METHOD: `PUT` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:03.213083 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdda39e-b48f-4622-82bf-258c993deb5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:03.213521 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdda39e-b48f-4622-82bf-258c993deb5b admin admin] PATH_INFO: `/v3/projects/ad956698aa524d8497f22da5d6f81c41/users/baf3caa0486348c0a0acb436a5c011c0/roles/1c39b9ab8cfd4c0ea71845831920a845` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:03.216114 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-cb172ce8-87e5-40b8-a9cb-3978fa81ebc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a248e0d1f586454b80522ca7ab36343d'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:03.230352 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdda39e-b48f-4622-82bf-258c993deb5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad956698aa524d8497f22da5d6f81c41, user_id=baf3caa0486348c0a0acb436a5c011c0, role_id=1c39b9ab8cfd4c0ea71845831920a845)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:03.233271 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-cb172ce8-87e5-40b8-a9cb-3978fa81ebc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a248e0d1f586454b80522ca7ab36343d'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:03.233681 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdda39e-b48f-4622-82bf-258c993deb5b admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:03.236213 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-cb172ce8-87e5-40b8-a9cb-3978fa81ebc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a248e0d1f586454b80522ca7ab36343d'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:03.247748 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 905/1814] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:16:03 2022] PUT /identity/v3/projects/ad956698aa524d8497f22da5d6f81c41/users/baf3caa0486348c0a0acb436a5c011c0/roles/1c39b9ab8cfd4c0ea71845831920a845 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:16:03.251486 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 910/1815] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Mar 30 07:16:03 2022] DELETE /identity/v3/users/a248e0d1f586454b80522ca7ab36343d => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:16:03.252050 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdda39e-b48f-4622-82bf-258c993deb5b admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:03.255278 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-afdda39e-b48f-4622-82bf-258c993deb5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:03.256493 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d638d9b3-6d6a-4bdc-92f2-9e01934798f0 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:03.256781 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d638d9b3-6d6a-4bdc-92f2-9e01934798f0 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:03.257052 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d638d9b3-6d6a-4bdc-92f2-9e01934798f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:03.274636 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-d638d9b3-6d6a-4bdc-92f2-9e01934798f0 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:16:03.275869 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-d638d9b3-6d6a-4bdc-92f2-9e01934798f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:03.328922 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdda39e-b48f-4622-82bf-258c993deb5b admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:03.338527 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 911/1816] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:16:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:16:03.349039 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d638d9b3-6d6a-4bdc-92f2-9e01934798f0 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:03.351293 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-d638d9b3-6d6a-4bdc-92f2-9e01934798f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:03.412733 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3e08d5-eee0-4c88-b83e-3f179a17d3b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:03.413960 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3e08d5-eee0-4c88-b83e-3f179a17d3b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:03.413960 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3e08d5-eee0-4c88-b83e-3f179a17d3b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:03.414129 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3e08d5-eee0-4c88-b83e-3f179a17d3b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:03.414968 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3e08d5-eee0-4c88-b83e-3f179a17d3b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:03.417632 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3e08d5-eee0-4c88-b83e-3f179a17d3b9 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:03.429657 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 906/1817] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:16:03 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 30 07:16:03.433127 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d638d9b3-6d6a-4bdc-92f2-9e01934798f0 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:03.433522 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3e08d5-eee0-4c88-b83e-3f179a17d3b9 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:03.437403 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342e8cfe-bc44-447b-9541-23354379e774 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3802cb341445f994b9204744060ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:03.438066 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e8cfe-bc44-447b-9541-23354379e774 service neutron] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:03.438346 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e8cfe-bc44-447b-9541-23354379e774 service neutron] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:03.438763 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e8cfe-bc44-447b-9541-23354379e774 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:03.445603 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3e08d5-eee0-4c88-b83e-3f179a17d3b9 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:03.451664 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2494347-35a0-43ac-8b5c-c34c74ad313d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:03.451865 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342e8cfe-bc44-447b-9541-23354379e774 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:03.452699 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2494347-35a0-43ac-8b5c-c34c74ad313d admin admin] REQUEST_METHOD: `PUT` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:03.453043 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2494347-35a0-43ac-8b5c-c34c74ad313d admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:03.453389 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2494347-35a0-43ac-8b5c-c34c74ad313d admin admin] PATH_INFO: `/v3/projects/ad956698aa524d8497f22da5d6f81c41/users/baf3caa0486348c0a0acb436a5c011c0/roles/1c39b9ab8cfd4c0ea71845831920a845` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:03.453858 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342e8cfe-bc44-447b-9541-23354379e774 service neutron] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:03.455527 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2494347-35a0-43ac-8b5c-c34c74ad313d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad956698aa524d8497f22da5d6f81c41, user_id=baf3caa0486348c0a0acb436a5c011c0, role_id=1c39b9ab8cfd4c0ea71845831920a845)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:03.459033 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2494347-35a0-43ac-8b5c-c34c74ad313d admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:03.465516 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 912/1818] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:16:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:16:03.482136 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 907/1819] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:16:03 2022] PUT /identity/v3/projects/ad956698aa524d8497f22da5d6f81c41/users/baf3caa0486348c0a0acb436a5c011c0/roles/1c39b9ab8cfd4c0ea71845831920a845 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:16:03.484700 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57373322-99dc-4170-ab2e-19d13063f0c4 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:03.485586 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57373322-99dc-4170-ab2e-19d13063f0c4 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:03.485884 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57373322-99dc-4170-ab2e-19d13063f0c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:03.515644 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-57373322-99dc-4170-ab2e-19d13063f0c4 None None] MFA Rules not processed for user `baf3caa0486348c0a0acb436a5c011c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:16:03.518459 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-57373322-99dc-4170-ab2e-19d13063f0c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:03.622097 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 913/1820] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:16:03 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:16:03.647802 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2494347-35a0-43ac-8b5c-c34c74ad313d admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:03.649958 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-e2494347-35a0-43ac-8b5c-c34c74ad313d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:03.827293 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2494347-35a0-43ac-8b5c-c34c74ad313d admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:03.838196 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f32d98-a9f8-45e9-8949-52daced45e9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e2fda180e8d448d895c40cdad34bc4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:03.839353 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f32d98-a9f8-45e9-8949-52daced45e9a service cinder] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:03.841779 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f32d98-a9f8-45e9-8949-52daced45e9a service cinder] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:03.842217 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f32d98-a9f8-45e9-8949-52daced45e9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:03.867764 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f32d98-a9f8-45e9-8949-52daced45e9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:03.872522 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f32d98-a9f8-45e9-8949-52daced45e9a service cinder] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:03.902822 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 908/1821] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:16:03 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:16:04.225367 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57373322-99dc-4170-ab2e-19d13063f0c4 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:04.226906 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-57373322-99dc-4170-ab2e-19d13063f0c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:04.415318 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57373322-99dc-4170-ab2e-19d13063f0c4 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:04.426512 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97453f4-3b1c-4865-a434-e82fb1684da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:04.428175 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97453f4-3b1c-4865-a434-e82fb1684da5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:04.428688 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97453f4-3b1c-4865-a434-e82fb1684da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:04.429152 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97453f4-3b1c-4865-a434-e82fb1684da5 admin admin] PATH_INFO: `/v3/projects/a276bf3abcf749a39e77fb1f04e11edf` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:04.430613 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97453f4-3b1c-4865-a434-e82fb1684da5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a276bf3abcf749a39e77fb1f04e11edf)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:04.433925 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97453f4-3b1c-4865-a434-e82fb1684da5 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:04.543369 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-f97453f4-3b1c-4865-a434-e82fb1684da5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a276bf3abcf749a39e77fb1f04e11edf', 'request_id': 'req-f97453f4-3b1c-4865-a434-e82fb1684da5'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:04.564380 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-f97453f4-3b1c-4865-a434-e82fb1684da5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a276bf3abcf749a39e77fb1f04e11edf', 'request_id': 'req-f97453f4-3b1c-4865-a434-e82fb1684da5'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:04.565689 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f32d98-a9f8-45e9-8949-52daced45e9a service cinder] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:04.575184 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-f97453f4-3b1c-4865-a434-e82fb1684da5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a276bf3abcf749a39e77fb1f04e11edf', 'request_id': 'req-f97453f4-3b1c-4865-a434-e82fb1684da5'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:04.593913 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f32d98-a9f8-45e9-8949-52daced45e9a service cinder] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:04.621092 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-f97453f4-3b1c-4865-a434-e82fb1684da5 admin admin] The token cache is being invalidate because project a276bf3abcf749a39e77fb1f04e11edf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79960) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 07:16:04.621492 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-f97453f4-3b1c-4865-a434-e82fb1684da5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:04.622402 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-f97453f4-3b1c-4865-a434-e82fb1684da5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:04.627861 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 914/1822] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Mar 30 07:16:04 2022] DELETE /identity/v3/projects/a276bf3abcf749a39e77fb1f04e11edf => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:16:04.631528 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97453f4-3b1c-4865-a434-e82fb1684da5 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:04.634656 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-f97453f4-3b1c-4865-a434-e82fb1684da5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:04.708280 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a17bb3-f3fc-4305-a1dd-cf228261458e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:04.710290 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a17bb3-f3fc-4305-a1dd-cf228261458e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:04.711012 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a17bb3-f3fc-4305-a1dd-cf228261458e admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:04.712056 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a17bb3-f3fc-4305-a1dd-cf228261458e admin admin] PATH_INFO: `/v3/users/7b8038415d0444c7a234f757183eb2ff` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:04.714437 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a17bb3-f3fc-4305-a1dd-cf228261458e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b8038415d0444c7a234f757183eb2ff)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:04.718038 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a17bb3-f3fc-4305-a1dd-cf228261458e admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:04.768538 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97453f4-3b1c-4865-a434-e82fb1684da5 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:04.780876 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a453f1b9-391d-4364-a96b-d1b62f563881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:04.783139 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a453f1b9-391d-4364-a96b-d1b62f563881 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:04.783614 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a453f1b9-391d-4364-a96b-d1b62f563881 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:04.784183 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a453f1b9-391d-4364-a96b-d1b62f563881 admin admin] PATH_INFO: `/v3/users/64a97e31688f4836bd1fbacd9b08ab6e` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:04.787555 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a453f1b9-391d-4364-a96b-d1b62f563881 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64a97e31688f4836bd1fbacd9b08ab6e)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:04.790432 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a453f1b9-391d-4364-a96b-d1b62f563881 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:04.812732 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-e2a17bb3-f3fc-4305-a1dd-cf228261458e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b8038415d0444c7a234f757183eb2ff'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:04.814858 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-e2a17bb3-f3fc-4305-a1dd-cf228261458e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b8038415d0444c7a234f757183eb2ff'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:04.815946 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-e2a17bb3-f3fc-4305-a1dd-cf228261458e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b8038415d0444c7a234f757183eb2ff'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:04.837195 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-e2a17bb3-f3fc-4305-a1dd-cf228261458e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b8038415d0444c7a234f757183eb2ff'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:04.848836 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-e2a17bb3-f3fc-4305-a1dd-cf228261458e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b8038415d0444c7a234f757183eb2ff'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:04.887140 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-a453f1b9-391d-4364-a96b-d1b62f563881 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64a97e31688f4836bd1fbacd9b08ab6e'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:04.889286 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-a453f1b9-391d-4364-a96b-d1b62f563881 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64a97e31688f4836bd1fbacd9b08ab6e'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:04.896601 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 909/1823] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Mar 30 07:16:04 2022] DELETE /identity/v3/users/7b8038415d0444c7a234f757183eb2ff => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 07:16:04.902611 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3271e599-414b-4bfe-a698-3b310e50e3fb None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:04.903428 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3271e599-414b-4bfe-a698-3b310e50e3fb None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:04.903693 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3271e599-414b-4bfe-a698-3b310e50e3fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:04.909681 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-a453f1b9-391d-4364-a96b-d1b62f563881 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64a97e31688f4836bd1fbacd9b08ab6e'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:04.946816 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-3271e599-414b-4bfe-a698-3b310e50e3fb None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:16:04.948053 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-a453f1b9-391d-4364-a96b-d1b62f563881 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64a97e31688f4836bd1fbacd9b08ab6e'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:04.948823 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-a453f1b9-391d-4364-a96b-d1b62f563881 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64a97e31688f4836bd1fbacd9b08ab6e'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:04.950469 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-3271e599-414b-4bfe-a698-3b310e50e3fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:04.983466 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 915/1824] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Mar 30 07:16:04 2022] DELETE /identity/v3/users/64a97e31688f4836bd1fbacd9b08ab6e => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:16:05.020317 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a453f1b9-391d-4364-a96b-d1b62f563881 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:05.023464 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-a453f1b9-391d-4364-a96b-d1b62f563881 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:05.064426 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 910/1825] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:16:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 07:16:05.117519 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a453f1b9-391d-4364-a96b-d1b62f563881 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:05.124204 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dee2ae6-b16f-4b9d-a98f-a7c5c0514d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:05.125072 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dee2ae6-b16f-4b9d-a98f-a7c5c0514d31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:05.125502 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dee2ae6-b16f-4b9d-a98f-a7c5c0514d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:05.125777 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dee2ae6-b16f-4b9d-a98f-a7c5c0514d31 admin admin] PATH_INFO: `/v3/users/464213e067f84fe493455d80339f0242` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:05.129910 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dee2ae6-b16f-4b9d-a98f-a7c5c0514d31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=464213e067f84fe493455d80339f0242)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:05.133346 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dee2ae6-b16f-4b9d-a98f-a7c5c0514d31 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:05.198357 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-5dee2ae6-b16f-4b9d-a98f-a7c5c0514d31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '464213e067f84fe493455d80339f0242'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:05.199047 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-5dee2ae6-b16f-4b9d-a98f-a7c5c0514d31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '464213e067f84fe493455d80339f0242'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:05.214826 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-5dee2ae6-b16f-4b9d-a98f-a7c5c0514d31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '464213e067f84fe493455d80339f0242'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:05.229216 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-5dee2ae6-b16f-4b9d-a98f-a7c5c0514d31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '464213e067f84fe493455d80339f0242'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:05.230466 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-5dee2ae6-b16f-4b9d-a98f-a7c5c0514d31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '464213e067f84fe493455d80339f0242'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:05.245346 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 916/1826] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Mar 30 07:16:05 2022] DELETE /identity/v3/users/464213e067f84fe493455d80339f0242 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:16:05.250440 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53eaafd-702c-4e53-abd4-3869786e007c None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:05.250704 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53eaafd-702c-4e53-abd4-3869786e007c None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:05.250986 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53eaafd-702c-4e53-abd4-3869786e007c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:05.272380 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-f53eaafd-702c-4e53-abd4-3869786e007c None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:16:05.273656 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-f53eaafd-702c-4e53-abd4-3869786e007c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:05.338272 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dee2ae6-b16f-4b9d-a98f-a7c5c0514d31 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:05.339526 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 911/1827] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:16:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:16:05.339704 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-5dee2ae6-b16f-4b9d-a98f-a7c5c0514d31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:05.363975 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53eaafd-702c-4e53-abd4-3869786e007c None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:05.366119 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-f53eaafd-702c-4e53-abd4-3869786e007c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:05.461213 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dee2ae6-b16f-4b9d-a98f-a7c5c0514d31 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:05.469106 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790cd3c6-5816-400a-95f3-44829250d9bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3802cb341445f994b9204744060ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:05.469786 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790cd3c6-5816-400a-95f3-44829250d9bc service neutron] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:05.470062 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790cd3c6-5816-400a-95f3-44829250d9bc service neutron] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:05.470331 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790cd3c6-5816-400a-95f3-44829250d9bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:05.476425 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-790cd3c6-5816-400a-95f3-44829250d9bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:05.501135 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53eaafd-702c-4e53-abd4-3869786e007c None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:05.515310 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b2265b-3ccf-4c5d-a923-efba081f6b14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3802cb341445f994b9204744060ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:05.516062 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b2265b-3ccf-4c5d-a923-efba081f6b14 service neutron] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:05.516514 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b2265b-3ccf-4c5d-a923-efba081f6b14 service neutron] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:05.516787 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b2265b-3ccf-4c5d-a923-efba081f6b14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:05.522791 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790cd3c6-5816-400a-95f3-44829250d9bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:05.524333 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790cd3c6-5816-400a-95f3-44829250d9bc service neutron] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:05.541634 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b2265b-3ccf-4c5d-a923-efba081f6b14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:05.545850 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b2265b-3ccf-4c5d-a923-efba081f6b14 service neutron] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:05.559685 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 917/1828] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:16:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 30 07:16:05.569210 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 912/1829] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:16:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 30 07:16:05.924459 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7444b2-7e12-4ccd-9bfc-cad57851f52e None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:05.925291 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7444b2-7e12-4ccd-9bfc-cad57851f52e None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:05.925759 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7444b2-7e12-4ccd-9bfc-cad57851f52e None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:05.929199 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 918/1830] 10.222.0.20 () {54 vars in 921 bytes} [Wed Mar 30 07:16:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:16:05.943724 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a64c0f-ecec-4824-b16b-3e573cc927a5 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:05.944286 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a64c0f-ecec-4824-b16b-3e573cc927a5 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:05.944286 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a64c0f-ecec-4824-b16b-3e573cc927a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:05.972755 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-e2a64c0f-ecec-4824-b16b-3e573cc927a5 None None] MFA Rules not processed for user `72b398c5ed14484d8b7a51fee900597b`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:16:05.974361 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-e2a64c0f-ecec-4824-b16b-3e573cc927a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:06.079621 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 913/1831] 10.222.0.20 () {58 vars in 1018 bytes} [Wed Mar 30 07:16:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:16:06.174852 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7444b2-7e12-4ccd-9bfc-cad57851f52e None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:06.183551 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-ba7444b2-7e12-4ccd-9bfc-cad57851f52e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:06.202296 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7444b2-7e12-4ccd-9bfc-cad57851f52e None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:06.208638 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b526c540-9b56-413e-ba64-ec7efd9c9a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:06.209583 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b526c540-9b56-413e-ba64-ec7efd9c9a87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:06.209877 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b526c540-9b56-413e-ba64-ec7efd9c9a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:06.210141 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b526c540-9b56-413e-ba64-ec7efd9c9a87 admin admin] PATH_INFO: `/v3/projects/6859ff608e7e48a6bde9bd21b6a49865` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:06.211416 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b526c540-9b56-413e-ba64-ec7efd9c9a87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6859ff608e7e48a6bde9bd21b6a49865)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:06.213376 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b526c540-9b56-413e-ba64-ec7efd9c9a87 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:06.269046 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-b526c540-9b56-413e-ba64-ec7efd9c9a87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6859ff608e7e48a6bde9bd21b6a49865', 'request_id': 'req-b526c540-9b56-413e-ba64-ec7efd9c9a87'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:06.278389 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-b526c540-9b56-413e-ba64-ec7efd9c9a87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6859ff608e7e48a6bde9bd21b6a49865', 'request_id': 'req-b526c540-9b56-413e-ba64-ec7efd9c9a87'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:06.287672 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-b526c540-9b56-413e-ba64-ec7efd9c9a87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6859ff608e7e48a6bde9bd21b6a49865', 'request_id': 'req-b526c540-9b56-413e-ba64-ec7efd9c9a87'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:06.304998 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-b526c540-9b56-413e-ba64-ec7efd9c9a87 admin admin] The token cache is being invalidate because project 6859ff608e7e48a6bde9bd21b6a49865 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79960) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 07:16:06.306010 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-b526c540-9b56-413e-ba64-ec7efd9c9a87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:06.309200 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-b526c540-9b56-413e-ba64-ec7efd9c9a87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:06.316874 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 919/1832] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Mar 30 07:16:06 2022] DELETE /identity/v3/projects/6859ff608e7e48a6bde9bd21b6a49865 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:16:06.317384 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ab465a-1639-4862-a366-8a9e49cf905e None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:06.317662 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ab465a-1639-4862-a366-8a9e49cf905e None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:06.317941 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ab465a-1639-4862-a366-8a9e49cf905e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:06.348841 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-07ab465a-1639-4862-a366-8a9e49cf905e None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:16:06.351034 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-07ab465a-1639-4862-a366-8a9e49cf905e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:06.426427 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b526c540-9b56-413e-ba64-ec7efd9c9a87 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:06.429418 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-b526c540-9b56-413e-ba64-ec7efd9c9a87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:06.493502 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 914/1833] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:16:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 07:16:06.502094 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e86b4e-a2b5-47de-a397-38b7940492f4 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:06.502428 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e86b4e-a2b5-47de-a397-38b7940492f4 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:06.503121 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e86b4e-a2b5-47de-a397-38b7940492f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:06.529900 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-f6e86b4e-a2b5-47de-a397-38b7940492f4 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:16:06.531383 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-f6e86b4e-a2b5-47de-a397-38b7940492f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:06.553670 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 915/1834] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:16:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:16:06.558305 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e86b4e-a2b5-47de-a397-38b7940492f4 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:06.559905 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-f6e86b4e-a2b5-47de-a397-38b7940492f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:06.609176 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b526c540-9b56-413e-ba64-ec7efd9c9a87 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:06.615512 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbde0d1-fa72-4317-a44a-af46be177476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:06.616439 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbde0d1-fa72-4317-a44a-af46be177476 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:06.616863 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbde0d1-fa72-4317-a44a-af46be177476 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:06.617404 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbde0d1-fa72-4317-a44a-af46be177476 admin admin] PATH_INFO: `/v3/projects/a5abb4822faa4316bf04e2fc0ed54e26` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:06.618968 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbde0d1-fa72-4317-a44a-af46be177476 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5abb4822faa4316bf04e2fc0ed54e26)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:06.624661 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbde0d1-fa72-4317-a44a-af46be177476 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:06.687389 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e86b4e-a2b5-47de-a397-38b7940492f4 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:06.702528 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-abbde0d1-fa72-4317-a44a-af46be177476 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5abb4822faa4316bf04e2fc0ed54e26', 'request_id': 'req-abbde0d1-fa72-4317-a44a-af46be177476'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:06.716083 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-abbde0d1-fa72-4317-a44a-af46be177476 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5abb4822faa4316bf04e2fc0ed54e26', 'request_id': 'req-abbde0d1-fa72-4317-a44a-af46be177476'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:06.729456 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-abbde0d1-fa72-4317-a44a-af46be177476 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5abb4822faa4316bf04e2fc0ed54e26', 'request_id': 'req-abbde0d1-fa72-4317-a44a-af46be177476'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:06.745334 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-abbde0d1-fa72-4317-a44a-af46be177476 admin admin] The token cache is being invalidate because project a5abb4822faa4316bf04e2fc0ed54e26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79960) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 07:16:06.745536 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-abbde0d1-fa72-4317-a44a-af46be177476 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:06.747088 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-abbde0d1-fa72-4317-a44a-af46be177476 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:06.750878 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 920/1835] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Mar 30 07:16:06 2022] DELETE /identity/v3/projects/a5abb4822faa4316bf04e2fc0ed54e26 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:16:06.751767 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbde0d1-fa72-4317-a44a-af46be177476 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:06.754759 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-abbde0d1-fa72-4317-a44a-af46be177476 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:06.770710 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1df0bb-db92-4171-a833-b7e1fc354bb5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72b398c5ed14484d8b7a51fee900597b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:06.772515 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1df0bb-db92-4171-a833-b7e1fc354bb5 service nova] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:06.773917 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1df0bb-db92-4171-a833-b7e1fc354bb5 service nova] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:06.775421 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1df0bb-db92-4171-a833-b7e1fc354bb5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:06.778009 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-ca1df0bb-db92-4171-a833-b7e1fc354bb5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:06.808771 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1df0bb-db92-4171-a833-b7e1fc354bb5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:06.810798 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1df0bb-db92-4171-a833-b7e1fc354bb5 service nova] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:06.829977 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 916/1836] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:16:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:16:06.830942 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1df0bb-db92-4171-a833-b7e1fc354bb5 service nova] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:06.833877 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-ca1df0bb-db92-4171-a833-b7e1fc354bb5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:06.876212 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbde0d1-fa72-4317-a44a-af46be177476 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:06.896651 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814e39e6-62ef-4b9e-8045-7e976912ed25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:06.897273 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814e39e6-62ef-4b9e-8045-7e976912ed25 admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:06.897563 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814e39e6-62ef-4b9e-8045-7e976912ed25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:06.897843 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814e39e6-62ef-4b9e-8045-7e976912ed25 admin admin] PATH_INFO: `/v3/domains` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:06.898633 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814e39e6-62ef-4b9e-8045-7e976912ed25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:16:06.898885 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814e39e6-62ef-4b9e-8045-7e976912ed25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:06.900536 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814e39e6-62ef-4b9e-8045-7e976912ed25 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:06.923853 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 921/1837] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Mar 30 07:16:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:16:06.924480 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814e39e6-62ef-4b9e-8045-7e976912ed25 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:06.929038 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-814e39e6-62ef-4b9e-8045-7e976912ed25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:06.931701 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1df0bb-db92-4171-a833-b7e1fc354bb5 service nova] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:06.938016 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debefb0b-1e7d-46d6-bcb7-00beefb05dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:06.939355 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debefb0b-1e7d-46d6-bcb7-00beefb05dca admin admin] REQUEST_METHOD: `DELETE` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:06.939938 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debefb0b-1e7d-46d6-bcb7-00beefb05dca admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:06.942326 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debefb0b-1e7d-46d6-bcb7-00beefb05dca admin admin] PATH_INFO: `/v3/projects/56017e238c18411991786143ddfcc3a3` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:06.944221 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debefb0b-1e7d-46d6-bcb7-00beefb05dca admin admin] RBAC: Authorizing `identity:delete_project(project_id=56017e238c18411991786143ddfcc3a3)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:06.947426 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debefb0b-1e7d-46d6-bcb7-00beefb05dca admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:06.953492 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814e39e6-62ef-4b9e-8045-7e976912ed25 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:06.961038 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73309375-752d-4325-8d45-45995a8d7937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:06.962028 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73309375-752d-4325-8d45-45995a8d7937 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:06.962375 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73309375-752d-4325-8d45-45995a8d7937 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:06.962716 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73309375-752d-4325-8d45-45995a8d7937 admin admin] PATH_INFO: `/v3/users/baf3caa0486348c0a0acb436a5c011c0` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:06.964174 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73309375-752d-4325-8d45-45995a8d7937 admin admin] RBAC: Authorizing `identity:delete_user(user_id=baf3caa0486348c0a0acb436a5c011c0)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:06.966577 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73309375-752d-4325-8d45-45995a8d7937 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:07.034504 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-debefb0b-1e7d-46d6-bcb7-00beefb05dca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56017e238c18411991786143ddfcc3a3', 'request_id': 'req-debefb0b-1e7d-46d6-bcb7-00beefb05dca'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:07.047239 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-debefb0b-1e7d-46d6-bcb7-00beefb05dca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56017e238c18411991786143ddfcc3a3', 'request_id': 'req-debefb0b-1e7d-46d6-bcb7-00beefb05dca'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:07.052466 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-73309375-752d-4325-8d45-45995a8d7937 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'baf3caa0486348c0a0acb436a5c011c0'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:07.053377 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-73309375-752d-4325-8d45-45995a8d7937 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'baf3caa0486348c0a0acb436a5c011c0'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:07.062902 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-debefb0b-1e7d-46d6-bcb7-00beefb05dca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56017e238c18411991786143ddfcc3a3', 'request_id': 'req-debefb0b-1e7d-46d6-bcb7-00beefb05dca'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:07.069729 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-73309375-752d-4325-8d45-45995a8d7937 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'baf3caa0486348c0a0acb436a5c011c0'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:07.081691 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-debefb0b-1e7d-46d6-bcb7-00beefb05dca admin admin] The token cache is being invalidate because project 56017e238c18411991786143ddfcc3a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79961) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 07:16:07.082451 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-debefb0b-1e7d-46d6-bcb7-00beefb05dca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:07.082679 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-debefb0b-1e7d-46d6-bcb7-00beefb05dca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:07.084312 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 917/1838] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Mar 30 07:16:06 2022] DELETE /identity/v3/projects/56017e238c18411991786143ddfcc3a3 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:16:07.085120 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debefb0b-1e7d-46d6-bcb7-00beefb05dca admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:07.086799 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-debefb0b-1e7d-46d6-bcb7-00beefb05dca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:07.096681 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-73309375-752d-4325-8d45-45995a8d7937 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'baf3caa0486348c0a0acb436a5c011c0'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:07.098635 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-73309375-752d-4325-8d45-45995a8d7937 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'baf3caa0486348c0a0acb436a5c011c0'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:07.119236 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 922/1839] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Mar 30 07:16:06 2022] DELETE /identity/v3/users/baf3caa0486348c0a0acb436a5c011c0 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:16:07.120286 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73309375-752d-4325-8d45-45995a8d7937 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:07.121739 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-73309375-752d-4325-8d45-45995a8d7937 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:07.226681 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73309375-752d-4325-8d45-45995a8d7937 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:07.227471 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debefb0b-1e7d-46d6-bcb7-00beefb05dca admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:07.232682 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53f46ee-b8d5-4ea7-978a-a453f877f0ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:07.233753 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53f46ee-b8d5-4ea7-978a-a453f877f0ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:07.234092 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53f46ee-b8d5-4ea7-978a-a453f877f0ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:07.234422 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53f46ee-b8d5-4ea7-978a-a453f877f0ac admin admin] PATH_INFO: `/v3/users/4f0995ac812a4fd79b00d7c1b580166a` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:07.235718 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53f46ee-b8d5-4ea7-978a-a453f877f0ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f0995ac812a4fd79b00d7c1b580166a)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:07.237814 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53f46ee-b8d5-4ea7-978a-a453f877f0ac admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:07.240323 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6df5a3-80db-47bf-a269-1169c27deeda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:07.241039 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6df5a3-80db-47bf-a269-1169c27deeda admin admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:07.241321 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6df5a3-80db-47bf-a269-1169c27deeda admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:07.241595 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6df5a3-80db-47bf-a269-1169c27deeda admin admin] PATH_INFO: `/v3/projects` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:07.243765 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6df5a3-80db-47bf-a269-1169c27deeda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:07.249509 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6df5a3-80db-47bf-a269-1169c27deeda admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:07.306873 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 918/1840] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Mar 30 07:16:07 2022] POST /identity/v3/projects => generated 381 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:16:07.311951 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6df5a3-80db-47bf-a269-1169c27deeda admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:07.312162 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-a53f46ee-b8d5-4ea7-978a-a453f877f0ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f0995ac812a4fd79b00d7c1b580166a'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:07.313074 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-a53f46ee-b8d5-4ea7-978a-a453f877f0ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f0995ac812a4fd79b00d7c1b580166a'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:07.317435 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-6d6df5a3-80db-47bf-a269-1169c27deeda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:07.332360 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-a53f46ee-b8d5-4ea7-978a-a453f877f0ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f0995ac812a4fd79b00d7c1b580166a'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:07.360137 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-a53f46ee-b8d5-4ea7-978a-a453f877f0ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f0995ac812a4fd79b00d7c1b580166a'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:07.361281 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-a53f46ee-b8d5-4ea7-978a-a453f877f0ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f0995ac812a4fd79b00d7c1b580166a'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:07.390000 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 923/1841] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Mar 30 07:16:07 2022] DELETE /identity/v3/users/4f0995ac812a4fd79b00d7c1b580166a => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:16:07.443308 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6df5a3-80db-47bf-a269-1169c27deeda admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:07.562638 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e7b95c-7ccf-4175-8b7a-965eab49c076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:07.563451 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e7b95c-7ccf-4175-8b7a-965eab49c076 admin admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:07.563645 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e7b95c-7ccf-4175-8b7a-965eab49c076 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:07.564011 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e7b95c-7ccf-4175-8b7a-965eab49c076 admin admin] PATH_INFO: `/v3/users` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:07.564721 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e7b95c-7ccf-4175-8b7a-965eab49c076 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:07.566672 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e7b95c-7ccf-4175-8b7a-965eab49c076 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:07.620770 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53f46ee-b8d5-4ea7-978a-a453f877f0ac admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:07.627706 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 919/1842] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Mar 30 07:16:07 2022] POST /identity/v3/users => generated 291 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:16:07.632799 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53f46ee-b8d5-4ea7-978a-a453f877f0ac admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:07.640196 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50748ef-e6fa-4b6b-be23-bd7235c97c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:07.640196 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50748ef-e6fa-4b6b-be23-bd7235c97c53 admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:07.640196 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50748ef-e6fa-4b6b-be23-bd7235c97c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:07.640196 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50748ef-e6fa-4b6b-be23-bd7235c97c53 admin admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:07.640689 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50748ef-e6fa-4b6b-be23-bd7235c97c53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:07.642634 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50748ef-e6fa-4b6b-be23-bd7235c97c53 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:07.665676 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e7b95c-7ccf-4175-8b7a-965eab49c076 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:07.679327 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 924/1843] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:16:07 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:16:07.687002 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e7b95c-7ccf-4175-8b7a-965eab49c076 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:07.698281 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7842d36e-70b3-4923-997f-6de74d164de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:07.699891 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7842d36e-70b3-4923-997f-6de74d164de7 admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:07.702407 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7842d36e-70b3-4923-997f-6de74d164de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:07.702860 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7842d36e-70b3-4923-997f-6de74d164de7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:07.703778 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7842d36e-70b3-4923-997f-6de74d164de7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:07.705789 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7842d36e-70b3-4923-997f-6de74d164de7 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:07.719513 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 920/1844] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:16:07 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:16:07.724037 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50748ef-e6fa-4b6b-be23-bd7235c97c53 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:07.739124 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50748ef-e6fa-4b6b-be23-bd7235c97c53 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:07.744531 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972dca77-9214-4565-8d11-5d987683e9b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:07.745725 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972dca77-9214-4565-8d11-5d987683e9b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:07.746077 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972dca77-9214-4565-8d11-5d987683e9b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:07.746494 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972dca77-9214-4565-8d11-5d987683e9b4 admin admin] PATH_INFO: `/v3/projects/a2c97b80e35b4a449351a32783539593/users/8cb0b32e0455452b8c482f0bfab45ad2/roles/5d79031a64754b57ba120367465e2252` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:07.772967 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972dca77-9214-4565-8d11-5d987683e9b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2c97b80e35b4a449351a32783539593, user_id=8cb0b32e0455452b8c482f0bfab45ad2, role_id=5d79031a64754b57ba120367465e2252)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:07.775888 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972dca77-9214-4565-8d11-5d987683e9b4 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:07.796561 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 925/1845] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:16:07 2022] PUT /identity/v3/projects/a2c97b80e35b4a449351a32783539593/users/8cb0b32e0455452b8c482f0bfab45ad2/roles/5d79031a64754b57ba120367465e2252 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 07:16:07.810001 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431bee05-5c31-4add-b396-6ff72e18a438 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:07.810290 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431bee05-5c31-4add-b396-6ff72e18a438 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:07.811219 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431bee05-5c31-4add-b396-6ff72e18a438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:07.855020 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-431bee05-5c31-4add-b396-6ff72e18a438 None None] MFA Rules not processed for user `8cb0b32e0455452b8c482f0bfab45ad2`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:16:07.856919 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-431bee05-5c31-4add-b396-6ff72e18a438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:07.951869 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 921/1846] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:16:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:16:07.954029 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972dca77-9214-4565-8d11-5d987683e9b4 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:08.033083 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972dca77-9214-4565-8d11-5d987683e9b4 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:08.037370 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a3dc46-ea26-4bc4-b3f8-331504a1175d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:08.038126 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a3dc46-ea26-4bc4-b3f8-331504a1175d admin admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:08.038481 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a3dc46-ea26-4bc4-b3f8-331504a1175d admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:08.038758 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a3dc46-ea26-4bc4-b3f8-331504a1175d admin admin] PATH_INFO: `/v3/projects` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:08.039467 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a3dc46-ea26-4bc4-b3f8-331504a1175d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:08.041473 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a3dc46-ea26-4bc4-b3f8-331504a1175d admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:08.079525 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431bee05-5c31-4add-b396-6ff72e18a438 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:08.080018 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 926/1847] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Mar 30 07:16:07 2022] POST /identity/v3/projects => generated 379 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:16:08.092907 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431bee05-5c31-4add-b396-6ff72e18a438 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:08.230334 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42e5d8a-9a85-4889-838f-3d1c2a6b82c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:08.231032 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42e5d8a-9a85-4889-838f-3d1c2a6b82c5 admin admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:08.231771 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42e5d8a-9a85-4889-838f-3d1c2a6b82c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:08.232179 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42e5d8a-9a85-4889-838f-3d1c2a6b82c5 admin admin] PATH_INFO: `/v3/users` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:08.232893 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42e5d8a-9a85-4889-838f-3d1c2a6b82c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:08.235041 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42e5d8a-9a85-4889-838f-3d1c2a6b82c5 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:08.264917 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 922/1848] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Mar 30 07:16:08 2022] POST /identity/v3/users => generated 296 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:16:08.269586 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a3dc46-ea26-4bc4-b3f8-331504a1175d admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:08.280773 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a3dc46-ea26-4bc4-b3f8-331504a1175d admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:08.297272 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2db04fc-44c1-49c8-90ef-d7aee74f349e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:08.298569 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2db04fc-44c1-49c8-90ef-d7aee74f349e admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:08.298872 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2db04fc-44c1-49c8-90ef-d7aee74f349e admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:08.299133 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2db04fc-44c1-49c8-90ef-d7aee74f349e admin admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:08.300260 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2db04fc-44c1-49c8-90ef-d7aee74f349e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:08.301722 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2db04fc-44c1-49c8-90ef-d7aee74f349e admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:08.334369 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 927/1849] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:16:08 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:16:08.335476 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42e5d8a-9a85-4889-838f-3d1c2a6b82c5 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:08.350302 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42e5d8a-9a85-4889-838f-3d1c2a6b82c5 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:08.363331 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8282cf5-0c83-4bc2-9211-91a6412c1817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:08.365249 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8282cf5-0c83-4bc2-9211-91a6412c1817 admin admin] REQUEST_METHOD: `PUT` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:08.365752 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8282cf5-0c83-4bc2-9211-91a6412c1817 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:08.366256 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8282cf5-0c83-4bc2-9211-91a6412c1817 admin admin] PATH_INFO: `/v3/projects/f321f3bc12434058aa8cda4c217cac1c/users/42b20d1693354fe5bf6cf5a7321e8677/roles/1c39b9ab8cfd4c0ea71845831920a845` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:08.372551 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2db04fc-44c1-49c8-90ef-d7aee74f349e admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:08.374423 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-d2db04fc-44c1-49c8-90ef-d7aee74f349e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:08.397192 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2db04fc-44c1-49c8-90ef-d7aee74f349e admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:08.397555 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8282cf5-0c83-4bc2-9211-91a6412c1817 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f321f3bc12434058aa8cda4c217cac1c, user_id=42b20d1693354fe5bf6cf5a7321e8677, role_id=1c39b9ab8cfd4c0ea71845831920a845)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:08.400447 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8282cf5-0c83-4bc2-9211-91a6412c1817 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:08.412144 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2e5110-56fc-4bf2-834f-76aaa777828c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:08.413027 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2e5110-56fc-4bf2-834f-76aaa777828c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:08.413323 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2e5110-56fc-4bf2-834f-76aaa777828c admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:08.413589 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2e5110-56fc-4bf2-834f-76aaa777828c admin admin] PATH_INFO: `/v3/projects/ad956698aa524d8497f22da5d6f81c41` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:08.414151 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 923/1850] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:16:08 2022] PUT /identity/v3/projects/f321f3bc12434058aa8cda4c217cac1c/users/42b20d1693354fe5bf6cf5a7321e8677/roles/1c39b9ab8cfd4c0ea71845831920a845 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:16:08.415926 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2e5110-56fc-4bf2-834f-76aaa777828c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad956698aa524d8497f22da5d6f81c41)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:08.416738 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2e5110-56fc-4bf2-834f-76aaa777828c admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:08.418247 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8282cf5-0c83-4bc2-9211-91a6412c1817 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:08.495297 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-7c2e5110-56fc-4bf2-834f-76aaa777828c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad956698aa524d8497f22da5d6f81c41', 'request_id': 'req-7c2e5110-56fc-4bf2-834f-76aaa777828c'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:08.514813 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-7c2e5110-56fc-4bf2-834f-76aaa777828c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad956698aa524d8497f22da5d6f81c41', 'request_id': 'req-7c2e5110-56fc-4bf2-834f-76aaa777828c'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:08.530206 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-7c2e5110-56fc-4bf2-834f-76aaa777828c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad956698aa524d8497f22da5d6f81c41', 'request_id': 'req-7c2e5110-56fc-4bf2-834f-76aaa777828c'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:08.531940 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8282cf5-0c83-4bc2-9211-91a6412c1817 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:08.544638 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-7c2e5110-56fc-4bf2-834f-76aaa777828c admin admin] The token cache is being invalidate because project ad956698aa524d8497f22da5d6f81c41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79960) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 07:16:08.545235 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-7c2e5110-56fc-4bf2-834f-76aaa777828c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:08.546785 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-7c2e5110-56fc-4bf2-834f-76aaa777828c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:08.550530 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 928/1851] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Mar 30 07:16:08 2022] DELETE /identity/v3/projects/ad956698aa524d8497f22da5d6f81c41 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:16:08.551747 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2e5110-56fc-4bf2-834f-76aaa777828c admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:08.553985 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-7c2e5110-56fc-4bf2-834f-76aaa777828c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:08.621103 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286e7083-580d-49ad-b111-dff8379160d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:08.621804 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286e7083-580d-49ad-b111-dff8379160d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:08.622086 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286e7083-580d-49ad-b111-dff8379160d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:08.622357 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286e7083-580d-49ad-b111-dff8379160d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:08.623086 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286e7083-580d-49ad-b111-dff8379160d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:08.624728 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286e7083-580d-49ad-b111-dff8379160d0 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:08.634833 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 924/1852] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:16:08 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 30 07:16:08.636272 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32650f86-5d08-413a-95c5-04117e4600ee None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:08.636555 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32650f86-5d08-413a-95c5-04117e4600ee None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:08.636830 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32650f86-5d08-413a-95c5-04117e4600ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:08.650616 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2e5110-56fc-4bf2-834f-76aaa777828c admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:08.657190 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca126ca2-be38-42ba-af4b-9b9f01419132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:08.657897 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca126ca2-be38-42ba-af4b-9b9f01419132 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:08.658180 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca126ca2-be38-42ba-af4b-9b9f01419132 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:08.658458 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca126ca2-be38-42ba-af4b-9b9f01419132 admin admin] PATH_INFO: `/v3/projects/fe32a888f4ad4ea2b4e44254db9e7524` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:08.659888 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca126ca2-be38-42ba-af4b-9b9f01419132 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe32a888f4ad4ea2b4e44254db9e7524)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:08.662699 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca126ca2-be38-42ba-af4b-9b9f01419132 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:08.665289 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-32650f86-5d08-413a-95c5-04117e4600ee None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:16:08.666864 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-32650f86-5d08-413a-95c5-04117e4600ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:08.679192 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 925/1853] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:16:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:16:08.688984 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32650f86-5d08-413a-95c5-04117e4600ee None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:08.693022 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-32650f86-5d08-413a-95c5-04117e4600ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:08.709377 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32650f86-5d08-413a-95c5-04117e4600ee None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:08.718393 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b91dd41-bfd0-4ef1-897a-38239c9700fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:08.719625 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b91dd41-bfd0-4ef1-897a-38239c9700fa admin admin] REQUEST_METHOD: `PUT` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:08.720382 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b91dd41-bfd0-4ef1-897a-38239c9700fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:08.720753 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b91dd41-bfd0-4ef1-897a-38239c9700fa admin admin] PATH_INFO: `/v3/projects/f321f3bc12434058aa8cda4c217cac1c/users/42b20d1693354fe5bf6cf5a7321e8677/roles/1c39b9ab8cfd4c0ea71845831920a845` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:08.724640 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b91dd41-bfd0-4ef1-897a-38239c9700fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=f321f3bc12434058aa8cda4c217cac1c, user_id=42b20d1693354fe5bf6cf5a7321e8677, role_id=1c39b9ab8cfd4c0ea71845831920a845)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:08.726666 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-ca126ca2-be38-42ba-af4b-9b9f01419132 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe32a888f4ad4ea2b4e44254db9e7524', 'request_id': 'req-ca126ca2-be38-42ba-af4b-9b9f01419132'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:08.728480 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b91dd41-bfd0-4ef1-897a-38239c9700fa admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:08.737878 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-ca126ca2-be38-42ba-af4b-9b9f01419132 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe32a888f4ad4ea2b4e44254db9e7524', 'request_id': 'req-ca126ca2-be38-42ba-af4b-9b9f01419132'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:08.750851 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 926/1854] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:16:08 2022] PUT /identity/v3/projects/f321f3bc12434058aa8cda4c217cac1c/users/42b20d1693354fe5bf6cf5a7321e8677/roles/1c39b9ab8cfd4c0ea71845831920a845 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:16:08.750851 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58a5112-60a8-4e10-aa69-61432fe92787 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:08.750851 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58a5112-60a8-4e10-aa69-61432fe92787 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:08.750851 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58a5112-60a8-4e10-aa69-61432fe92787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:08.751271 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-ca126ca2-be38-42ba-af4b-9b9f01419132 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe32a888f4ad4ea2b4e44254db9e7524', 'request_id': 'req-ca126ca2-be38-42ba-af4b-9b9f01419132'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:08.759142 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-ca126ca2-be38-42ba-af4b-9b9f01419132 admin admin] The token cache is being invalidate because project fe32a888f4ad4ea2b4e44254db9e7524 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79960) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 07:16:08.759447 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-ca126ca2-be38-42ba-af4b-9b9f01419132 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:08.760258 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-ca126ca2-be38-42ba-af4b-9b9f01419132 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:08.763348 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 929/1855] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Mar 30 07:16:08 2022] DELETE /identity/v3/projects/fe32a888f4ad4ea2b4e44254db9e7524 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:16:08.765612 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65139408-77b8-4e34-ab09-1471f3c9df1d None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:08.765890 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65139408-77b8-4e34-ab09-1471f3c9df1d None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:08.766165 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65139408-77b8-4e34-ab09-1471f3c9df1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:08.784914 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-a58a5112-60a8-4e10-aa69-61432fe92787 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:16:08.786128 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-a58a5112-60a8-4e10-aa69-61432fe92787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:08.808901 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-65139408-77b8-4e34-ab09-1471f3c9df1d None None] MFA Rules not processed for user `42b20d1693354fe5bf6cf5a7321e8677`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:16:08.811959 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-65139408-77b8-4e34-ab09-1471f3c9df1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:08.861396 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 927/1856] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:16:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:16:08.862757 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58a5112-60a8-4e10-aa69-61432fe92787 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:08.866005 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-a58a5112-60a8-4e10-aa69-61432fe92787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:08.880358 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58a5112-60a8-4e10-aa69-61432fe92787 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:08.892685 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f7aa2b-b032-418d-9bcb-100e9a9c81fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:08.894172 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f7aa2b-b032-418d-9bcb-100e9a9c81fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:08.894637 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f7aa2b-b032-418d-9bcb-100e9a9c81fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:08.895178 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f7aa2b-b032-418d-9bcb-100e9a9c81fe admin admin] PATH_INFO: `/v3/users/f1669554db804a6a97fad6e331df7ecd` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:08.896664 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f7aa2b-b032-418d-9bcb-100e9a9c81fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1669554db804a6a97fad6e331df7ecd)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:08.898793 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f7aa2b-b032-418d-9bcb-100e9a9c81fe admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:08.912640 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 930/1857] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:16:08 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:16:08.919597 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65139408-77b8-4e34-ab09-1471f3c9df1d None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:08.939030 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65139408-77b8-4e34-ab09-1471f3c9df1d None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:08.946939 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a5430d-c3ac-457c-8f09-224277f2d07d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:08.948075 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a5430d-c3ac-457c-8f09-224277f2d07d admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:08.948820 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a5430d-c3ac-457c-8f09-224277f2d07d admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:08.949095 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a5430d-c3ac-457c-8f09-224277f2d07d admin admin] PATH_INFO: `/v3/domains` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:08.951200 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a5430d-c3ac-457c-8f09-224277f2d07d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:16:08.951711 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a5430d-c3ac-457c-8f09-224277f2d07d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:08.953607 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a5430d-c3ac-457c-8f09-224277f2d07d admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:08.975535 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-e8f7aa2b-b032-418d-9bcb-100e9a9c81fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1669554db804a6a97fad6e331df7ecd'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:08.976586 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-e8f7aa2b-b032-418d-9bcb-100e9a9c81fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1669554db804a6a97fad6e331df7ecd'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:08.977608 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-e8f7aa2b-b032-418d-9bcb-100e9a9c81fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1669554db804a6a97fad6e331df7ecd'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:08.989646 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-e8f7aa2b-b032-418d-9bcb-100e9a9c81fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1669554db804a6a97fad6e331df7ecd'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:08.998677 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-e8f7aa2b-b032-418d-9bcb-100e9a9c81fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1669554db804a6a97fad6e331df7ecd'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:09.009563 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 931/1858] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Mar 30 07:16:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:16:09.010741 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a5430d-c3ac-457c-8f09-224277f2d07d admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:09.013086 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-45a5430d-c3ac-457c-8f09-224277f2d07d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:09.054438 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 928/1859] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Mar 30 07:16:08 2022] DELETE /identity/v3/users/f1669554db804a6a97fad6e331df7ecd => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:16:09.056969 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f7aa2b-b032-418d-9bcb-100e9a9c81fe admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:09.059156 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-e8f7aa2b-b032-418d-9bcb-100e9a9c81fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:09.096173 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a5430d-c3ac-457c-8f09-224277f2d07d admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:09.157161 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f7aa2b-b032-418d-9bcb-100e9a9c81fe admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:09.161749 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86513b16-28fb-415e-a588-555d36975bac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e2fda180e8d448d895c40cdad34bc4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:09.162324 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b77932b-874e-4f84-af3c-66668776ca39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:09.162468 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86513b16-28fb-415e-a588-555d36975bac service cinder] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:09.162691 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86513b16-28fb-415e-a588-555d36975bac service cinder] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:09.162969 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86513b16-28fb-415e-a588-555d36975bac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:09.163178 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b77932b-874e-4f84-af3c-66668776ca39 admin admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:09.163534 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b77932b-874e-4f84-af3c-66668776ca39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:09.164307 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b77932b-874e-4f84-af3c-66668776ca39 admin admin] PATH_INFO: `/v3/projects` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:09.164749 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b77932b-874e-4f84-af3c-66668776ca39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:09.165033 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-86513b16-28fb-415e-a588-555d36975bac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:09.167541 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b77932b-874e-4f84-af3c-66668776ca39 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:09.203478 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 929/1860] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Mar 30 07:16:09 2022] POST /identity/v3/projects => generated 381 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:16:09.204617 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b77932b-874e-4f84-af3c-66668776ca39 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:09.249724 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86513b16-28fb-415e-a588-555d36975bac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:09.251200 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86513b16-28fb-415e-a588-555d36975bac service cinder] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:09.262795 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 932/1861] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:16:09 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:16:09.297894 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b77932b-874e-4f84-af3c-66668776ca39 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:09.304816 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223ed400-63b2-47f5-90e6-364a0d6bdb83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:09.305674 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223ed400-63b2-47f5-90e6-364a0d6bdb83 admin admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:09.306083 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223ed400-63b2-47f5-90e6-364a0d6bdb83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:09.306371 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223ed400-63b2-47f5-90e6-364a0d6bdb83 admin admin] PATH_INFO: `/v3/users` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:09.307482 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223ed400-63b2-47f5-90e6-364a0d6bdb83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:09.309294 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223ed400-63b2-47f5-90e6-364a0d6bdb83 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:09.336659 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 930/1862] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Mar 30 07:16:09 2022] POST /identity/v3/users => generated 291 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:16:09.340985 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86513b16-28fb-415e-a588-555d36975bac service cinder] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:09.356246 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86513b16-28fb-415e-a588-555d36975bac service cinder] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:09.377623 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657d2321-621b-43d5-9e11-6b4433c60845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:09.378732 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657d2321-621b-43d5-9e11-6b4433c60845 admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:09.382206 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657d2321-621b-43d5-9e11-6b4433c60845 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:09.382765 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657d2321-621b-43d5-9e11-6b4433c60845 admin admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:09.383894 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657d2321-621b-43d5-9e11-6b4433c60845 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:09.386844 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657d2321-621b-43d5-9e11-6b4433c60845 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:09.409434 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223ed400-63b2-47f5-90e6-364a0d6bdb83 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:09.410048 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 933/1863] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:16:09 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:16:09.429670 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223ed400-63b2-47f5-90e6-364a0d6bdb83 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:09.439311 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e0ba12-7d7b-47ea-ad11-791bbe822fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:09.440029 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e0ba12-7d7b-47ea-ad11-791bbe822fce admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:09.441456 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e0ba12-7d7b-47ea-ad11-791bbe822fce admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:09.441748 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e0ba12-7d7b-47ea-ad11-791bbe822fce admin admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:09.442496 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e0ba12-7d7b-47ea-ad11-791bbe822fce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:09.446989 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e0ba12-7d7b-47ea-ad11-791bbe822fce admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:09.475152 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 931/1864] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:16:09 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 30 07:16:09.479645 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657d2321-621b-43d5-9e11-6b4433c60845 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:09.500617 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657d2321-621b-43d5-9e11-6b4433c60845 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:09.518654 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ab164a-27f4-4a4c-9b8c-994fed02753f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:09.520940 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ab164a-27f4-4a4c-9b8c-994fed02753f admin admin] REQUEST_METHOD: `PUT` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:09.522458 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ab164a-27f4-4a4c-9b8c-994fed02753f admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:09.522874 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ab164a-27f4-4a4c-9b8c-994fed02753f admin admin] PATH_INFO: `/v3/projects/893e3b80ed084ef992de9503d05aca17/users/a9cf134174164764b89853ef89b4d6e1/roles/5d79031a64754b57ba120367465e2252` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:09.560622 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ab164a-27f4-4a4c-9b8c-994fed02753f admin admin] RBAC: Authorizing `identity:create_grant(project_id=893e3b80ed084ef992de9503d05aca17, user_id=a9cf134174164764b89853ef89b4d6e1, role_id=5d79031a64754b57ba120367465e2252)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:09.564796 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ab164a-27f4-4a4c-9b8c-994fed02753f admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:09.615607 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19269109-dc4e-4946-81cb-ee54ef75c571 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:09.616242 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19269109-dc4e-4946-81cb-ee54ef75c571 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:09.616367 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 934/1865] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:16:09 2022] PUT /identity/v3/projects/893e3b80ed084ef992de9503d05aca17/users/a9cf134174164764b89853ef89b4d6e1/roles/5d79031a64754b57ba120367465e2252 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:16:09.616791 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19269109-dc4e-4946-81cb-ee54ef75c571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:09.708083 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-19269109-dc4e-4946-81cb-ee54ef75c571 None None] MFA Rules not processed for user `a9cf134174164764b89853ef89b4d6e1`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:16:09.718867 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-19269109-dc4e-4946-81cb-ee54ef75c571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:09.914028 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 932/1866] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:16:09 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 07:16:09.918193 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19269109-dc4e-4946-81cb-ee54ef75c571 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:09.918320 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ab164a-27f4-4a4c-9b8c-994fed02753f admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:10.024790 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19269109-dc4e-4946-81cb-ee54ef75c571 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:10.035029 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4983c28c-ef5c-408e-a8f5-8865f4465615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:10.035910 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4983c28c-ef5c-408e-a8f5-8865f4465615 admin admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:10.036596 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4983c28c-ef5c-408e-a8f5-8865f4465615 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:10.036920 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4983c28c-ef5c-408e-a8f5-8865f4465615 admin admin] PATH_INFO: `/v3/projects` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:10.037941 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4983c28c-ef5c-408e-a8f5-8865f4465615 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:10.040514 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ab164a-27f4-4a4c-9b8c-994fed02753f admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:10.041195 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4983c28c-ef5c-408e-a8f5-8865f4465615 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:10.046588 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29c0a22-ebba-4164-97b4-c69410e88568 tempest-VolumeQuotaClassesTest-187410323 tempest-VolumeQuotaClassesTest-187410323-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42b20d1693354fe5bf6cf5a7321e8677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f321f3bc12434058aa8cda4c217cac1c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:10.047380 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29c0a22-ebba-4164-97b4-c69410e88568 tempest-VolumeQuotaClassesTest-187410323 tempest-VolumeQuotaClassesTest-187410323-project-admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:10.047731 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29c0a22-ebba-4164-97b4-c69410e88568 tempest-VolumeQuotaClassesTest-187410323 tempest-VolumeQuotaClassesTest-187410323-project-admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:10.048094 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29c0a22-ebba-4164-97b4-c69410e88568 tempest-VolumeQuotaClassesTest-187410323 tempest-VolumeQuotaClassesTest-187410323-project-admin] PATH_INFO: `/v3/domains` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:10.048942 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29c0a22-ebba-4164-97b4-c69410e88568 tempest-VolumeQuotaClassesTest-187410323 tempest-VolumeQuotaClassesTest-187410323-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:16:10.049411 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29c0a22-ebba-4164-97b4-c69410e88568 tempest-VolumeQuotaClassesTest-187410323 tempest-VolumeQuotaClassesTest-187410323-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:10.051295 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29c0a22-ebba-4164-97b4-c69410e88568 tempest-VolumeQuotaClassesTest-187410323 tempest-VolumeQuotaClassesTest-187410323-project-admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:10.070928 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 935/1867] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Mar 30 07:16:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:16:10.076704 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 933/1868] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Mar 30 07:16:09 2022] POST /identity/v3/projects => generated 381 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:16:10.082109 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4983c28c-ef5c-408e-a8f5-8865f4465615 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:10.084652 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29c0a22-ebba-4164-97b4-c69410e88568 tempest-VolumeQuotaClassesTest-187410323 tempest-VolumeQuotaClassesTest-187410323-project-admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:10.107029 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29c0a22-ebba-4164-97b4-c69410e88568 tempest-VolumeQuotaClassesTest-187410323 tempest-VolumeQuotaClassesTest-187410323-project-admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:10.206998 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4983c28c-ef5c-408e-a8f5-8865f4465615 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:10.215846 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3d8ca4-74fc-482e-97d5-4321ed51a242 tempest-VolumeQuotaClassesTest-187410323 tempest-VolumeQuotaClassesTest-187410323-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42b20d1693354fe5bf6cf5a7321e8677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f321f3bc12434058aa8cda4c217cac1c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:10.222233 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c288804-d16f-476b-b2c4-ec66490a277d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:10.224913 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c288804-d16f-476b-b2c4-ec66490a277d admin admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:10.225048 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3d8ca4-74fc-482e-97d5-4321ed51a242 tempest-VolumeQuotaClassesTest-187410323 tempest-VolumeQuotaClassesTest-187410323-project-admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:10.225234 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3d8ca4-74fc-482e-97d5-4321ed51a242 tempest-VolumeQuotaClassesTest-187410323 tempest-VolumeQuotaClassesTest-187410323-project-admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:10.225717 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c288804-d16f-476b-b2c4-ec66490a277d admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:10.226280 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c288804-d16f-476b-b2c4-ec66490a277d admin admin] PATH_INFO: `/v3/users` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:10.227186 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c288804-d16f-476b-b2c4-ec66490a277d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:10.228934 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3d8ca4-74fc-482e-97d5-4321ed51a242 tempest-VolumeQuotaClassesTest-187410323 tempest-VolumeQuotaClassesTest-187410323-project-admin] PATH_INFO: `/v3/projects` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:10.230309 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3d8ca4-74fc-482e-97d5-4321ed51a242 tempest-VolumeQuotaClassesTest-187410323 tempest-VolumeQuotaClassesTest-187410323-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:10.230905 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c288804-d16f-476b-b2c4-ec66490a277d admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:10.238422 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3d8ca4-74fc-482e-97d5-4321ed51a242 tempest-VolumeQuotaClassesTest-187410323 tempest-VolumeQuotaClassesTest-187410323-project-admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:10.276012 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 934/1869] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Mar 30 07:16:10 2022] POST /identity/v3/users => generated 297 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 07:16:10.277962 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c288804-d16f-476b-b2c4-ec66490a277d admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:10.280834 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-8c288804-d16f-476b-b2c4-ec66490a277d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:10.304030 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 936/1870] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Mar 30 07:16:10 2022] POST /identity/v3/projects => generated 355 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:16:10.304030 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3d8ca4-74fc-482e-97d5-4321ed51a242 tempest-VolumeQuotaClassesTest-187410323 tempest-VolumeQuotaClassesTest-187410323-project-admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:10.308440 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c288804-d16f-476b-b2c4-ec66490a277d admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:10.405075 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3d8ca4-74fc-482e-97d5-4321ed51a242 tempest-VolumeQuotaClassesTest-187410323 tempest-VolumeQuotaClassesTest-187410323-project-admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:10.410687 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a1c6c2-3a6d-4921-bec0-705fd63142db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:10.411440 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a1c6c2-3a6d-4921-bec0-705fd63142db admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:10.411793 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a1c6c2-3a6d-4921-bec0-705fd63142db admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:10.412167 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a1c6c2-3a6d-4921-bec0-705fd63142db admin admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:10.412984 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a1c6c2-3a6d-4921-bec0-705fd63142db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:10.414643 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a1c6c2-3a6d-4921-bec0-705fd63142db admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:10.421200 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008d3c19-da40-43b9-9119-ad2c15826149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:10.422096 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d3c19-da40-43b9-9119-ad2c15826149 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:10.422386 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d3c19-da40-43b9-9119-ad2c15826149 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:10.423331 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d3c19-da40-43b9-9119-ad2c15826149 admin admin] PATH_INFO: `/v3/projects/afcd4fc046cd411c9b0ba52cfd131331` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:10.424789 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008d3c19-da40-43b9-9119-ad2c15826149 admin admin] RBAC: Authorizing `identity:delete_project(project_id=afcd4fc046cd411c9b0ba52cfd131331)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:10.428145 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008d3c19-da40-43b9-9119-ad2c15826149 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:10.435565 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 937/1871] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:16:10 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:16:10.436553 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a1c6c2-3a6d-4921-bec0-705fd63142db admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:10.490210 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-008d3c19-da40-43b9-9119-ad2c15826149 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afcd4fc046cd411c9b0ba52cfd131331', 'request_id': 'req-008d3c19-da40-43b9-9119-ad2c15826149'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:10.498335 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-008d3c19-da40-43b9-9119-ad2c15826149 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afcd4fc046cd411c9b0ba52cfd131331', 'request_id': 'req-008d3c19-da40-43b9-9119-ad2c15826149'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:10.510236 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-008d3c19-da40-43b9-9119-ad2c15826149 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afcd4fc046cd411c9b0ba52cfd131331', 'request_id': 'req-008d3c19-da40-43b9-9119-ad2c15826149'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:10.520954 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a1c6c2-3a6d-4921-bec0-705fd63142db admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:10.524989 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-008d3c19-da40-43b9-9119-ad2c15826149 admin admin] The token cache is being invalidate because project afcd4fc046cd411c9b0ba52cfd131331 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79961) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 07:16:10.525347 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-008d3c19-da40-43b9-9119-ad2c15826149 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:10.526335 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-008d3c19-da40-43b9-9119-ad2c15826149 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:10.532750 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 935/1872] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Mar 30 07:16:10 2022] DELETE /identity/v3/projects/afcd4fc046cd411c9b0ba52cfd131331 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:16:10.532750 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008d3c19-da40-43b9-9119-ad2c15826149 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:10.540089 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-008d3c19-da40-43b9-9119-ad2c15826149 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:10.592684 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b8970a-c02a-4d29-9f3a-71b5e541e96a tempest-VolumeQuotaClassesTest-187410323 tempest-VolumeQuotaClassesTest-187410323-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42b20d1693354fe5bf6cf5a7321e8677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f321f3bc12434058aa8cda4c217cac1c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:10.593687 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b8970a-c02a-4d29-9f3a-71b5e541e96a tempest-VolumeQuotaClassesTest-187410323 tempest-VolumeQuotaClassesTest-187410323-project-admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:10.593979 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b8970a-c02a-4d29-9f3a-71b5e541e96a tempest-VolumeQuotaClassesTest-187410323 tempest-VolumeQuotaClassesTest-187410323-project-admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:10.594496 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b8970a-c02a-4d29-9f3a-71b5e541e96a tempest-VolumeQuotaClassesTest-187410323 tempest-VolumeQuotaClassesTest-187410323-project-admin] PATH_INFO: `/v3/domains` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:10.595652 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b8970a-c02a-4d29-9f3a-71b5e541e96a tempest-VolumeQuotaClassesTest-187410323 tempest-VolumeQuotaClassesTest-187410323-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:16:10.595775 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b8970a-c02a-4d29-9f3a-71b5e541e96a tempest-VolumeQuotaClassesTest-187410323 tempest-VolumeQuotaClassesTest-187410323-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:10.597391 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b8970a-c02a-4d29-9f3a-71b5e541e96a tempest-VolumeQuotaClassesTest-187410323 tempest-VolumeQuotaClassesTest-187410323-project-admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:10.614307 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 938/1873] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Mar 30 07:16:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:16:10.616547 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed253f62-9683-44a4-92e4-28f849c1064b None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:10.617170 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed253f62-9683-44a4-92e4-28f849c1064b None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:10.617623 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed253f62-9683-44a4-92e4-28f849c1064b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:10.628113 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008d3c19-da40-43b9-9119-ad2c15826149 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:10.633334 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987effba-fb71-4637-9a3c-6b6ba036f805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:10.634853 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987effba-fb71-4637-9a3c-6b6ba036f805 admin admin] REQUEST_METHOD: `PUT` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:10.635166 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987effba-fb71-4637-9a3c-6b6ba036f805 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:10.635924 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987effba-fb71-4637-9a3c-6b6ba036f805 admin admin] PATH_INFO: `/v3/projects/e9949aa6e06c4d998e766b4afc8a90f8/users/e6a4a15032cf4cdc93e77d6dfb1dd6d7/roles/1c39b9ab8cfd4c0ea71845831920a845` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:10.640688 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-ed253f62-9683-44a4-92e4-28f849c1064b None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:16:10.642557 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-ed253f62-9683-44a4-92e4-28f849c1064b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:10.653113 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 939/1874] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:16:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:16:10.661776 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a462165d-eabf-492a-b225-532142be3c5c None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:10.662189 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a462165d-eabf-492a-b225-532142be3c5c None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:10.662359 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a462165d-eabf-492a-b225-532142be3c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:10.663535 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987effba-fb71-4637-9a3c-6b6ba036f805 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9949aa6e06c4d998e766b4afc8a90f8, user_id=e6a4a15032cf4cdc93e77d6dfb1dd6d7, role_id=1c39b9ab8cfd4c0ea71845831920a845)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:10.668063 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987effba-fb71-4637-9a3c-6b6ba036f805 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:10.685282 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-a462165d-eabf-492a-b225-532142be3c5c None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:16:10.686562 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-a462165d-eabf-492a-b225-532142be3c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:10.689416 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 936/1875] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:16:10 2022] PUT /identity/v3/projects/e9949aa6e06c4d998e766b4afc8a90f8/users/e6a4a15032cf4cdc93e77d6dfb1dd6d7/roles/1c39b9ab8cfd4c0ea71845831920a845 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:16:10.690495 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987effba-fb71-4637-9a3c-6b6ba036f805 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:10.693409 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-987effba-fb71-4637-9a3c-6b6ba036f805 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:10.774562 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987effba-fb71-4637-9a3c-6b6ba036f805 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:10.775983 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 940/1876] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:16:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 07:16:10.777193 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a462165d-eabf-492a-b225-532142be3c5c None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:10.780989 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff037c5a-d08a-480a-a3c3-7b9f6d85c654 tempest-VolumeQuotaClassesTest-187410323 tempest-VolumeQuotaClassesTest-187410323-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42b20d1693354fe5bf6cf5a7321e8677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f321f3bc12434058aa8cda4c217cac1c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:10.782098 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff037c5a-d08a-480a-a3c3-7b9f6d85c654 tempest-VolumeQuotaClassesTest-187410323 tempest-VolumeQuotaClassesTest-187410323-project-admin] REQUEST_METHOD: `DELETE` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:10.782547 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff037c5a-d08a-480a-a3c3-7b9f6d85c654 tempest-VolumeQuotaClassesTest-187410323 tempest-VolumeQuotaClassesTest-187410323-project-admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:10.782964 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff037c5a-d08a-480a-a3c3-7b9f6d85c654 tempest-VolumeQuotaClassesTest-187410323 tempest-VolumeQuotaClassesTest-187410323-project-admin] PATH_INFO: `/v3/projects/fdf0e1154faa4fee85c9fa53c5a74402` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:10.784366 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff037c5a-d08a-480a-a3c3-7b9f6d85c654 tempest-VolumeQuotaClassesTest-187410323 tempest-VolumeQuotaClassesTest-187410323-project-admin] RBAC: Authorizing `identity:delete_project(project_id=fdf0e1154faa4fee85c9fa53c5a74402)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:10.786444 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff037c5a-d08a-480a-a3c3-7b9f6d85c654 tempest-VolumeQuotaClassesTest-187410323 tempest-VolumeQuotaClassesTest-187410323-project-admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:10.787300 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a462165d-eabf-492a-b225-532142be3c5c None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:10.792002 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347cf58a-0627-44d1-ad7f-175c8219f7ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:10.792668 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347cf58a-0627-44d1-ad7f-175c8219f7ee admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:10.792945 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347cf58a-0627-44d1-ad7f-175c8219f7ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:10.793217 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347cf58a-0627-44d1-ad7f-175c8219f7ee admin admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:10.793979 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347cf58a-0627-44d1-ad7f-175c8219f7ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:10.795554 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347cf58a-0627-44d1-ad7f-175c8219f7ee admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:10.813540 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 941/1877] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:16:10 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:16:10.815198 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347cf58a-0627-44d1-ad7f-175c8219f7ee admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:10.833528 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347cf58a-0627-44d1-ad7f-175c8219f7ee admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:10.848765 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-ff037c5a-d08a-480a-a3c3-7b9f6d85c654 tempest-VolumeQuotaClassesTest-187410323 tempest-VolumeQuotaClassesTest-187410323-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdf0e1154faa4fee85c9fa53c5a74402', 'request_id': 'req-ff037c5a-d08a-480a-a3c3-7b9f6d85c654'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:10.854750 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-ff037c5a-d08a-480a-a3c3-7b9f6d85c654 tempest-VolumeQuotaClassesTest-187410323 tempest-VolumeQuotaClassesTest-187410323-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdf0e1154faa4fee85c9fa53c5a74402', 'request_id': 'req-ff037c5a-d08a-480a-a3c3-7b9f6d85c654'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:10.869440 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-ff037c5a-d08a-480a-a3c3-7b9f6d85c654 tempest-VolumeQuotaClassesTest-187410323 tempest-VolumeQuotaClassesTest-187410323-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdf0e1154faa4fee85c9fa53c5a74402', 'request_id': 'req-ff037c5a-d08a-480a-a3c3-7b9f6d85c654'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:10.882698 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-ff037c5a-d08a-480a-a3c3-7b9f6d85c654 tempest-VolumeQuotaClassesTest-187410323 tempest-VolumeQuotaClassesTest-187410323-project-admin] The token cache is being invalidate because project fdf0e1154faa4fee85c9fa53c5a74402 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79961) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 07:16:10.882698 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-ff037c5a-d08a-480a-a3c3-7b9f6d85c654 tempest-VolumeQuotaClassesTest-187410323 tempest-VolumeQuotaClassesTest-187410323-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:10.883399 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-ff037c5a-d08a-480a-a3c3-7b9f6d85c654 tempest-VolumeQuotaClassesTest-187410323 tempest-VolumeQuotaClassesTest-187410323-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:10.885212 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 937/1878] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Mar 30 07:16:10 2022] DELETE /identity/v3/projects/fdf0e1154faa4fee85c9fa53c5a74402 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:16:10.885980 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff037c5a-d08a-480a-a3c3-7b9f6d85c654 tempest-VolumeQuotaClassesTest-187410323 tempest-VolumeQuotaClassesTest-187410323-project-admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:10.887661 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-ff037c5a-d08a-480a-a3c3-7b9f6d85c654 tempest-VolumeQuotaClassesTest-187410323 tempest-VolumeQuotaClassesTest-187410323-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:10.910023 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60461302-ceca-4c9c-af0f-d602f480b4b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:10.910759 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60461302-ceca-4c9c-af0f-d602f480b4b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:10.911041 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60461302-ceca-4c9c-af0f-d602f480b4b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:10.911504 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60461302-ceca-4c9c-af0f-d602f480b4b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:10.912326 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60461302-ceca-4c9c-af0f-d602f480b4b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:16:10.912672 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60461302-ceca-4c9c-af0f-d602f480b4b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:10.914428 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60461302-ceca-4c9c-af0f-d602f480b4b9 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:10.932334 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 942/1879] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Mar 30 07:16:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:16:10.935669 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60461302-ceca-4c9c-af0f-d602f480b4b9 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:10.940472 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-60461302-ceca-4c9c-af0f-d602f480b4b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:10.970857 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff037c5a-d08a-480a-a3c3-7b9f6d85c654 tempest-VolumeQuotaClassesTest-187410323 tempest-VolumeQuotaClassesTest-187410323-project-admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:10.971836 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60461302-ceca-4c9c-af0f-d602f480b4b9 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:10.977416 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e315351a-6dbb-4bb2-9434-35f1d5e98830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:10.977783 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0761866-aeb9-43c0-aca7-7bb950494e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:10.978098 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e315351a-6dbb-4bb2-9434-35f1d5e98830 admin admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:10.978556 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e315351a-6dbb-4bb2-9434-35f1d5e98830 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:10.978877 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e315351a-6dbb-4bb2-9434-35f1d5e98830 admin admin] PATH_INFO: `/v3/projects` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:10.979710 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0761866-aeb9-43c0-aca7-7bb950494e03 admin admin] REQUEST_METHOD: `PUT` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:10.979859 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e315351a-6dbb-4bb2-9434-35f1d5e98830 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:10.980411 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0761866-aeb9-43c0-aca7-7bb950494e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:10.980984 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0761866-aeb9-43c0-aca7-7bb950494e03 admin admin] PATH_INFO: `/v3/projects/e9949aa6e06c4d998e766b4afc8a90f8/users/e6a4a15032cf4cdc93e77d6dfb1dd6d7/roles/1c39b9ab8cfd4c0ea71845831920a845` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:10.983462 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e315351a-6dbb-4bb2-9434-35f1d5e98830 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:10.984758 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0761866-aeb9-43c0-aca7-7bb950494e03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9949aa6e06c4d998e766b4afc8a90f8, user_id=e6a4a15032cf4cdc93e77d6dfb1dd6d7, role_id=1c39b9ab8cfd4c0ea71845831920a845)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:10.988163 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0761866-aeb9-43c0-aca7-7bb950494e03 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:11.011862 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 938/1880] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:16:10 2022] PUT /identity/v3/projects/e9949aa6e06c4d998e766b4afc8a90f8/users/e6a4a15032cf4cdc93e77d6dfb1dd6d7/roles/1c39b9ab8cfd4c0ea71845831920a845 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:16:11.018697 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8afdbc1-af17-4865-b749-6ab6f5a3d626 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:11.019059 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8afdbc1-af17-4865-b749-6ab6f5a3d626 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:11.019975 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8afdbc1-af17-4865-b749-6ab6f5a3d626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:11.021702 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 943/1881] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Mar 30 07:16:10 2022] POST /identity/v3/projects => generated 383 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 07:16:11.025881 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e315351a-6dbb-4bb2-9434-35f1d5e98830 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:11.054309 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-d8afdbc1-af17-4865-b749-6ab6f5a3d626 None None] MFA Rules not processed for user `e6a4a15032cf4cdc93e77d6dfb1dd6d7`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:16:11.055595 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-d8afdbc1-af17-4865-b749-6ab6f5a3d626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:11.148892 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e315351a-6dbb-4bb2-9434-35f1d5e98830 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:11.155564 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcddf66-b795-43ee-8a94-39564f5d23d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:11.156580 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcddf66-b795-43ee-8a94-39564f5d23d0 admin admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:11.156847 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcddf66-b795-43ee-8a94-39564f5d23d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:11.157116 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcddf66-b795-43ee-8a94-39564f5d23d0 admin admin] PATH_INFO: `/v3/users` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:11.157973 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 939/1882] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:16:11 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:16:11.158108 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcddf66-b795-43ee-8a94-39564f5d23d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:11.160247 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcddf66-b795-43ee-8a94-39564f5d23d0 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:11.170041 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8afdbc1-af17-4865-b749-6ab6f5a3d626 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:11.171849 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-d8afdbc1-af17-4865-b749-6ab6f5a3d626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:11.183485 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 944/1883] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Mar 30 07:16:11 2022] POST /identity/v3/users => generated 292 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:16:11.189041 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcddf66-b795-43ee-8a94-39564f5d23d0 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:11.199031 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcddf66-b795-43ee-8a94-39564f5d23d0 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:11.206572 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ec9ada-d1d8-4b9b-9c2b-83eaed281f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:11.208024 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec9ada-d1d8-4b9b-9c2b-83eaed281f3d admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:11.208326 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec9ada-d1d8-4b9b-9c2b-83eaed281f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:11.208603 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec9ada-d1d8-4b9b-9c2b-83eaed281f3d admin admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:11.209345 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ec9ada-d1d8-4b9b-9c2b-83eaed281f3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:11.210965 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ec9ada-d1d8-4b9b-9c2b-83eaed281f3d admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:11.227171 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 945/1884] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:16:11 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:16:11.231014 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ec9ada-d1d8-4b9b-9c2b-83eaed281f3d admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:11.235746 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8afdbc1-af17-4865-b749-6ab6f5a3d626 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:11.239703 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b732b5d2-4170-4b7d-b7a1-981223a7bdb6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e2fda180e8d448d895c40cdad34bc4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:11.240561 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b732b5d2-4170-4b7d-b7a1-981223a7bdb6 service cinder] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:11.240847 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b732b5d2-4170-4b7d-b7a1-981223a7bdb6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:11.241124 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b732b5d2-4170-4b7d-b7a1-981223a7bdb6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:11.242892 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ec9ada-d1d8-4b9b-9c2b-83eaed281f3d admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:11.249021 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6c6f25-5319-4690-9c8b-dd4a5844363e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:11.249490 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c6f25-5319-4690-9c8b-dd4a5844363e admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:11.249836 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c6f25-5319-4690-9c8b-dd4a5844363e admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:11.250353 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c6f25-5319-4690-9c8b-dd4a5844363e admin admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:11.251323 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6c6f25-5319-4690-9c8b-dd4a5844363e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:11.251429 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b732b5d2-4170-4b7d-b7a1-981223a7bdb6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:11.253359 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b732b5d2-4170-4b7d-b7a1-981223a7bdb6 service cinder] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:11.253467 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6c6f25-5319-4690-9c8b-dd4a5844363e admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:11.264978 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 940/1885] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:16:11 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 30 07:16:11.267847 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 946/1886] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:16:11 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 30 07:16:11.269531 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b732b5d2-4170-4b7d-b7a1-981223a7bdb6 service cinder] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:11.281551 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b732b5d2-4170-4b7d-b7a1-981223a7bdb6 service cinder] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:11.293192 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae757069-c6f4-4ae1-aeae-4b15a71234a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:11.294288 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae757069-c6f4-4ae1-aeae-4b15a71234a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:11.294858 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae757069-c6f4-4ae1-aeae-4b15a71234a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:11.295152 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae757069-c6f4-4ae1-aeae-4b15a71234a8 admin admin] PATH_INFO: `/v3/projects/0a62cd7490f842c2851be53db92960b5/users/fcf6820a50114c60846f2bc86c03b906/roles/5d79031a64754b57ba120367465e2252` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:11.304719 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6c6f25-5319-4690-9c8b-dd4a5844363e admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:11.307367 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-2b6c6f25-5319-4690-9c8b-dd4a5844363e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:11.321372 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae757069-c6f4-4ae1-aeae-4b15a71234a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a62cd7490f842c2851be53db92960b5, user_id=fcf6820a50114c60846f2bc86c03b906, role_id=5d79031a64754b57ba120367465e2252)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:11.324757 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae757069-c6f4-4ae1-aeae-4b15a71234a8 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:11.338918 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6c6f25-5319-4690-9c8b-dd4a5844363e admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:11.348656 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a68ab6-07f6-437d-bcfd-94bb0a55baee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:11.350213 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a68ab6-07f6-437d-bcfd-94bb0a55baee admin admin] REQUEST_METHOD: `DELETE` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:11.350497 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a68ab6-07f6-437d-bcfd-94bb0a55baee admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:11.350770 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a68ab6-07f6-437d-bcfd-94bb0a55baee admin admin] PATH_INFO: `/v3/users/8cb0b32e0455452b8c482f0bfab45ad2` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:11.353175 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a68ab6-07f6-437d-bcfd-94bb0a55baee admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cb0b32e0455452b8c482f0bfab45ad2)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:11.357688 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a68ab6-07f6-437d-bcfd-94bb0a55baee admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:11.364412 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 941/1887] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:16:11 2022] PUT /identity/v3/projects/0a62cd7490f842c2851be53db92960b5/users/fcf6820a50114c60846f2bc86c03b906/roles/5d79031a64754b57ba120367465e2252 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 07:16:11.367865 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c69016-a507-41bd-a17b-ec57d139d278 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:11.368144 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c69016-a507-41bd-a17b-ec57d139d278 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:11.368458 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c69016-a507-41bd-a17b-ec57d139d278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:11.414855 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-13c69016-a507-41bd-a17b-ec57d139d278 None None] MFA Rules not processed for user `fcf6820a50114c60846f2bc86c03b906`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:16:11.416252 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-13c69016-a507-41bd-a17b-ec57d139d278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:11.443388 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-76a68ab6-07f6-437d-bcfd-94bb0a55baee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cb0b32e0455452b8c482f0bfab45ad2'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:11.444411 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-76a68ab6-07f6-437d-bcfd-94bb0a55baee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cb0b32e0455452b8c482f0bfab45ad2'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:11.463636 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-76a68ab6-07f6-437d-bcfd-94bb0a55baee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cb0b32e0455452b8c482f0bfab45ad2'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:11.482224 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-76a68ab6-07f6-437d-bcfd-94bb0a55baee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cb0b32e0455452b8c482f0bfab45ad2'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:11.483406 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-76a68ab6-07f6-437d-bcfd-94bb0a55baee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cb0b32e0455452b8c482f0bfab45ad2'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:11.501083 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 947/1888] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Mar 30 07:16:11 2022] DELETE /identity/v3/users/8cb0b32e0455452b8c482f0bfab45ad2 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:16:11.504969 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a68ab6-07f6-437d-bcfd-94bb0a55baee admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:11.506117 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 942/1889] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:16:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:16:11.506526 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-76a68ab6-07f6-437d-bcfd-94bb0a55baee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:11.508203 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996f8f67-47c4-47fd-ae3a-85467043411d None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:11.508203 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996f8f67-47c4-47fd-ae3a-85467043411d None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:11.508203 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996f8f67-47c4-47fd-ae3a-85467043411d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:11.527514 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-996f8f67-47c4-47fd-ae3a-85467043411d None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:16:11.529235 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-996f8f67-47c4-47fd-ae3a-85467043411d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:11.579789 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a68ab6-07f6-437d-bcfd-94bb0a55baee admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:11.583575 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fa9a7e-4994-425a-9d58-8910f3533224 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e2fda180e8d448d895c40cdad34bc4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:11.584490 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa9a7e-4994-425a-9d58-8910f3533224 service cinder] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:11.584696 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa9a7e-4994-425a-9d58-8910f3533224 service cinder] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:11.584948 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa9a7e-4994-425a-9d58-8910f3533224 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:11.586890 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-18fa9a7e-4994-425a-9d58-8910f3533224 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:11.600739 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 943/1890] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:16:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:16:11.601588 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996f8f67-47c4-47fd-ae3a-85467043411d None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:11.602819 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-996f8f67-47c4-47fd-ae3a-85467043411d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:11.615002 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996f8f67-47c4-47fd-ae3a-85467043411d None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:11.620048 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2d13ff-9f0b-450a-b6df-75ac82cee91b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:11.620716 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d13ff-9f0b-450a-b6df-75ac82cee91b admin admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:11.620992 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d13ff-9f0b-450a-b6df-75ac82cee91b admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:11.621261 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d13ff-9f0b-450a-b6df-75ac82cee91b admin admin] PATH_INFO: `/v3/projects` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:11.621991 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2d13ff-9f0b-450a-b6df-75ac82cee91b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:11.624128 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2d13ff-9f0b-450a-b6df-75ac82cee91b admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:11.659019 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fa9a7e-4994-425a-9d58-8910f3533224 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:11.659019 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fa9a7e-4994-425a-9d58-8910f3533224 service cinder] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:11.661135 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 944/1891] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Mar 30 07:16:11 2022] POST /identity/v3/projects => generated 381 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:16:11.662101 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2d13ff-9f0b-450a-b6df-75ac82cee91b admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:11.665859 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-7f2d13ff-9f0b-450a-b6df-75ac82cee91b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:11.674069 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 948/1892] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:16:11 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:16:11.674935 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fa9a7e-4994-425a-9d58-8910f3533224 service cinder] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:11.685045 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fa9a7e-4994-425a-9d58-8910f3533224 service cinder] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:11.737831 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2d13ff-9f0b-450a-b6df-75ac82cee91b admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:11.741721 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff31b184-51a3-4327-ba60-04f57cc8c802 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3802cb341445f994b9204744060ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:11.742440 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff31b184-51a3-4327-ba60-04f57cc8c802 service neutron] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:11.742790 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff31b184-51a3-4327-ba60-04f57cc8c802 service neutron] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:11.743132 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff31b184-51a3-4327-ba60-04f57cc8c802 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:11.747301 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c729b83e-e46b-4f6f-8f53-1d1c51c45c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:11.748088 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c729b83e-e46b-4f6f-8f53-1d1c51c45c90 admin admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:11.748428 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c729b83e-e46b-4f6f-8f53-1d1c51c45c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:11.748760 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c729b83e-e46b-4f6f-8f53-1d1c51c45c90 admin admin] PATH_INFO: `/v3/users` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:11.749510 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c729b83e-e46b-4f6f-8f53-1d1c51c45c90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:11.751673 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c729b83e-e46b-4f6f-8f53-1d1c51c45c90 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:11.753765 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff31b184-51a3-4327-ba60-04f57cc8c802 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:11.755685 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff31b184-51a3-4327-ba60-04f57cc8c802 service neutron] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:11.766628 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 945/1893] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:16:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:16:11.775069 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 949/1894] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Mar 30 07:16:11 2022] POST /identity/v3/users => generated 297 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:16:11.779227 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff31b184-51a3-4327-ba60-04f57cc8c802 service neutron] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:11.789322 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff31b184-51a3-4327-ba60-04f57cc8c802 service neutron] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:11.795157 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a4404b-f6bb-4427-960e-f1abc7b9a309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:11.795871 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a4404b-f6bb-4427-960e-f1abc7b9a309 admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:11.796153 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a4404b-f6bb-4427-960e-f1abc7b9a309 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:11.796426 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a4404b-f6bb-4427-960e-f1abc7b9a309 admin admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:11.797155 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a4404b-f6bb-4427-960e-f1abc7b9a309 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:11.799112 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a4404b-f6bb-4427-960e-f1abc7b9a309 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:11.810143 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 946/1895] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:16:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:16:11.814214 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c729b83e-e46b-4f6f-8f53-1d1c51c45c90 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:11.825578 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c729b83e-e46b-4f6f-8f53-1d1c51c45c90 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:11.831296 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13be803-c1fe-47ed-8dde-e858aef1af62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:11.832454 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13be803-c1fe-47ed-8dde-e858aef1af62 admin admin] REQUEST_METHOD: `PUT` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:11.832751 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13be803-c1fe-47ed-8dde-e858aef1af62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:11.833084 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13be803-c1fe-47ed-8dde-e858aef1af62 admin admin] PATH_INFO: `/v3/projects/72c640a373744ce6ade5d438b3663707/users/0660283b3462408e9da9535e197e975d/roles/1c39b9ab8cfd4c0ea71845831920a845` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:11.852113 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13be803-c1fe-47ed-8dde-e858aef1af62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72c640a373744ce6ade5d438b3663707, user_id=0660283b3462408e9da9535e197e975d, role_id=1c39b9ab8cfd4c0ea71845831920a845)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:11.855043 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13be803-c1fe-47ed-8dde-e858aef1af62 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:11.883726 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 950/1896] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:16:11 2022] PUT /identity/v3/projects/72c640a373744ce6ade5d438b3663707/users/0660283b3462408e9da9535e197e975d/roles/1c39b9ab8cfd4c0ea71845831920a845 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 07:16:11.891577 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a4404b-f6bb-4427-960e-f1abc7b9a309 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:11.902492 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a4404b-f6bb-4427-960e-f1abc7b9a309 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:11.998028 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5aaa53-de1c-4004-9375-9b191f40f125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:11.998966 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5aaa53-de1c-4004-9375-9b191f40f125 admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:11.999297 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5aaa53-de1c-4004-9375-9b191f40f125 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:11.999623 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5aaa53-de1c-4004-9375-9b191f40f125 admin admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:12.000475 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5aaa53-de1c-4004-9375-9b191f40f125 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:12.003077 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5aaa53-de1c-4004-9375-9b191f40f125 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:12.014853 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 947/1897] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:16:11 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:16:12.018442 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13be803-c1fe-47ed-8dde-e858aef1af62 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:12.031093 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13be803-c1fe-47ed-8dde-e858aef1af62 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:12.036980 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db995035-8a48-45c3-a46d-9a7c0c2840cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:12.038209 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db995035-8a48-45c3-a46d-9a7c0c2840cc admin admin] REQUEST_METHOD: `PUT` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:12.038485 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db995035-8a48-45c3-a46d-9a7c0c2840cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:12.038778 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db995035-8a48-45c3-a46d-9a7c0c2840cc admin admin] PATH_INFO: `/v3/projects/72c640a373744ce6ade5d438b3663707/users/0660283b3462408e9da9535e197e975d/roles/1c39b9ab8cfd4c0ea71845831920a845` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:12.041045 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db995035-8a48-45c3-a46d-9a7c0c2840cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=72c640a373744ce6ade5d438b3663707, user_id=0660283b3462408e9da9535e197e975d, role_id=1c39b9ab8cfd4c0ea71845831920a845)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:12.044249 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db995035-8a48-45c3-a46d-9a7c0c2840cc admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:12.056598 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 951/1898] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:16:12 2022] PUT /identity/v3/projects/72c640a373744ce6ade5d438b3663707/users/0660283b3462408e9da9535e197e975d/roles/1c39b9ab8cfd4c0ea71845831920a845 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:16:12.067824 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526dba4f-2f9c-4503-8fdf-033406704f61 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:12.068339 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526dba4f-2f9c-4503-8fdf-033406704f61 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:12.068498 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526dba4f-2f9c-4503-8fdf-033406704f61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:12.097314 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-526dba4f-2f9c-4503-8fdf-033406704f61 None None] MFA Rules not processed for user `0660283b3462408e9da9535e197e975d`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:16:12.098517 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-526dba4f-2f9c-4503-8fdf-033406704f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:12.174944 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 948/1899] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:16:12 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:16:12.190752 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db995035-8a48-45c3-a46d-9a7c0c2840cc admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:12.266269 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db995035-8a48-45c3-a46d-9a7c0c2840cc admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:12.270510 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27804924-4926-4048-8733-1074c26229f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e2fda180e8d448d895c40cdad34bc4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:12.271644 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27804924-4926-4048-8733-1074c26229f9 service cinder] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:12.271960 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27804924-4926-4048-8733-1074c26229f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:12.272241 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27804924-4926-4048-8733-1074c26229f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:12.283146 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27804924-4926-4048-8733-1074c26229f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:12.284703 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27804924-4926-4048-8733-1074c26229f9 service cinder] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:12.294712 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 952/1900] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:16:12 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:16:12.306186 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526dba4f-2f9c-4503-8fdf-033406704f61 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:12.308827 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-526dba4f-2f9c-4503-8fdf-033406704f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:12.392239 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526dba4f-2f9c-4503-8fdf-033406704f61 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:12.394112 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6953f808-4a12-4574-860c-9804d9c4772f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:12.395029 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6953f808-4a12-4574-860c-9804d9c4772f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:12.395306 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6953f808-4a12-4574-860c-9804d9c4772f admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:12.395604 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6953f808-4a12-4574-860c-9804d9c4772f admin admin] PATH_INFO: `/v3/projects/a2c97b80e35b4a449351a32783539593` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:12.396828 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6953f808-4a12-4574-860c-9804d9c4772f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2c97b80e35b4a449351a32783539593)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:12.398764 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6953f808-4a12-4574-860c-9804d9c4772f admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:12.399116 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27804924-4926-4048-8733-1074c26229f9 service cinder] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:12.407798 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27804924-4926-4048-8733-1074c26229f9 service cinder] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:12.411706 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da27a25-68e1-4baa-947b-1e98684077fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e2fda180e8d448d895c40cdad34bc4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:12.412392 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da27a25-68e1-4baa-947b-1e98684077fb service cinder] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:12.412670 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da27a25-68e1-4baa-947b-1e98684077fb service cinder] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:12.412993 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da27a25-68e1-4baa-947b-1e98684077fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:12.446868 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-6953f808-4a12-4574-860c-9804d9c4772f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2c97b80e35b4a449351a32783539593', 'request_id': 'req-6953f808-4a12-4574-860c-9804d9c4772f'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:12.452514 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-6953f808-4a12-4574-860c-9804d9c4772f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2c97b80e35b4a449351a32783539593', 'request_id': 'req-6953f808-4a12-4574-860c-9804d9c4772f'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:12.461107 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-6953f808-4a12-4574-860c-9804d9c4772f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2c97b80e35b4a449351a32783539593', 'request_id': 'req-6953f808-4a12-4574-860c-9804d9c4772f'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:12.471124 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da27a25-68e1-4baa-947b-1e98684077fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:12.472459 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-6953f808-4a12-4574-860c-9804d9c4772f admin admin] The token cache is being invalidate because project a2c97b80e35b4a449351a32783539593 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79961) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 07:16:12.472759 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-6953f808-4a12-4574-860c-9804d9c4772f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:12.472964 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da27a25-68e1-4baa-947b-1e98684077fb service cinder] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:12.473449 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-6953f808-4a12-4574-860c-9804d9c4772f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:12.475242 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 949/1901] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Mar 30 07:16:12 2022] DELETE /identity/v3/projects/a2c97b80e35b4a449351a32783539593 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:16:12.478890 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6953f808-4a12-4574-860c-9804d9c4772f admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:12.482182 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-6953f808-4a12-4574-860c-9804d9c4772f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:12.486360 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 953/1902] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:16:12 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 30 07:16:12.548706 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6953f808-4a12-4574-860c-9804d9c4772f admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:12.553417 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e83981-e69d-40f3-a165-3c2124262586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:12.554297 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e83981-e69d-40f3-a165-3c2124262586 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:12.554571 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e83981-e69d-40f3-a165-3c2124262586 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:12.554843 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e83981-e69d-40f3-a165-3c2124262586 admin admin] PATH_INFO: `/v3/users/42b20d1693354fe5bf6cf5a7321e8677` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:12.556056 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e83981-e69d-40f3-a165-3c2124262586 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42b20d1693354fe5bf6cf5a7321e8677)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:12.558111 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e83981-e69d-40f3-a165-3c2124262586 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:12.613611 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-20e83981-e69d-40f3-a165-3c2124262586 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42b20d1693354fe5bf6cf5a7321e8677'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:12.614307 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-20e83981-e69d-40f3-a165-3c2124262586 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42b20d1693354fe5bf6cf5a7321e8677'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:12.614915 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-20e83981-e69d-40f3-a165-3c2124262586 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42b20d1693354fe5bf6cf5a7321e8677'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:12.626320 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-20e83981-e69d-40f3-a165-3c2124262586 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42b20d1693354fe5bf6cf5a7321e8677'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:12.634518 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-20e83981-e69d-40f3-a165-3c2124262586 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42b20d1693354fe5bf6cf5a7321e8677'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:12.654660 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 950/1903] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Mar 30 07:16:12 2022] DELETE /identity/v3/users/42b20d1693354fe5bf6cf5a7321e8677 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:16:12.772339 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da27a25-68e1-4baa-947b-1e98684077fb service cinder] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:12.783249 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da27a25-68e1-4baa-947b-1e98684077fb service cinder] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:12.842492 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48a1a03-f955-4105-a025-584060ed01d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:12.843535 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48a1a03-f955-4105-a025-584060ed01d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:12.843837 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48a1a03-f955-4105-a025-584060ed01d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:12.844242 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48a1a03-f955-4105-a025-584060ed01d2 admin admin] PATH_INFO: `/v3/users/fcf6820a50114c60846f2bc86c03b906` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:12.845478 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48a1a03-f955-4105-a025-584060ed01d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcf6820a50114c60846f2bc86c03b906)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:12.847569 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48a1a03-f955-4105-a025-584060ed01d2 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:12.895541 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-a48a1a03-f955-4105-a025-584060ed01d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcf6820a50114c60846f2bc86c03b906'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:12.896200 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-a48a1a03-f955-4105-a025-584060ed01d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcf6820a50114c60846f2bc86c03b906'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:12.905247 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-a48a1a03-f955-4105-a025-584060ed01d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcf6820a50114c60846f2bc86c03b906'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:12.917935 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-a48a1a03-f955-4105-a025-584060ed01d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcf6820a50114c60846f2bc86c03b906'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:12.918813 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-a48a1a03-f955-4105-a025-584060ed01d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcf6820a50114c60846f2bc86c03b906'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:12.936087 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 954/1904] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Mar 30 07:16:12 2022] DELETE /identity/v3/users/fcf6820a50114c60846f2bc86c03b906 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 07:16:12.941304 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ad5e47-7aa3-4d47-8430-ad37052fa16b None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:12.941619 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ad5e47-7aa3-4d47-8430-ad37052fa16b None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:12.941872 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ad5e47-7aa3-4d47-8430-ad37052fa16b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:12.962371 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-56ad5e47-7aa3-4d47-8430-ad37052fa16b None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:16:12.963579 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-56ad5e47-7aa3-4d47-8430-ad37052fa16b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:13.042817 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 951/1905] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:16:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:16:13.052713 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48a1a03-f955-4105-a025-584060ed01d2 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:13.054159 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-a48a1a03-f955-4105-a025-584060ed01d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:13.097590 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ad5e47-7aa3-4d47-8430-ad37052fa16b None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:13.099303 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-56ad5e47-7aa3-4d47-8430-ad37052fa16b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:13.115375 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48a1a03-f955-4105-a025-584060ed01d2 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:13.119422 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1205a1c2-2462-454c-a6e4-859148ba2265 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3802cb341445f994b9204744060ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:13.120118 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1205a1c2-2462-454c-a6e4-859148ba2265 service neutron] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:13.120398 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1205a1c2-2462-454c-a6e4-859148ba2265 service neutron] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:13.120576 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ad5e47-7aa3-4d47-8430-ad37052fa16b None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:13.120672 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1205a1c2-2462-454c-a6e4-859148ba2265 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:13.126495 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386d5b4b-29bf-478e-a2d6-91b729db08bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:13.127421 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d5b4b-29bf-478e-a2d6-91b729db08bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:13.127705 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d5b4b-29bf-478e-a2d6-91b729db08bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:13.128057 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d5b4b-29bf-478e-a2d6-91b729db08bb admin admin] PATH_INFO: `/v3/projects/f321f3bc12434058aa8cda4c217cac1c` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:13.129177 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386d5b4b-29bf-478e-a2d6-91b729db08bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=f321f3bc12434058aa8cda4c217cac1c)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:13.130316 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1205a1c2-2462-454c-a6e4-859148ba2265 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:13.131325 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386d5b4b-29bf-478e-a2d6-91b729db08bb admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:13.131731 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1205a1c2-2462-454c-a6e4-859148ba2265 service neutron] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:13.142099 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 955/1906] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:16:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:16:13.181548 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-386d5b4b-29bf-478e-a2d6-91b729db08bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f321f3bc12434058aa8cda4c217cac1c', 'request_id': 'req-386d5b4b-29bf-478e-a2d6-91b729db08bb'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:13.187059 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-386d5b4b-29bf-478e-a2d6-91b729db08bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f321f3bc12434058aa8cda4c217cac1c', 'request_id': 'req-386d5b4b-29bf-478e-a2d6-91b729db08bb'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:13.194721 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-386d5b4b-29bf-478e-a2d6-91b729db08bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f321f3bc12434058aa8cda4c217cac1c', 'request_id': 'req-386d5b4b-29bf-478e-a2d6-91b729db08bb'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:13.207763 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-386d5b4b-29bf-478e-a2d6-91b729db08bb admin admin] The token cache is being invalidate because project f321f3bc12434058aa8cda4c217cac1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79961) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 07:16:13.207763 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-386d5b4b-29bf-478e-a2d6-91b729db08bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:13.208951 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-386d5b4b-29bf-478e-a2d6-91b729db08bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:13.210283 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 952/1907] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Mar 30 07:16:13 2022] DELETE /identity/v3/projects/f321f3bc12434058aa8cda4c217cac1c => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:16:13.215585 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d6477f-fd9f-416c-abd3-b9a335eb92ff None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:13.215764 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d6477f-fd9f-416c-abd3-b9a335eb92ff None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:13.216066 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d6477f-fd9f-416c-abd3-b9a335eb92ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:13.234638 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-82d6477f-fd9f-416c-abd3-b9a335eb92ff None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:16:13.235847 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-82d6477f-fd9f-416c-abd3-b9a335eb92ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:13.310240 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 956/1908] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:16:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:16:13.311923 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71144ead-018d-4d11-a4fc-24f535f06895 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:13.312258 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71144ead-018d-4d11-a4fc-24f535f06895 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:13.312628 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71144ead-018d-4d11-a4fc-24f535f06895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:13.334783 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-71144ead-018d-4d11-a4fc-24f535f06895 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:16:13.336154 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-71144ead-018d-4d11-a4fc-24f535f06895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:13.346328 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 953/1909] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:16:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:16:13.350944 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d6477f-fd9f-416c-abd3-b9a335eb92ff None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:13.361923 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d6477f-fd9f-416c-abd3-b9a335eb92ff None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:13.367502 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd7e412-157a-475c-83b5-24920fb4a4d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:13.368721 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd7e412-157a-475c-83b5-24920fb4a4d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:13.368721 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd7e412-157a-475c-83b5-24920fb4a4d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:13.368929 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd7e412-157a-475c-83b5-24920fb4a4d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:13.369587 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd7e412-157a-475c-83b5-24920fb4a4d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:16:13.369936 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd7e412-157a-475c-83b5-24920fb4a4d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:13.371556 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd7e412-157a-475c-83b5-24920fb4a4d1 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:13.386270 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 957/1910] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Mar 30 07:16:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:16:13.391464 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71144ead-018d-4d11-a4fc-24f535f06895 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:13.411408 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71144ead-018d-4d11-a4fc-24f535f06895 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:13.421565 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08658bf-7466-4571-a3a5-bf9f85e2c82d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:13.422295 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08658bf-7466-4571-a3a5-bf9f85e2c82d admin admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:13.422537 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08658bf-7466-4571-a3a5-bf9f85e2c82d admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:13.422905 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08658bf-7466-4571-a3a5-bf9f85e2c82d admin admin] PATH_INFO: `/v3/projects` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:13.427847 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08658bf-7466-4571-a3a5-bf9f85e2c82d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:13.429812 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08658bf-7466-4571-a3a5-bf9f85e2c82d admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:13.436222 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd7e412-157a-475c-83b5-24920fb4a4d1 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:13.438262 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-0cd7e412-157a-475c-83b5-24920fb4a4d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:13.459785 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd7e412-157a-475c-83b5-24920fb4a4d1 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:13.472952 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 954/1911] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Mar 30 07:16:13 2022] POST /identity/v3/projects => generated 383 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:16:13.474743 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed876c11-30ea-4488-acbf-006c76750fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:13.475737 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed876c11-30ea-4488-acbf-006c76750fd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:13.476062 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed876c11-30ea-4488-acbf-006c76750fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:13.476351 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed876c11-30ea-4488-acbf-006c76750fd9 admin admin] PATH_INFO: `/v3/projects/0a62cd7490f842c2851be53db92960b5` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:13.477251 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08658bf-7466-4571-a3a5-bf9f85e2c82d admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:13.478029 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed876c11-30ea-4488-acbf-006c76750fd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a62cd7490f842c2851be53db92960b5)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:13.480222 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed876c11-30ea-4488-acbf-006c76750fd9 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:13.545078 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-ed876c11-30ea-4488-acbf-006c76750fd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a62cd7490f842c2851be53db92960b5', 'request_id': 'req-ed876c11-30ea-4488-acbf-006c76750fd9'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:13.548377 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08658bf-7466-4571-a3a5-bf9f85e2c82d admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:13.556727 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-ed876c11-30ea-4488-acbf-006c76750fd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a62cd7490f842c2851be53db92960b5', 'request_id': 'req-ed876c11-30ea-4488-acbf-006c76750fd9'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:13.568254 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-ed876c11-30ea-4488-acbf-006c76750fd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a62cd7490f842c2851be53db92960b5', 'request_id': 'req-ed876c11-30ea-4488-acbf-006c76750fd9'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:13.581051 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-ed876c11-30ea-4488-acbf-006c76750fd9 admin admin] The token cache is being invalidate because project 0a62cd7490f842c2851be53db92960b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79960) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 07:16:13.581332 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-ed876c11-30ea-4488-acbf-006c76750fd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:13.582125 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-ed876c11-30ea-4488-acbf-006c76750fd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:13.583835 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 958/1912] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Mar 30 07:16:13 2022] DELETE /identity/v3/projects/0a62cd7490f842c2851be53db92960b5 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:16:13.587338 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed876c11-30ea-4488-acbf-006c76750fd9 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:13.588674 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-ed876c11-30ea-4488-acbf-006c76750fd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:13.629680 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e668bc-4c51-4cee-a96e-778dd481a8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:13.630650 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e668bc-4c51-4cee-a96e-778dd481a8e6 admin admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:13.631107 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e668bc-4c51-4cee-a96e-778dd481a8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:13.631434 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e668bc-4c51-4cee-a96e-778dd481a8e6 admin admin] PATH_INFO: `/v3/users` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:13.632273 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e668bc-4c51-4cee-a96e-778dd481a8e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:13.636815 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e668bc-4c51-4cee-a96e-778dd481a8e6 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:13.657901 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 955/1913] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Mar 30 07:16:13 2022] POST /identity/v3/users => generated 292 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:16:13.659228 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed876c11-30ea-4488-acbf-006c76750fd9 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:13.662954 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e668bc-4c51-4cee-a96e-778dd481a8e6 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:13.665682 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-79e668bc-4c51-4cee-a96e-778dd481a8e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:13.666125 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e17f1ee-6c32-4907-8c05-bd0a17960692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:13.667191 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e17f1ee-6c32-4907-8c05-bd0a17960692 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:13.667466 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e17f1ee-6c32-4907-8c05-bd0a17960692 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:13.667762 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e17f1ee-6c32-4907-8c05-bd0a17960692 admin admin] PATH_INFO: `/v3/users/0660283b3462408e9da9535e197e975d` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:13.669684 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e17f1ee-6c32-4907-8c05-bd0a17960692 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0660283b3462408e9da9535e197e975d)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:13.671966 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e17f1ee-6c32-4907-8c05-bd0a17960692 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:13.685272 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e668bc-4c51-4cee-a96e-778dd481a8e6 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:13.690131 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdf32c1-e0a4-47ea-97b0-d76248f4590e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:13.690814 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdf32c1-e0a4-47ea-97b0-d76248f4590e admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:13.691095 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdf32c1-e0a4-47ea-97b0-d76248f4590e admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:13.691368 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdf32c1-e0a4-47ea-97b0-d76248f4590e admin admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:13.692157 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdf32c1-e0a4-47ea-97b0-d76248f4590e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:13.693793 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdf32c1-e0a4-47ea-97b0-d76248f4590e admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:13.705200 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 956/1914] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:16:13 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 30 07:16:13.709778 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdf32c1-e0a4-47ea-97b0-d76248f4590e admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:13.720770 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdf32c1-e0a4-47ea-97b0-d76248f4590e admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:13.723062 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-4e17f1ee-6c32-4907-8c05-bd0a17960692 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0660283b3462408e9da9535e197e975d'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:13.723751 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-4e17f1ee-6c32-4907-8c05-bd0a17960692 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0660283b3462408e9da9535e197e975d'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:13.726085 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcaba1d-8171-4388-b578-414609fa342e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:13.726783 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcaba1d-8171-4388-b578-414609fa342e admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:13.727078 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcaba1d-8171-4388-b578-414609fa342e admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:13.727493 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcaba1d-8171-4388-b578-414609fa342e admin admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:13.728245 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcaba1d-8171-4388-b578-414609fa342e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:13.730135 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcaba1d-8171-4388-b578-414609fa342e admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:13.732594 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-4e17f1ee-6c32-4907-8c05-bd0a17960692 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0660283b3462408e9da9535e197e975d'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:13.743101 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 957/1915] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:16:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 30 07:16:13.746261 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-4e17f1ee-6c32-4907-8c05-bd0a17960692 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0660283b3462408e9da9535e197e975d'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:13.747119 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-4e17f1ee-6c32-4907-8c05-bd0a17960692 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0660283b3462408e9da9535e197e975d'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:13.748750 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcaba1d-8171-4388-b578-414609fa342e admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:13.750697 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-2fcaba1d-8171-4388-b578-414609fa342e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:13.759501 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 959/1916] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Mar 30 07:16:13 2022] DELETE /identity/v3/users/0660283b3462408e9da9535e197e975d => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:16:13.764703 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcaba1d-8171-4388-b578-414609fa342e admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:13.826211 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7ffd4b-a829-499b-af49-d7b3fdb9898b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:13.827150 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ffd4b-a829-499b-af49-d7b3fdb9898b admin admin] REQUEST_METHOD: `PUT` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:13.827421 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ffd4b-a829-499b-af49-d7b3fdb9898b admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:13.827695 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ffd4b-a829-499b-af49-d7b3fdb9898b admin admin] PATH_INFO: `/v3/projects/54cfcac585b249b0b8c79666a7a6b74a/users/6bf0b90cce7e447aa66083b12b7f4f32/roles/5d79031a64754b57ba120367465e2252` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:13.842832 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7ffd4b-a829-499b-af49-d7b3fdb9898b admin admin] RBAC: Authorizing `identity:create_grant(project_id=54cfcac585b249b0b8c79666a7a6b74a, user_id=6bf0b90cce7e447aa66083b12b7f4f32, role_id=5d79031a64754b57ba120367465e2252)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:13.845501 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7ffd4b-a829-499b-af49-d7b3fdb9898b admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:13.859240 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 958/1917] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:16:13 2022] PUT /identity/v3/projects/54cfcac585b249b0b8c79666a7a6b74a/users/6bf0b90cce7e447aa66083b12b7f4f32/roles/5d79031a64754b57ba120367465e2252 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 07:16:13.870823 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2294cb-e6d2-4781-9189-8e759cf0be2b None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:13.871113 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2294cb-e6d2-4781-9189-8e759cf0be2b None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:13.871380 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2294cb-e6d2-4781-9189-8e759cf0be2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:13.899688 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-3d2294cb-e6d2-4781-9189-8e759cf0be2b None None] MFA Rules not processed for user `6bf0b90cce7e447aa66083b12b7f4f32`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:16:13.900949 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-3d2294cb-e6d2-4781-9189-8e759cf0be2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:13.972738 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 960/1918] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:16:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:16:13.984460 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7ffd4b-a829-499b-af49-d7b3fdb9898b admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:13.986328 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-2d7ffd4b-a829-499b-af49-d7b3fdb9898b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:14.046846 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7ffd4b-a829-499b-af49-d7b3fdb9898b admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:14.053679 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0771689c-0bb3-439e-a16e-cfd3eb583da2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e2fda180e8d448d895c40cdad34bc4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:14.054395 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0771689c-0bb3-439e-a16e-cfd3eb583da2 service cinder] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:14.054677 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0771689c-0bb3-439e-a16e-cfd3eb583da2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:14.054952 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0771689c-0bb3-439e-a16e-cfd3eb583da2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:14.065735 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0771689c-0bb3-439e-a16e-cfd3eb583da2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:14.067201 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0771689c-0bb3-439e-a16e-cfd3eb583da2 service cinder] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:14.077884 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 959/1919] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:16:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:16:14.088645 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2294cb-e6d2-4781-9189-8e759cf0be2b None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:14.091021 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-3d2294cb-e6d2-4781-9189-8e759cf0be2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:14.270531 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2294cb-e6d2-4781-9189-8e759cf0be2b None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:14.281272 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03da9163-a9bb-4e1c-90a3-0652b00a34e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:14.282441 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da9163-a9bb-4e1c-90a3-0652b00a34e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:14.282923 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da9163-a9bb-4e1c-90a3-0652b00a34e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:14.283454 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da9163-a9bb-4e1c-90a3-0652b00a34e1 admin admin] PATH_INFO: `/v3/projects/72c640a373744ce6ade5d438b3663707` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:14.289528 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03da9163-a9bb-4e1c-90a3-0652b00a34e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72c640a373744ce6ade5d438b3663707)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:14.292826 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03da9163-a9bb-4e1c-90a3-0652b00a34e1 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:14.371680 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-03da9163-a9bb-4e1c-90a3-0652b00a34e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72c640a373744ce6ade5d438b3663707', 'request_id': 'req-03da9163-a9bb-4e1c-90a3-0652b00a34e1'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:14.384414 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-03da9163-a9bb-4e1c-90a3-0652b00a34e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72c640a373744ce6ade5d438b3663707', 'request_id': 'req-03da9163-a9bb-4e1c-90a3-0652b00a34e1'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:14.395462 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-03da9163-a9bb-4e1c-90a3-0652b00a34e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72c640a373744ce6ade5d438b3663707', 'request_id': 'req-03da9163-a9bb-4e1c-90a3-0652b00a34e1'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:14.407041 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-03da9163-a9bb-4e1c-90a3-0652b00a34e1 admin admin] The token cache is being invalidate because project 72c640a373744ce6ade5d438b3663707 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79960) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 07:16:14.407331 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-03da9163-a9bb-4e1c-90a3-0652b00a34e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:14.408012 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-03da9163-a9bb-4e1c-90a3-0652b00a34e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:14.410054 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 961/1920] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Mar 30 07:16:14 2022] DELETE /identity/v3/projects/72c640a373744ce6ade5d438b3663707 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:16:14.415079 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a2879-fa54-4832-80ef-3e7f77af1dfa None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:14.415533 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a2879-fa54-4832-80ef-3e7f77af1dfa None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:14.415609 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a2879-fa54-4832-80ef-3e7f77af1dfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:14.460853 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-697a2879-fa54-4832-80ef-3e7f77af1dfa None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:16:14.462121 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-697a2879-fa54-4832-80ef-3e7f77af1dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:14.534922 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 960/1921] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:16:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:16:14.542726 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1065b97e-ec0f-4fc7-bfb3-a8e6f774de0a None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:14.543318 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1065b97e-ec0f-4fc7-bfb3-a8e6f774de0a None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:14.544094 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1065b97e-ec0f-4fc7-bfb3-a8e6f774de0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:14.571902 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-1065b97e-ec0f-4fc7-bfb3-a8e6f774de0a None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:16:14.573270 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-1065b97e-ec0f-4fc7-bfb3-a8e6f774de0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:14.583876 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 962/1922] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:16:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:16:14.586363 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697a2879-fa54-4832-80ef-3e7f77af1dfa None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:14.598049 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697a2879-fa54-4832-80ef-3e7f77af1dfa None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:14.608939 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c44dc4-546d-4b78-9244-e62198d9bee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:14.609746 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c44dc4-546d-4b78-9244-e62198d9bee9 admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:14.610316 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c44dc4-546d-4b78-9244-e62198d9bee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:14.610690 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c44dc4-546d-4b78-9244-e62198d9bee9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:14.611561 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c44dc4-546d-4b78-9244-e62198d9bee9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:16:14.612115 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c44dc4-546d-4b78-9244-e62198d9bee9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:14.614017 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c44dc4-546d-4b78-9244-e62198d9bee9 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:14.631165 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 961/1923] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Mar 30 07:16:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:16:14.634576 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1065b97e-ec0f-4fc7-bfb3-a8e6f774de0a None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:14.644613 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1065b97e-ec0f-4fc7-bfb3-a8e6f774de0a None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:14.659372 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6e8244-8624-486a-b5f5-a42d1a2e4102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:14.660103 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e8244-8624-486a-b5f5-a42d1a2e4102 admin admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:14.660381 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e8244-8624-486a-b5f5-a42d1a2e4102 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:14.660720 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e8244-8624-486a-b5f5-a42d1a2e4102 admin admin] PATH_INFO: `/v3/projects` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:14.661353 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6e8244-8624-486a-b5f5-a42d1a2e4102 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:14.664029 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6e8244-8624-486a-b5f5-a42d1a2e4102 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:14.699844 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 963/1924] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Mar 30 07:16:14 2022] POST /identity/v3/projects => generated 385 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:16:14.702881 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c44dc4-546d-4b78-9244-e62198d9bee9 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:14.716140 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c44dc4-546d-4b78-9244-e62198d9bee9 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:14.781446 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dbdf0f-7020-4191-a86f-07b3357a0a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:14.782104 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dbdf0f-7020-4191-a86f-07b3357a0a45 admin admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:14.782385 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dbdf0f-7020-4191-a86f-07b3357a0a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:14.782766 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dbdf0f-7020-4191-a86f-07b3357a0a45 admin admin] PATH_INFO: `/v3/users` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:14.783347 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dbdf0f-7020-4191-a86f-07b3357a0a45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:14.785532 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dbdf0f-7020-4191-a86f-07b3357a0a45 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:14.810110 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 962/1925] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Mar 30 07:16:14 2022] POST /identity/v3/users => generated 293 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 07:16:14.814474 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6e8244-8624-486a-b5f5-a42d1a2e4102 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:14.825323 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6e8244-8624-486a-b5f5-a42d1a2e4102 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:14.830102 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6def33-4bf1-4c5c-8f12-daf9d1313fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:14.830773 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6def33-4bf1-4c5c-8f12-daf9d1313fd2 admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:14.831053 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6def33-4bf1-4c5c-8f12-daf9d1313fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:14.831329 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6def33-4bf1-4c5c-8f12-daf9d1313fd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:14.832116 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6def33-4bf1-4c5c-8f12-daf9d1313fd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:14.833981 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6def33-4bf1-4c5c-8f12-daf9d1313fd2 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:14.845572 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 964/1926] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:16:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:16:14.849648 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dbdf0f-7020-4191-a86f-07b3357a0a45 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:14.860454 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dbdf0f-7020-4191-a86f-07b3357a0a45 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:14.865528 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae49c7e-049b-4a48-bcab-9e93c7795f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:14.866454 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae49c7e-049b-4a48-bcab-9e93c7795f29 admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:14.866911 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae49c7e-049b-4a48-bcab-9e93c7795f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:14.867243 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae49c7e-049b-4a48-bcab-9e93c7795f29 admin admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:14.868056 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae49c7e-049b-4a48-bcab-9e93c7795f29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:14.872427 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae49c7e-049b-4a48-bcab-9e93c7795f29 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:14.885662 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 963/1927] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:16:14 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 30 07:16:14.891058 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6def33-4bf1-4c5c-8f12-daf9d1313fd2 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:14.901680 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6def33-4bf1-4c5c-8f12-daf9d1313fd2 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:14.908033 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dda00e-f935-42ba-a3f5-594a2969e587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:14.908952 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dda00e-f935-42ba-a3f5-594a2969e587 admin admin] REQUEST_METHOD: `PUT` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:14.909218 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dda00e-f935-42ba-a3f5-594a2969e587 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:14.909491 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dda00e-f935-42ba-a3f5-594a2969e587 admin admin] PATH_INFO: `/v3/projects/43a86ebcda754bf48c690d459216813a/users/c8dcc54b369840698829bd862d7cfd23/roles/5d79031a64754b57ba120367465e2252` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:14.932458 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dda00e-f935-42ba-a3f5-594a2969e587 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43a86ebcda754bf48c690d459216813a, user_id=c8dcc54b369840698829bd862d7cfd23, role_id=5d79031a64754b57ba120367465e2252)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:14.935742 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dda00e-f935-42ba-a3f5-594a2969e587 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:14.952676 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 965/1928] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:16:14 2022] PUT /identity/v3/projects/43a86ebcda754bf48c690d459216813a/users/c8dcc54b369840698829bd862d7cfd23/roles/5d79031a64754b57ba120367465e2252 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:16:14.964209 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70564fad-67fb-4029-b943-d94f374ad11f None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:14.964574 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70564fad-67fb-4029-b943-d94f374ad11f None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:14.964997 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70564fad-67fb-4029-b943-d94f374ad11f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:14.996381 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-70564fad-67fb-4029-b943-d94f374ad11f None None] MFA Rules not processed for user `c8dcc54b369840698829bd862d7cfd23`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:16:14.997665 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-70564fad-67fb-4029-b943-d94f374ad11f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:15.081422 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 964/1929] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:16:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 07:16:15.093790 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dda00e-f935-42ba-a3f5-594a2969e587 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:15.095760 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-a6dda00e-f935-42ba-a3f5-594a2969e587 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:15.161084 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dda00e-f935-42ba-a3f5-594a2969e587 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:15.164726 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fbdf64-b76b-4ecc-9708-d5dc65bcbd32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e2fda180e8d448d895c40cdad34bc4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:15.165420 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fbdf64-b76b-4ecc-9708-d5dc65bcbd32 service cinder] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:15.165695 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fbdf64-b76b-4ecc-9708-d5dc65bcbd32 service cinder] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:15.165963 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fbdf64-b76b-4ecc-9708-d5dc65bcbd32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:15.175917 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fbdf64-b76b-4ecc-9708-d5dc65bcbd32 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:15.176984 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fbdf64-b76b-4ecc-9708-d5dc65bcbd32 service cinder] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:15.187342 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 966/1930] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:16:15 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:16:15.213684 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70564fad-67fb-4029-b943-d94f374ad11f None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:15.296993 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70564fad-67fb-4029-b943-d94f374ad11f None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:15.302243 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8029a0f3-8c6a-47ac-9448-04dfa291d728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:15.303556 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8029a0f3-8c6a-47ac-9448-04dfa291d728 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:15.303990 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8029a0f3-8c6a-47ac-9448-04dfa291d728 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:15.304267 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8029a0f3-8c6a-47ac-9448-04dfa291d728 admin admin] PATH_INFO: `/v3/users/c8dcc54b369840698829bd862d7cfd23` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:15.306011 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8029a0f3-8c6a-47ac-9448-04dfa291d728 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8dcc54b369840698829bd862d7cfd23)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:15.307958 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8029a0f3-8c6a-47ac-9448-04dfa291d728 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:15.367448 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-8029a0f3-8c6a-47ac-9448-04dfa291d728 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8dcc54b369840698829bd862d7cfd23'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:15.368225 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-8029a0f3-8c6a-47ac-9448-04dfa291d728 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8dcc54b369840698829bd862d7cfd23'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:15.369062 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-8029a0f3-8c6a-47ac-9448-04dfa291d728 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8dcc54b369840698829bd862d7cfd23'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:15.380755 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-8029a0f3-8c6a-47ac-9448-04dfa291d728 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8dcc54b369840698829bd862d7cfd23'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:15.391857 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-8029a0f3-8c6a-47ac-9448-04dfa291d728 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8dcc54b369840698829bd862d7cfd23'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:15.425847 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 965/1931] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Mar 30 07:16:15 2022] DELETE /identity/v3/users/c8dcc54b369840698829bd862d7cfd23 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:16:15.430355 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e45564-c77d-4804-b72f-5f178986db3b None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:15.430644 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e45564-c77d-4804-b72f-5f178986db3b None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:15.430916 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e45564-c77d-4804-b72f-5f178986db3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:15.455384 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-b4e45564-c77d-4804-b72f-5f178986db3b None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:16:15.456612 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-b4e45564-c77d-4804-b72f-5f178986db3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:15.493611 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8029a0f3-8c6a-47ac-9448-04dfa291d728 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:15.502106 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-8029a0f3-8c6a-47ac-9448-04dfa291d728 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:15.548509 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 967/1932] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:16:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 07:16:15.559674 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e45564-c77d-4804-b72f-5f178986db3b None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:15.561760 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-b4e45564-c77d-4804-b72f-5f178986db3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:15.627715 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8029a0f3-8c6a-47ac-9448-04dfa291d728 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:15.638736 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07a9924-0e6d-452a-a532-18cfc0b235b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:15.642282 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07a9924-0e6d-452a-a532-18cfc0b235b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:15.642559 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07a9924-0e6d-452a-a532-18cfc0b235b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:15.642842 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07a9924-0e6d-452a-a532-18cfc0b235b4 admin admin] PATH_INFO: `/v3/users/a9cf134174164764b89853ef89b4d6e1` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:15.648520 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07a9924-0e6d-452a-a532-18cfc0b235b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9cf134174164764b89853ef89b4d6e1)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:15.650694 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07a9924-0e6d-452a-a532-18cfc0b235b4 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:15.672877 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e45564-c77d-4804-b72f-5f178986db3b None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:15.686226 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6509926-402b-4e0c-97d5-a5ecf162dac7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3802cb341445f994b9204744060ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:15.689580 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6509926-402b-4e0c-97d5-a5ecf162dac7 service neutron] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:15.689973 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6509926-402b-4e0c-97d5-a5ecf162dac7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:15.690351 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6509926-402b-4e0c-97d5-a5ecf162dac7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:15.736531 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6509926-402b-4e0c-97d5-a5ecf162dac7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:15.738273 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6509926-402b-4e0c-97d5-a5ecf162dac7 service neutron] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:15.767334 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 968/1933] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:16:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 30 07:16:15.768361 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-b07a9924-0e6d-452a-a532-18cfc0b235b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9cf134174164764b89853ef89b4d6e1'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:15.770478 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-b07a9924-0e6d-452a-a532-18cfc0b235b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9cf134174164764b89853ef89b4d6e1'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:15.772013 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-b07a9924-0e6d-452a-a532-18cfc0b235b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9cf134174164764b89853ef89b4d6e1'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:15.790245 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-b07a9924-0e6d-452a-a532-18cfc0b235b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9cf134174164764b89853ef89b4d6e1'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:15.808343 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-b07a9924-0e6d-452a-a532-18cfc0b235b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9cf134174164764b89853ef89b4d6e1'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:15.858980 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 966/1934] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Mar 30 07:16:15 2022] DELETE /identity/v3/users/a9cf134174164764b89853ef89b4d6e1 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:16:15.863827 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b8d783-fa82-46c2-b08f-f59f9b07c2ef None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:15.864109 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b8d783-fa82-46c2-b08f-f59f9b07c2ef None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:15.864371 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b8d783-fa82-46c2-b08f-f59f9b07c2ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:15.909937 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-07b8d783-fa82-46c2-b08f-f59f9b07c2ef None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:16:15.913420 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-07b8d783-fa82-46c2-b08f-f59f9b07c2ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:16.042811 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 969/1935] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:16:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:16:16.055015 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07a9924-0e6d-452a-a532-18cfc0b235b4 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:16.057604 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-b07a9924-0e6d-452a-a532-18cfc0b235b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:16.199678 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07a9924-0e6d-452a-a532-18cfc0b235b4 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:16.210574 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcafa12-b13b-408d-b821-501337ec92bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3802cb341445f994b9204744060ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:16.211404 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcafa12-b13b-408d-b821-501337ec92bd service neutron] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:16.211780 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcafa12-b13b-408d-b821-501337ec92bd service neutron] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:16.212334 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcafa12-b13b-408d-b821-501337ec92bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:16.231096 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcafa12-b13b-408d-b821-501337ec92bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:16.233774 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcafa12-b13b-408d-b821-501337ec92bd service neutron] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:16.252104 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 967/1936] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:16:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:16:16.373516 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b8d783-fa82-46c2-b08f-f59f9b07c2ef None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:16.374948 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-07b8d783-fa82-46c2-b08f-f59f9b07c2ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:16.391585 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b8d783-fa82-46c2-b08f-f59f9b07c2ef None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:16.396668 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777c7fd0-bdfb-4be1-bf50-e843e174ef04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:16.397724 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c7fd0-bdfb-4be1-bf50-e843e174ef04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:16.397889 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c7fd0-bdfb-4be1-bf50-e843e174ef04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:16.398178 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c7fd0-bdfb-4be1-bf50-e843e174ef04 admin admin] PATH_INFO: `/v3/projects/43a86ebcda754bf48c690d459216813a` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:16.399435 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777c7fd0-bdfb-4be1-bf50-e843e174ef04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43a86ebcda754bf48c690d459216813a)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:16.401393 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777c7fd0-bdfb-4be1-bf50-e843e174ef04 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:16.472683 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-777c7fd0-bdfb-4be1-bf50-e843e174ef04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43a86ebcda754bf48c690d459216813a', 'request_id': 'req-777c7fd0-bdfb-4be1-bf50-e843e174ef04'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:16.485924 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-777c7fd0-bdfb-4be1-bf50-e843e174ef04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43a86ebcda754bf48c690d459216813a', 'request_id': 'req-777c7fd0-bdfb-4be1-bf50-e843e174ef04'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:16.493071 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-777c7fd0-bdfb-4be1-bf50-e843e174ef04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43a86ebcda754bf48c690d459216813a', 'request_id': 'req-777c7fd0-bdfb-4be1-bf50-e843e174ef04'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:16.524693 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-777c7fd0-bdfb-4be1-bf50-e843e174ef04 admin admin] The token cache is being invalidate because project 43a86ebcda754bf48c690d459216813a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79960) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 07:16:16.524990 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-777c7fd0-bdfb-4be1-bf50-e843e174ef04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:16.526923 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-777c7fd0-bdfb-4be1-bf50-e843e174ef04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:16.529919 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 970/1937] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Mar 30 07:16:16 2022] DELETE /identity/v3/projects/43a86ebcda754bf48c690d459216813a => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 07:16:16.535573 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9999fb-c685-44c6-b5c4-615fec27827b None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:16.536060 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9999fb-c685-44c6-b5c4-615fec27827b None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:16.536149 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9999fb-c685-44c6-b5c4-615fec27827b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:16.559099 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-4a9999fb-c685-44c6-b5c4-615fec27827b None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:16:16.561642 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-4a9999fb-c685-44c6-b5c4-615fec27827b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:16.626607 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 968/1938] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:16:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:16:16.634481 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665fa56a-651e-46c8-a53f-94e1ef7024c5 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:16.634971 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665fa56a-651e-46c8-a53f-94e1ef7024c5 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:16.635149 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665fa56a-651e-46c8-a53f-94e1ef7024c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:16.656040 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-665fa56a-651e-46c8-a53f-94e1ef7024c5 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:16:16.657262 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-665fa56a-651e-46c8-a53f-94e1ef7024c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:16.667707 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 971/1939] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:16:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:16:16.674073 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9999fb-c685-44c6-b5c4-615fec27827b None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:16.686112 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9999fb-c685-44c6-b5c4-615fec27827b None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:16.690745 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b442da1-587b-4898-ac3d-9fad398dd811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:16.691417 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b442da1-587b-4898-ac3d-9fad398dd811 admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:16.691701 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b442da1-587b-4898-ac3d-9fad398dd811 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:16.692022 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b442da1-587b-4898-ac3d-9fad398dd811 admin admin] PATH_INFO: `/v3/domains` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:16.692908 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b442da1-587b-4898-ac3d-9fad398dd811 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:16:16.693255 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b442da1-587b-4898-ac3d-9fad398dd811 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:16.695065 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b442da1-587b-4898-ac3d-9fad398dd811 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:16.708697 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 969/1940] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Mar 30 07:16:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:16:16.713767 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665fa56a-651e-46c8-a53f-94e1ef7024c5 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:16.730441 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665fa56a-651e-46c8-a53f-94e1ef7024c5 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:16.735585 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b442da1-587b-4898-ac3d-9fad398dd811 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:16.738364 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-5b442da1-587b-4898-ac3d-9fad398dd811 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:16.739777 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb0c1f5-12ec-402f-8d93-42b6a7ebef83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:16.740658 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb0c1f5-12ec-402f-8d93-42b6a7ebef83 admin admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:16.741162 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb0c1f5-12ec-402f-8d93-42b6a7ebef83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:16.741535 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb0c1f5-12ec-402f-8d93-42b6a7ebef83 admin admin] PATH_INFO: `/v3/projects` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:16.742427 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb0c1f5-12ec-402f-8d93-42b6a7ebef83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:16.744821 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb0c1f5-12ec-402f-8d93-42b6a7ebef83 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:16.754767 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b442da1-587b-4898-ac3d-9fad398dd811 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:16.766285 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0247f0f9-84a5-486a-a4de-d9a7aa39c465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:16.767534 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0247f0f9-84a5-486a-a4de-d9a7aa39c465 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:16.767985 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0247f0f9-84a5-486a-a4de-d9a7aa39c465 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:16.768393 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0247f0f9-84a5-486a-a4de-d9a7aa39c465 admin admin] PATH_INFO: `/v3/projects/893e3b80ed084ef992de9503d05aca17` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:16.769855 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0247f0f9-84a5-486a-a4de-d9a7aa39c465 admin admin] RBAC: Authorizing `identity:delete_project(project_id=893e3b80ed084ef992de9503d05aca17)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:16.772567 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0247f0f9-84a5-486a-a4de-d9a7aa39c465 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:16.805440 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 972/1941] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Mar 30 07:16:16 2022] POST /identity/v3/projects => generated 383 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:16:16.810049 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb0c1f5-12ec-402f-8d93-42b6a7ebef83 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:16.827902 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-0247f0f9-84a5-486a-a4de-d9a7aa39c465 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '893e3b80ed084ef992de9503d05aca17', 'request_id': 'req-0247f0f9-84a5-486a-a4de-d9a7aa39c465'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:16.837688 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-0247f0f9-84a5-486a-a4de-d9a7aa39c465 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '893e3b80ed084ef992de9503d05aca17', 'request_id': 'req-0247f0f9-84a5-486a-a4de-d9a7aa39c465'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:16.846723 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-0247f0f9-84a5-486a-a4de-d9a7aa39c465 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '893e3b80ed084ef992de9503d05aca17', 'request_id': 'req-0247f0f9-84a5-486a-a4de-d9a7aa39c465'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:16.859088 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-0247f0f9-84a5-486a-a4de-d9a7aa39c465 admin admin] The token cache is being invalidate because project 893e3b80ed084ef992de9503d05aca17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79961) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 07:16:16.859393 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-0247f0f9-84a5-486a-a4de-d9a7aa39c465 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:16.860231 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-0247f0f9-84a5-486a-a4de-d9a7aa39c465 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:16.861946 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 970/1942] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Mar 30 07:16:16 2022] DELETE /identity/v3/projects/893e3b80ed084ef992de9503d05aca17 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 07:16:16.866651 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0247f0f9-84a5-486a-a4de-d9a7aa39c465 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:16.867775 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-0247f0f9-84a5-486a-a4de-d9a7aa39c465 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:16.877985 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb0c1f5-12ec-402f-8d93-42b6a7ebef83 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:16.934191 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0247f0f9-84a5-486a-a4de-d9a7aa39c465 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:16.938780 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9c53ef-1770-470d-b521-239b6c00ed4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:16.939685 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c53ef-1770-470d-b521-239b6c00ed4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:16.939994 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c53ef-1770-470d-b521-239b6c00ed4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:16.940270 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c53ef-1770-470d-b521-239b6c00ed4d admin admin] PATH_INFO: `/v3/users/e6a4a15032cf4cdc93e77d6dfb1dd6d7` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:16.941452 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9c53ef-1770-470d-b521-239b6c00ed4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6a4a15032cf4cdc93e77d6dfb1dd6d7)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:16.942242 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ef717b-175d-47e7-954d-c69012f95c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:16.942913 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ef717b-175d-47e7-954d-c69012f95c09 admin admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:16.943209 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ef717b-175d-47e7-954d-c69012f95c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:16.943435 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9c53ef-1770-470d-b521-239b6c00ed4d admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:16.943530 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ef717b-175d-47e7-954d-c69012f95c09 admin admin] PATH_INFO: `/v3/users` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:16.944163 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ef717b-175d-47e7-954d-c69012f95c09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:16.946075 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ef717b-175d-47e7-954d-c69012f95c09 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:16.971291 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 973/1943] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Mar 30 07:16:16 2022] POST /identity/v3/users => generated 292 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 07:16:16.973692 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ef717b-175d-47e7-954d-c69012f95c09 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:16.975747 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-b4ef717b-175d-47e7-954d-c69012f95c09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:16.988602 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ef717b-175d-47e7-954d-c69012f95c09 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:16.993298 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-6a9c53ef-1770-470d-b521-239b6c00ed4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6a4a15032cf4cdc93e77d6dfb1dd6d7'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:16.994595 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-6a9c53ef-1770-470d-b521-239b6c00ed4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6a4a15032cf4cdc93e77d6dfb1dd6d7'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:16.995259 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-6a9c53ef-1770-470d-b521-239b6c00ed4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6a4a15032cf4cdc93e77d6dfb1dd6d7'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:16.995957 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113c8947-1f93-42ed-88b4-293b620c9a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:16.996632 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c8947-1f93-42ed-88b4-293b620c9a49 admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:16.996907 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c8947-1f93-42ed-88b4-293b620c9a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:16.997173 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c8947-1f93-42ed-88b4-293b620c9a49 admin admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:16.997945 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113c8947-1f93-42ed-88b4-293b620c9a49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:16.999831 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113c8947-1f93-42ed-88b4-293b620c9a49 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:17.004211 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-6a9c53ef-1770-470d-b521-239b6c00ed4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6a4a15032cf4cdc93e77d6dfb1dd6d7'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:17.010423 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 974/1944] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:16:16 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:16:17.011537 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-6a9c53ef-1770-470d-b521-239b6c00ed4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6a4a15032cf4cdc93e77d6dfb1dd6d7'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:17.014972 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113c8947-1f93-42ed-88b4-293b620c9a49 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:17.016639 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-113c8947-1f93-42ed-88b4-293b620c9a49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:17.029587 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113c8947-1f93-42ed-88b4-293b620c9a49 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:17.031774 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 971/1945] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Mar 30 07:16:16 2022] DELETE /identity/v3/users/e6a4a15032cf4cdc93e77d6dfb1dd6d7 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 07:16:17.034131 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873582a5-86a7-496f-9b07-26012c130a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:17.034790 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873582a5-86a7-496f-9b07-26012c130a94 admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:17.035066 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873582a5-86a7-496f-9b07-26012c130a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:17.035341 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873582a5-86a7-496f-9b07-26012c130a94 admin admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:17.036124 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873582a5-86a7-496f-9b07-26012c130a94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:17.037716 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873582a5-86a7-496f-9b07-26012c130a94 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:17.049342 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 975/1946] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:16:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 30 07:16:17.054906 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9c53ef-1770-470d-b521-239b6c00ed4d admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:17.124437 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9c53ef-1770-470d-b521-239b6c00ed4d admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:17.129323 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40988d45-62ac-4bf8-adae-a6298bced2f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:17.130241 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40988d45-62ac-4bf8-adae-a6298bced2f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:17.130517 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40988d45-62ac-4bf8-adae-a6298bced2f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:17.130775 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40988d45-62ac-4bf8-adae-a6298bced2f5 admin admin] PATH_INFO: `/v3/projects/dd0285ecbfb045d29f646eab8bea7a34/users/6697e96acaea487a824c4c3ac2932cd6/roles/5d79031a64754b57ba120367465e2252` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:17.146481 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40988d45-62ac-4bf8-adae-a6298bced2f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd0285ecbfb045d29f646eab8bea7a34, user_id=6697e96acaea487a824c4c3ac2932cd6, role_id=5d79031a64754b57ba120367465e2252)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:17.149247 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40988d45-62ac-4bf8-adae-a6298bced2f5 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:17.165521 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 972/1947] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:16:17 2022] PUT /identity/v3/projects/dd0285ecbfb045d29f646eab8bea7a34/users/6697e96acaea487a824c4c3ac2932cd6/roles/5d79031a64754b57ba120367465e2252 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:16:17.178249 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1d9fbf-6c62-42d0-8712-381db8e31622 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:17.178532 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1d9fbf-6c62-42d0-8712-381db8e31622 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:17.178831 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1d9fbf-6c62-42d0-8712-381db8e31622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:17.211383 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-dd1d9fbf-6c62-42d0-8712-381db8e31622 None None] MFA Rules not processed for user `6697e96acaea487a824c4c3ac2932cd6`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:16:17.214641 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-dd1d9fbf-6c62-42d0-8712-381db8e31622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:17.294986 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 976/1948] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:16:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:16:17.306654 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40988d45-62ac-4bf8-adae-a6298bced2f5 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:17.308642 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-40988d45-62ac-4bf8-adae-a6298bced2f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:17.343340 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1d9fbf-6c62-42d0-8712-381db8e31622 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:17.344796 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-dd1d9fbf-6c62-42d0-8712-381db8e31622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:17.369106 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40988d45-62ac-4bf8-adae-a6298bced2f5 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:17.373831 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a206868-75f0-4a4f-a569-34c9b91fbc24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e2fda180e8d448d895c40cdad34bc4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:17.374561 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a206868-75f0-4a4f-a569-34c9b91fbc24 service cinder] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:17.375224 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a206868-75f0-4a4f-a569-34c9b91fbc24 service cinder] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:17.375224 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a206868-75f0-4a4f-a569-34c9b91fbc24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:17.384196 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a206868-75f0-4a4f-a569-34c9b91fbc24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:17.385694 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a206868-75f0-4a4f-a569-34c9b91fbc24 service cinder] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:17.395377 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 973/1949] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:16:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:16:17.416062 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1d9fbf-6c62-42d0-8712-381db8e31622 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:17.421420 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed58ea4-cdbf-47b6-ba4a-9093ede62679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:17.422901 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed58ea4-cdbf-47b6-ba4a-9093ede62679 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:17.423362 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed58ea4-cdbf-47b6-ba4a-9093ede62679 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:17.423902 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed58ea4-cdbf-47b6-ba4a-9093ede62679 admin admin] PATH_INFO: `/v3/projects/e9949aa6e06c4d998e766b4afc8a90f8` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:17.425953 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed58ea4-cdbf-47b6-ba4a-9093ede62679 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9949aa6e06c4d998e766b4afc8a90f8)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:17.429194 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed58ea4-cdbf-47b6-ba4a-9093ede62679 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:17.476743 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-5ed58ea4-cdbf-47b6-ba4a-9093ede62679 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9949aa6e06c4d998e766b4afc8a90f8', 'request_id': 'req-5ed58ea4-cdbf-47b6-ba4a-9093ede62679'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:17.484671 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-5ed58ea4-cdbf-47b6-ba4a-9093ede62679 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9949aa6e06c4d998e766b4afc8a90f8', 'request_id': 'req-5ed58ea4-cdbf-47b6-ba4a-9093ede62679'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:17.490591 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-5ed58ea4-cdbf-47b6-ba4a-9093ede62679 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9949aa6e06c4d998e766b4afc8a90f8', 'request_id': 'req-5ed58ea4-cdbf-47b6-ba4a-9093ede62679'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:17.501603 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-5ed58ea4-cdbf-47b6-ba4a-9093ede62679 admin admin] The token cache is being invalidate because project e9949aa6e06c4d998e766b4afc8a90f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79960) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 07:16:17.501882 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-5ed58ea4-cdbf-47b6-ba4a-9093ede62679 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:17.502538 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-5ed58ea4-cdbf-47b6-ba4a-9093ede62679 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:17.504135 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 977/1950] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Mar 30 07:16:17 2022] DELETE /identity/v3/projects/e9949aa6e06c4d998e766b4afc8a90f8 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 07:16:17.509345 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ecc45-5eef-4b77-8f84-9a7922e6536c None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:17.509655 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ecc45-5eef-4b77-8f84-9a7922e6536c None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:17.509906 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ecc45-5eef-4b77-8f84-9a7922e6536c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:17.528842 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-e64ecc45-5eef-4b77-8f84-9a7922e6536c None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:16:17.530306 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-e64ecc45-5eef-4b77-8f84-9a7922e6536c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:17.602379 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 974/1951] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:16:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:16:17.604154 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ca891-29b4-40dc-af13-ed4850ca553b None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:17.604475 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ca891-29b4-40dc-af13-ed4850ca553b None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:17.604742 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ca891-29b4-40dc-af13-ed4850ca553b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:17.625410 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-b21ca891-29b4-40dc-af13-ed4850ca553b None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:16:17.626942 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-b21ca891-29b4-40dc-af13-ed4850ca553b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:17.650141 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 978/1952] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:16:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 07:16:17.654572 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64ecc45-5eef-4b77-8f84-9a7922e6536c None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:17.665054 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64ecc45-5eef-4b77-8f84-9a7922e6536c None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:17.670869 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a0eb30-d653-4f21-b2ff-600c3707d73a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:17.671989 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a0eb30-d653-4f21-b2ff-600c3707d73a admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:17.672287 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a0eb30-d653-4f21-b2ff-600c3707d73a admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:17.672575 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a0eb30-d653-4f21-b2ff-600c3707d73a admin admin] PATH_INFO: `/v3/domains` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:17.673399 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a0eb30-d653-4f21-b2ff-600c3707d73a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:16:17.673866 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a0eb30-d653-4f21-b2ff-600c3707d73a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:17.675651 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a0eb30-d653-4f21-b2ff-600c3707d73a admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:17.691837 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 975/1953] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Mar 30 07:16:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:16:17.698982 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21ca891-29b4-40dc-af13-ed4850ca553b None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:17.708994 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21ca891-29b4-40dc-af13-ed4850ca553b None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:17.713709 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f78e30-da2e-40d6-a9f8-45f53f35f468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:17.714370 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f78e30-da2e-40d6-a9f8-45f53f35f468 admin admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:17.714653 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f78e30-da2e-40d6-a9f8-45f53f35f468 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:17.714925 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f78e30-da2e-40d6-a9f8-45f53f35f468 admin admin] PATH_INFO: `/v3/projects` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:17.716053 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f78e30-da2e-40d6-a9f8-45f53f35f468 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:17.718028 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f78e30-da2e-40d6-a9f8-45f53f35f468 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:17.749709 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 979/1954] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Mar 30 07:16:17 2022] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:16:17.754432 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a0eb30-d653-4f21-b2ff-600c3707d73a admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:17.765102 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a0eb30-d653-4f21-b2ff-600c3707d73a admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:17.825537 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8824544-46f7-47f9-9423-764b3d62fe62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:17.826264 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8824544-46f7-47f9-9423-764b3d62fe62 admin admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:17.826519 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8824544-46f7-47f9-9423-764b3d62fe62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:17.826821 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8824544-46f7-47f9-9423-764b3d62fe62 admin admin] PATH_INFO: `/v3/users` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:17.827498 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8824544-46f7-47f9-9423-764b3d62fe62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:17.829433 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8824544-46f7-47f9-9423-764b3d62fe62 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:17.854149 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 976/1955] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Mar 30 07:16:17 2022] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 07:16:17.856629 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f78e30-da2e-40d6-a9f8-45f53f35f468 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:17.867282 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f78e30-da2e-40d6-a9f8-45f53f35f468 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:17.872861 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a55dfce-ff7b-411d-a619-2a02009c5124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:17.873969 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a55dfce-ff7b-411d-a619-2a02009c5124 admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:17.874459 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a55dfce-ff7b-411d-a619-2a02009c5124 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:17.874940 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a55dfce-ff7b-411d-a619-2a02009c5124 admin admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:17.876386 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a55dfce-ff7b-411d-a619-2a02009c5124 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:17.879180 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a55dfce-ff7b-411d-a619-2a02009c5124 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:17.890657 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 980/1956] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:16:17 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:16:17.894860 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8824544-46f7-47f9-9423-764b3d62fe62 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:17.905228 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8824544-46f7-47f9-9423-764b3d62fe62 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:17.911285 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadd89f5-0a12-4bbc-a454-d4c026c9db70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:17.912459 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadd89f5-0a12-4bbc-a454-d4c026c9db70 admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:17.912874 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadd89f5-0a12-4bbc-a454-d4c026c9db70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:17.913158 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadd89f5-0a12-4bbc-a454-d4c026c9db70 admin admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:17.913897 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadd89f5-0a12-4bbc-a454-d4c026c9db70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:17.915704 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadd89f5-0a12-4bbc-a454-d4c026c9db70 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:17.930651 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 977/1957] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:16:17 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:16:17.932558 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a55dfce-ff7b-411d-a619-2a02009c5124 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:17.943667 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a55dfce-ff7b-411d-a619-2a02009c5124 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:17.948537 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb15884-f829-43a8-981c-bb6b37a61803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:17.949428 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb15884-f829-43a8-981c-bb6b37a61803 admin admin] REQUEST_METHOD: `PUT` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:17.949930 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb15884-f829-43a8-981c-bb6b37a61803 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:17.950363 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb15884-f829-43a8-981c-bb6b37a61803 admin admin] PATH_INFO: `/v3/projects/9c0e413ae9784525a486e41173a1b27b/users/a601c4c65cec4936a3b83d34f1e8d3cc/roles/5d79031a64754b57ba120367465e2252` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:17.965910 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb15884-f829-43a8-981c-bb6b37a61803 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c0e413ae9784525a486e41173a1b27b, user_id=a601c4c65cec4936a3b83d34f1e8d3cc, role_id=5d79031a64754b57ba120367465e2252)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:17.968617 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb15884-f829-43a8-981c-bb6b37a61803 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:17.982886 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 981/1958] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:16:17 2022] PUT /identity/v3/projects/9c0e413ae9784525a486e41173a1b27b/users/a601c4c65cec4936a3b83d34f1e8d3cc/roles/5d79031a64754b57ba120367465e2252 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:16:17.993222 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93ec1c7-099f-4db6-acc6-a4af3fda598d None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:17.993509 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93ec1c7-099f-4db6-acc6-a4af3fda598d None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:17.993781 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93ec1c7-099f-4db6-acc6-a4af3fda598d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:18.021981 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-c93ec1c7-099f-4db6-acc6-a4af3fda598d None None] MFA Rules not processed for user `a601c4c65cec4936a3b83d34f1e8d3cc`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:16:18.023183 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-c93ec1c7-099f-4db6-acc6-a4af3fda598d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:18.087573 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 978/1959] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:16:17 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:16:18.098929 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb15884-f829-43a8-981c-bb6b37a61803 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:18.100687 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-0fb15884-f829-43a8-981c-bb6b37a61803 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:18.156873 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb15884-f829-43a8-981c-bb6b37a61803 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:18.160919 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e55c5d-c6be-4901-9032-e249e9fccfaa service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e880ade912f3412abf44ba73939d6e50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:18.161571 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e55c5d-c6be-4901-9032-e249e9fccfaa service glance] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:18.161853 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e55c5d-c6be-4901-9032-e249e9fccfaa service glance] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:18.162149 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e55c5d-c6be-4901-9032-e249e9fccfaa service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:18.170824 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e55c5d-c6be-4901-9032-e249e9fccfaa service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:18.172292 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e55c5d-c6be-4901-9032-e249e9fccfaa service glance] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:18.181211 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 982/1960] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:16:18 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:16:21.011677 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93ec1c7-099f-4db6-acc6-a4af3fda598d None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:21.013331 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-c93ec1c7-099f-4db6-acc6-a4af3fda598d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:21.082915 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93ec1c7-099f-4db6-acc6-a4af3fda598d None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:21.088788 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a768f7ee-df30-43ad-9282-33cd4e65c0d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:21.089711 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a768f7ee-df30-43ad-9282-33cd4e65c0d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:21.089992 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a768f7ee-df30-43ad-9282-33cd4e65c0d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:21.090391 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a768f7ee-df30-43ad-9282-33cd4e65c0d6 admin admin] PATH_INFO: `/v3/users/6697e96acaea487a824c4c3ac2932cd6` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:21.091613 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a768f7ee-df30-43ad-9282-33cd4e65c0d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6697e96acaea487a824c4c3ac2932cd6)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:21.095876 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a768f7ee-df30-43ad-9282-33cd4e65c0d6 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:21.145773 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-a768f7ee-df30-43ad-9282-33cd4e65c0d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6697e96acaea487a824c4c3ac2932cd6'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:21.146680 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-a768f7ee-df30-43ad-9282-33cd4e65c0d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6697e96acaea487a824c4c3ac2932cd6'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:21.147520 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-a768f7ee-df30-43ad-9282-33cd4e65c0d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6697e96acaea487a824c4c3ac2932cd6'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:21.158702 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-a768f7ee-df30-43ad-9282-33cd4e65c0d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6697e96acaea487a824c4c3ac2932cd6'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:21.166486 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-a768f7ee-df30-43ad-9282-33cd4e65c0d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6697e96acaea487a824c4c3ac2932cd6'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:21.171300 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e55c5d-c6be-4901-9032-e249e9fccfaa service glance] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:21.172875 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-88e55c5d-c6be-4901-9032-e249e9fccfaa service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:21.186656 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 979/1961] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Mar 30 07:16:21 2022] DELETE /identity/v3/users/6697e96acaea487a824c4c3ac2932cd6 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:16:21.190401 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e55c5d-c6be-4901-9032-e249e9fccfaa service glance] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:21.191444 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89193c0-0bbb-4e7c-b8f6-63447cee1974 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:21.191725 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89193c0-0bbb-4e7c-b8f6-63447cee1974 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:21.192123 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89193c0-0bbb-4e7c-b8f6-63447cee1974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:21.212958 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-d89193c0-0bbb-4e7c-b8f6-63447cee1974 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:16:21.214698 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-d89193c0-0bbb-4e7c-b8f6-63447cee1974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:21.259038 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56959eb-ff3d-4aa5-a1f5-e2b48ca0eb78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:21.260397 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56959eb-ff3d-4aa5-a1f5-e2b48ca0eb78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:21.260827 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56959eb-ff3d-4aa5-a1f5-e2b48ca0eb78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:21.261331 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56959eb-ff3d-4aa5-a1f5-e2b48ca0eb78 admin admin] PATH_INFO: `/v3/users/b775cdb37e6f4afb97f1c230dc0c45db` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:21.262945 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56959eb-ff3d-4aa5-a1f5-e2b48ca0eb78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b775cdb37e6f4afb97f1c230dc0c45db)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:21.265193 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56959eb-ff3d-4aa5-a1f5-e2b48ca0eb78 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:21.278067 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 980/1962] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:16:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 07:16:21.288088 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89193c0-0bbb-4e7c-b8f6-63447cee1974 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:21.289497 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-d89193c0-0bbb-4e7c-b8f6-63447cee1974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:21.315460 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-b56959eb-ff3d-4aa5-a1f5-e2b48ca0eb78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b775cdb37e6f4afb97f1c230dc0c45db'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:21.316127 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-b56959eb-ff3d-4aa5-a1f5-e2b48ca0eb78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b775cdb37e6f4afb97f1c230dc0c45db'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:21.323545 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-b56959eb-ff3d-4aa5-a1f5-e2b48ca0eb78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b775cdb37e6f4afb97f1c230dc0c45db'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:21.335119 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-b56959eb-ff3d-4aa5-a1f5-e2b48ca0eb78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b775cdb37e6f4afb97f1c230dc0c45db'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:21.335884 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-b56959eb-ff3d-4aa5-a1f5-e2b48ca0eb78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b775cdb37e6f4afb97f1c230dc0c45db'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:21.343821 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89193c0-0bbb-4e7c-b8f6-63447cee1974 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:21.347692 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de28116-9b5c-4ae2-8c29-b42a7d9460cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3802cb341445f994b9204744060ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:21.348392 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de28116-9b5c-4ae2-8c29-b42a7d9460cd service neutron] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:21.348668 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de28116-9b5c-4ae2-8c29-b42a7d9460cd service neutron] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:21.348969 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de28116-9b5c-4ae2-8c29-b42a7d9460cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:21.350743 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-8de28116-9b5c-4ae2-8c29-b42a7d9460cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:21.355073 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 983/1963] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Mar 30 07:16:21 2022] DELETE /identity/v3/users/b775cdb37e6f4afb97f1c230dc0c45db => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 07:16:21.360249 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb428e-daa1-488a-b54f-cbc1572c6db3 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:21.360541 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb428e-daa1-488a-b54f-cbc1572c6db3 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:21.360966 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb428e-daa1-488a-b54f-cbc1572c6db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:21.363478 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de28116-9b5c-4ae2-8c29-b42a7d9460cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:21.365001 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de28116-9b5c-4ae2-8c29-b42a7d9460cd service neutron] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:21.375527 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 981/1964] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:16:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:16:21.384383 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-abeb428e-daa1-488a-b54f-cbc1572c6db3 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:16:21.385600 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-abeb428e-daa1-488a-b54f-cbc1572c6db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:21.475845 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 984/1965] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:16:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:16:21.486278 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de28116-9b5c-4ae2-8c29-b42a7d9460cd service neutron] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:21.488093 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-8de28116-9b5c-4ae2-8c29-b42a7d9460cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:21.503640 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de28116-9b5c-4ae2-8c29-b42a7d9460cd service neutron] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:21.564644 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd255324-d853-45ca-b789-4001a257f094 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3802cb341445f994b9204744060ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:21.565309 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd255324-d853-45ca-b789-4001a257f094 service neutron] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:21.565933 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd255324-d853-45ca-b789-4001a257f094 service neutron] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:21.565933 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd255324-d853-45ca-b789-4001a257f094 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:21.578069 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd255324-d853-45ca-b789-4001a257f094 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:21.579436 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd255324-d853-45ca-b789-4001a257f094 service neutron] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:21.596860 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 982/1966] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:16:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:16:21.757639 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeb428e-daa1-488a-b54f-cbc1572c6db3 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:21.759291 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-abeb428e-daa1-488a-b54f-cbc1572c6db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:21.774158 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeb428e-daa1-488a-b54f-cbc1572c6db3 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:21.781575 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d3b7b6-adb7-4365-a047-b69006ca7297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:21.782979 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d3b7b6-adb7-4365-a047-b69006ca7297 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:21.795467 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d3b7b6-adb7-4365-a047-b69006ca7297 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:21.795929 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d3b7b6-adb7-4365-a047-b69006ca7297 admin admin] PATH_INFO: `/v3/projects/dd0285ecbfb045d29f646eab8bea7a34` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:21.798836 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d3b7b6-adb7-4365-a047-b69006ca7297 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd0285ecbfb045d29f646eab8bea7a34)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:21.801746 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d3b7b6-adb7-4365-a047-b69006ca7297 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:21.882812 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-f7d3b7b6-adb7-4365-a047-b69006ca7297 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd0285ecbfb045d29f646eab8bea7a34', 'request_id': 'req-f7d3b7b6-adb7-4365-a047-b69006ca7297'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:21.907415 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-f7d3b7b6-adb7-4365-a047-b69006ca7297 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd0285ecbfb045d29f646eab8bea7a34', 'request_id': 'req-f7d3b7b6-adb7-4365-a047-b69006ca7297'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:21.914567 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-f7d3b7b6-adb7-4365-a047-b69006ca7297 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd0285ecbfb045d29f646eab8bea7a34', 'request_id': 'req-f7d3b7b6-adb7-4365-a047-b69006ca7297'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:21.926287 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-f7d3b7b6-adb7-4365-a047-b69006ca7297 admin admin] The token cache is being invalidate because project dd0285ecbfb045d29f646eab8bea7a34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79960) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 07:16:21.926557 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-f7d3b7b6-adb7-4365-a047-b69006ca7297 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:21.927193 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-f7d3b7b6-adb7-4365-a047-b69006ca7297 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:21.929139 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 985/1967] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Mar 30 07:16:21 2022] DELETE /identity/v3/projects/dd0285ecbfb045d29f646eab8bea7a34 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:16:21.934487 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e530f7fd-d92d-4565-878a-a89bc8f6419e None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:21.934807 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e530f7fd-d92d-4565-878a-a89bc8f6419e None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:21.935089 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e530f7fd-d92d-4565-878a-a89bc8f6419e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:21.953844 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-e530f7fd-d92d-4565-878a-a89bc8f6419e None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:16:21.955261 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-e530f7fd-d92d-4565-878a-a89bc8f6419e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:22.036302 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 983/1968] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:16:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:16:22.038269 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ad074-39d7-4ad3-89f9-57ac3b3555c2 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:22.038607 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ad074-39d7-4ad3-89f9-57ac3b3555c2 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:22.038924 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ad074-39d7-4ad3-89f9-57ac3b3555c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:22.066295 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-128ad074-39d7-4ad3-89f9-57ac3b3555c2 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:16:22.067924 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-128ad074-39d7-4ad3-89f9-57ac3b3555c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:22.076172 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 986/1969] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:16:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 07:16:22.081213 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e530f7fd-d92d-4565-878a-a89bc8f6419e None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:22.091487 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e530f7fd-d92d-4565-878a-a89bc8f6419e None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:22.098272 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128ad074-39d7-4ad3-89f9-57ac3b3555c2 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:22.099648 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-128ad074-39d7-4ad3-89f9-57ac3b3555c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:22.107619 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbbf394-6e0c-48e8-bfc9-230837392487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:22.108469 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbbf394-6e0c-48e8-bfc9-230837392487 admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:22.108808 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbbf394-6e0c-48e8-bfc9-230837392487 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:22.109500 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbbf394-6e0c-48e8-bfc9-230837392487 admin admin] PATH_INFO: `/v3/domains` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:22.110287 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbbf394-6e0c-48e8-bfc9-230837392487 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:16:22.110620 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbbf394-6e0c-48e8-bfc9-230837392487 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:22.113089 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128ad074-39d7-4ad3-89f9-57ac3b3555c2 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:22.113217 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbbf394-6e0c-48e8-bfc9-230837392487 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:22.119156 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2c5257-6aef-4713-b91b-8db6f61ef08a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:22.120852 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2c5257-6aef-4713-b91b-8db6f61ef08a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:22.121281 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2c5257-6aef-4713-b91b-8db6f61ef08a admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:22.121630 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2c5257-6aef-4713-b91b-8db6f61ef08a admin admin] PATH_INFO: `/v3/projects/728b95eba64247c6aab0736ea79dd7ac` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:22.123464 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2c5257-6aef-4713-b91b-8db6f61ef08a admin admin] RBAC: Authorizing `identity:delete_project(project_id=728b95eba64247c6aab0736ea79dd7ac)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:22.125926 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2c5257-6aef-4713-b91b-8db6f61ef08a admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:22.134642 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 984/1970] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Mar 30 07:16:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:16:22.139574 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbbf394-6e0c-48e8-bfc9-230837392487 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:22.154061 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbbf394-6e0c-48e8-bfc9-230837392487 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:22.160180 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7c6b9c-6ff5-4987-b016-1c225a9041f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:22.161272 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7c6b9c-6ff5-4987-b016-1c225a9041f8 admin admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:22.161556 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7c6b9c-6ff5-4987-b016-1c225a9041f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:22.161883 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7c6b9c-6ff5-4987-b016-1c225a9041f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:22.162588 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7c6b9c-6ff5-4987-b016-1c225a9041f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:22.164750 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7c6b9c-6ff5-4987-b016-1c225a9041f8 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:22.175701 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-7a2c5257-6aef-4713-b91b-8db6f61ef08a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '728b95eba64247c6aab0736ea79dd7ac', 'request_id': 'req-7a2c5257-6aef-4713-b91b-8db6f61ef08a'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:22.185918 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-7a2c5257-6aef-4713-b91b-8db6f61ef08a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '728b95eba64247c6aab0736ea79dd7ac', 'request_id': 'req-7a2c5257-6aef-4713-b91b-8db6f61ef08a'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:22.192711 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-7a2c5257-6aef-4713-b91b-8db6f61ef08a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '728b95eba64247c6aab0736ea79dd7ac', 'request_id': 'req-7a2c5257-6aef-4713-b91b-8db6f61ef08a'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:22.195311 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 985/1971] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Mar 30 07:16:22 2022] POST /identity/v3/projects => generated 369 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 07:16:22.199659 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7c6b9c-6ff5-4987-b016-1c225a9041f8 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:22.212582 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-7a2c5257-6aef-4713-b91b-8db6f61ef08a admin admin] The token cache is being invalidate because project 728b95eba64247c6aab0736ea79dd7ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79960) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 07:16:22.212868 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-7a2c5257-6aef-4713-b91b-8db6f61ef08a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:22.214373 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-7a2c5257-6aef-4713-b91b-8db6f61ef08a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:22.217405 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 987/1972] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Mar 30 07:16:22 2022] DELETE /identity/v3/projects/728b95eba64247c6aab0736ea79dd7ac => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 07:16:22.221986 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2c5257-6aef-4713-b91b-8db6f61ef08a admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:22.223704 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-7a2c5257-6aef-4713-b91b-8db6f61ef08a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:22.296275 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7c6b9c-6ff5-4987-b016-1c225a9041f8 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:22.301666 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466d904c-395e-4676-9325-4a642304c70c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:22.302439 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d904c-395e-4676-9325-4a642304c70c admin admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:22.302787 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d904c-395e-4676-9325-4a642304c70c admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:22.303125 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d904c-395e-4676-9325-4a642304c70c admin admin] PATH_INFO: `/v3/users` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:22.303594 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2c5257-6aef-4713-b91b-8db6f61ef08a admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:22.303981 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466d904c-395e-4676-9325-4a642304c70c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:22.306530 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466d904c-395e-4676-9325-4a642304c70c admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:22.310543 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec353b6-8bdc-4ac1-bca7-37062affeb73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:22.310543 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec353b6-8bdc-4ac1-bca7-37062affeb73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:22.310543 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec353b6-8bdc-4ac1-bca7-37062affeb73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:22.310543 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec353b6-8bdc-4ac1-bca7-37062affeb73 admin admin] PATH_INFO: `/v3/users/36b949ab7fb344b69d978b137fec134e` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:22.311050 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec353b6-8bdc-4ac1-bca7-37062affeb73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36b949ab7fb344b69d978b137fec134e)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:22.313051 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec353b6-8bdc-4ac1-bca7-37062affeb73 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:22.336259 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 986/1973] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Mar 30 07:16:22 2022] POST /identity/v3/users => generated 285 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 07:16:22.337293 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466d904c-395e-4676-9325-4a642304c70c admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:22.339142 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-466d904c-395e-4676-9325-4a642304c70c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:22.353365 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466d904c-395e-4676-9325-4a642304c70c admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:22.358963 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18494340-bb00-4528-957f-23762bcbcc95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:22.359719 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18494340-bb00-4528-957f-23762bcbcc95 admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:22.360111 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18494340-bb00-4528-957f-23762bcbcc95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:22.360457 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18494340-bb00-4528-957f-23762bcbcc95 admin admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:22.361185 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18494340-bb00-4528-957f-23762bcbcc95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:22.362791 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18494340-bb00-4528-957f-23762bcbcc95 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:22.374307 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 987/1974] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:16:22 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 30 07:16:22.374485 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-1ec353b6-8bdc-4ac1-bca7-37062affeb73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36b949ab7fb344b69d978b137fec134e'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:22.375310 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-1ec353b6-8bdc-4ac1-bca7-37062affeb73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36b949ab7fb344b69d978b137fec134e'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:22.378974 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18494340-bb00-4528-957f-23762bcbcc95 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:22.380640 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-18494340-bb00-4528-957f-23762bcbcc95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:22.387853 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-1ec353b6-8bdc-4ac1-bca7-37062affeb73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36b949ab7fb344b69d978b137fec134e'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:22.396155 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18494340-bb00-4528-957f-23762bcbcc95 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:22.401264 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66959995-b5aa-4833-a9bb-168baad7e4ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:22.402153 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66959995-b5aa-4833-a9bb-168baad7e4ab admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:22.402275 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66959995-b5aa-4833-a9bb-168baad7e4ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:22.402466 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66959995-b5aa-4833-a9bb-168baad7e4ab admin admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:22.403735 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66959995-b5aa-4833-a9bb-168baad7e4ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:22.405881 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66959995-b5aa-4833-a9bb-168baad7e4ab admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:22.408130 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-1ec353b6-8bdc-4ac1-bca7-37062affeb73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36b949ab7fb344b69d978b137fec134e'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:22.409067 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-1ec353b6-8bdc-4ac1-bca7-37062affeb73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36b949ab7fb344b69d978b137fec134e'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:22.417035 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 988/1975] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:16:22 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:16:22.421442 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66959995-b5aa-4833-a9bb-168baad7e4ab admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:22.421687 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 988/1976] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Mar 30 07:16:22 2022] DELETE /identity/v3/users/36b949ab7fb344b69d978b137fec134e => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:16:22.431459 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66959995-b5aa-4833-a9bb-168baad7e4ab admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:22.505347 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfe8942-e1a0-4e93-a9d0-fb270b5613bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:22.506985 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfe8942-e1a0-4e93-a9d0-fb270b5613bd admin admin] REQUEST_METHOD: `PUT` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:22.507390 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfe8942-e1a0-4e93-a9d0-fb270b5613bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:22.507743 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfe8942-e1a0-4e93-a9d0-fb270b5613bd admin admin] PATH_INFO: `/v3/projects/3c48a8adc1d14a1d813ad9755c7ff057/users/4a1956a5792b4f9c8b1a96e4994b1d34/roles/5d79031a64754b57ba120367465e2252` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:22.524028 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfe8942-e1a0-4e93-a9d0-fb270b5613bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c48a8adc1d14a1d813ad9755c7ff057, user_id=4a1956a5792b4f9c8b1a96e4994b1d34, role_id=5d79031a64754b57ba120367465e2252)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:22.527291 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfe8942-e1a0-4e93-a9d0-fb270b5613bd admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:22.543301 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 989/1977] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:16:22 2022] PUT /identity/v3/projects/3c48a8adc1d14a1d813ad9755c7ff057/users/4a1956a5792b4f9c8b1a96e4994b1d34/roles/5d79031a64754b57ba120367465e2252 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 07:16:22.553871 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350dd699-b95d-4bc2-b71d-9ba8cd1400bb None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:22.554874 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350dd699-b95d-4bc2-b71d-9ba8cd1400bb None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:22.555250 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350dd699-b95d-4bc2-b71d-9ba8cd1400bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:22.622645 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-350dd699-b95d-4bc2-b71d-9ba8cd1400bb None None] MFA Rules not processed for user `4a1956a5792b4f9c8b1a96e4994b1d34`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:16:22.624207 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-350dd699-b95d-4bc2-b71d-9ba8cd1400bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:22.707766 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 989/1978] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:16:22 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 07:16:22.721741 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfe8942-e1a0-4e93-a9d0-fb270b5613bd admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:22.723704 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-bbfe8942-e1a0-4e93-a9d0-fb270b5613bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:22.745348 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350dd699-b95d-4bc2-b71d-9ba8cd1400bb None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:22.747547 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-350dd699-b95d-4bc2-b71d-9ba8cd1400bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:22.806886 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfe8942-e1a0-4e93-a9d0-fb270b5613bd admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:22.811224 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ff1808-55aa-4e13-8b21-b93da4b741d6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e880ade912f3412abf44ba73939d6e50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:22.811947 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ff1808-55aa-4e13-8b21-b93da4b741d6 service glance] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:22.812229 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ff1808-55aa-4e13-8b21-b93da4b741d6 service glance] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:22.812902 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ff1808-55aa-4e13-8b21-b93da4b741d6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:22.822969 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ff1808-55aa-4e13-8b21-b93da4b741d6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:22.824563 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ff1808-55aa-4e13-8b21-b93da4b741d6 service glance] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:22.835511 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 990/1979] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:16:22 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:16:22.850070 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350dd699-b95d-4bc2-b71d-9ba8cd1400bb None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:22.855643 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d478c65f-d104-45a8-a478-312ffb2f8426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:22.857102 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478c65f-d104-45a8-a478-312ffb2f8426 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:22.857447 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478c65f-d104-45a8-a478-312ffb2f8426 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:22.857818 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478c65f-d104-45a8-a478-312ffb2f8426 admin admin] PATH_INFO: `/v3/projects/3feed9d8e2d842c6b67d2f4b780ce3e8` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:22.859258 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d478c65f-d104-45a8-a478-312ffb2f8426 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3feed9d8e2d842c6b67d2f4b780ce3e8)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:22.861452 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d478c65f-d104-45a8-a478-312ffb2f8426 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:22.934530 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ff1808-55aa-4e13-8b21-b93da4b741d6 service glance] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:22.936377 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-52ff1808-55aa-4e13-8b21-b93da4b741d6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:22.940963 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-d478c65f-d104-45a8-a478-312ffb2f8426 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3feed9d8e2d842c6b67d2f4b780ce3e8', 'request_id': 'req-d478c65f-d104-45a8-a478-312ffb2f8426'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:22.952666 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-d478c65f-d104-45a8-a478-312ffb2f8426 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3feed9d8e2d842c6b67d2f4b780ce3e8', 'request_id': 'req-d478c65f-d104-45a8-a478-312ffb2f8426'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:22.956783 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ff1808-55aa-4e13-8b21-b93da4b741d6 service glance] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:22.959201 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-d478c65f-d104-45a8-a478-312ffb2f8426 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3feed9d8e2d842c6b67d2f4b780ce3e8', 'request_id': 'req-d478c65f-d104-45a8-a478-312ffb2f8426'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:22.973455 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-d478c65f-d104-45a8-a478-312ffb2f8426 admin admin] The token cache is being invalidate because project 3feed9d8e2d842c6b67d2f4b780ce3e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79960) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 07:16:22.973971 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-d478c65f-d104-45a8-a478-312ffb2f8426 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:22.974830 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-d478c65f-d104-45a8-a478-312ffb2f8426 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:22.976951 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 990/1980] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Mar 30 07:16:22 2022] DELETE /identity/v3/projects/3feed9d8e2d842c6b67d2f4b780ce3e8 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:16:22.982534 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8da4f8-a10a-4440-a876-37c0328923fb None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:22.982822 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8da4f8-a10a-4440-a876-37c0328923fb None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:22.983149 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8da4f8-a10a-4440-a876-37c0328923fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:23.003331 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-3a8da4f8-a10a-4440-a876-37c0328923fb None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:16:23.004574 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-3a8da4f8-a10a-4440-a876-37c0328923fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:23.039204 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b92caf-887b-40d2-a5b6-45ab590e9b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:23.040461 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b92caf-887b-40d2-a5b6-45ab590e9b82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:23.041544 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b92caf-887b-40d2-a5b6-45ab590e9b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:23.041827 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b92caf-887b-40d2-a5b6-45ab590e9b82 admin admin] PATH_INFO: `/v3/users/6bf0b90cce7e447aa66083b12b7f4f32` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:23.043154 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b92caf-887b-40d2-a5b6-45ab590e9b82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bf0b90cce7e447aa66083b12b7f4f32)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:23.045220 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b92caf-887b-40d2-a5b6-45ab590e9b82 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:23.105637 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 991/1981] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:16:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:16:23.115913 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e53af0-9a9a-41a7-85b2-eac69fca9225 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:23.116766 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e53af0-9a9a-41a7-85b2-eac69fca9225 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:23.117468 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e53af0-9a9a-41a7-85b2-eac69fca9225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:23.136941 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-75b92caf-887b-40d2-a5b6-45ab590e9b82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bf0b90cce7e447aa66083b12b7f4f32'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:23.139045 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-75b92caf-887b-40d2-a5b6-45ab590e9b82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bf0b90cce7e447aa66083b12b7f4f32'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:23.140169 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-75b92caf-887b-40d2-a5b6-45ab590e9b82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bf0b90cce7e447aa66083b12b7f4f32'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:23.150089 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-83e53af0-9a9a-41a7-85b2-eac69fca9225 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:16:23.151359 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-83e53af0-9a9a-41a7-85b2-eac69fca9225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:23.151795 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-75b92caf-887b-40d2-a5b6-45ab590e9b82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bf0b90cce7e447aa66083b12b7f4f32'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:23.163137 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-75b92caf-887b-40d2-a5b6-45ab590e9b82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bf0b90cce7e447aa66083b12b7f4f32'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:23.167707 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 992/1982] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:16:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 07:16:23.172158 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e53af0-9a9a-41a7-85b2-eac69fca9225 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:23.183945 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 991/1983] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Mar 30 07:16:22 2022] DELETE /identity/v3/users/6bf0b90cce7e447aa66083b12b7f4f32 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:16:23.187494 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e53af0-9a9a-41a7-85b2-eac69fca9225 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:23.190103 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d859c-87b0-464b-a418-5ebaaede53f3 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:23.191142 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d859c-87b0-464b-a418-5ebaaede53f3 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:23.191432 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d859c-87b0-464b-a418-5ebaaede53f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:23.219766 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-ab5d859c-87b0-464b-a418-5ebaaede53f3 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:16:23.221022 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-ab5d859c-87b0-464b-a418-5ebaaede53f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:23.278471 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86315f1-d286-4ec8-8f90-41571b21f472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:23.279400 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86315f1-d286-4ec8-8f90-41571b21f472 admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:23.279686 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86315f1-d286-4ec8-8f90-41571b21f472 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:23.280004 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86315f1-d286-4ec8-8f90-41571b21f472 admin admin] PATH_INFO: `/v3/domains` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:23.280888 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86315f1-d286-4ec8-8f90-41571b21f472 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:16:23.281012 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86315f1-d286-4ec8-8f90-41571b21f472 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:23.282976 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86315f1-d286-4ec8-8f90-41571b21f472 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:23.297689 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 993/1984] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Mar 30 07:16:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:16:23.302211 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86315f1-d286-4ec8-8f90-41571b21f472 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:23.316386 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86315f1-d286-4ec8-8f90-41571b21f472 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:23.322998 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c29ecb8-7191-45e1-a4b9-9351e4acf2b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:23.323781 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c29ecb8-7191-45e1-a4b9-9351e4acf2b0 admin admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:23.324169 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c29ecb8-7191-45e1-a4b9-9351e4acf2b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:23.324605 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c29ecb8-7191-45e1-a4b9-9351e4acf2b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:23.325383 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c29ecb8-7191-45e1-a4b9-9351e4acf2b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:23.326164 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 992/1985] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:16:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:16:23.333892 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c29ecb8-7191-45e1-a4b9-9351e4acf2b0 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:23.336455 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5d859c-87b0-464b-a418-5ebaaede53f3 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:23.338512 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-ab5d859c-87b0-464b-a418-5ebaaede53f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:23.389088 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 994/1986] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Mar 30 07:16:23 2022] POST /identity/v3/projects => generated 365 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:16:23.393400 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c29ecb8-7191-45e1-a4b9-9351e4acf2b0 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:23.423685 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5d859c-87b0-464b-a418-5ebaaede53f3 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:23.505554 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9b9fa3-6018-4a49-81a4-ef21d929cb14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3802cb341445f994b9204744060ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:23.506461 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b9fa3-6018-4a49-81a4-ef21d929cb14 service neutron] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:23.507041 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b9fa3-6018-4a49-81a4-ef21d929cb14 service neutron] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:23.507351 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b9fa3-6018-4a49-81a4-ef21d929cb14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:23.525652 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c29ecb8-7191-45e1-a4b9-9351e4acf2b0 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:23.532715 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21a94bc-4bce-4b69-abaf-8ecd359babb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:23.533635 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21a94bc-4bce-4b69-abaf-8ecd359babb9 admin admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:23.534009 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21a94bc-4bce-4b69-abaf-8ecd359babb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:23.534508 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21a94bc-4bce-4b69-abaf-8ecd359babb9 admin admin] PATH_INFO: `/v3/users` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:23.535400 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21a94bc-4bce-4b69-abaf-8ecd359babb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:23.537975 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21a94bc-4bce-4b69-abaf-8ecd359babb9 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:23.580976 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 995/1987] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Mar 30 07:16:23 2022] POST /identity/v3/users => generated 283 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:16:23.582386 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21a94bc-4bce-4b69-abaf-8ecd359babb9 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:23.589396 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9b9fa3-6018-4a49-81a4-ef21d929cb14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:23.591337 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9b9fa3-6018-4a49-81a4-ef21d929cb14 service neutron] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:23.593374 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21a94bc-4bce-4b69-abaf-8ecd359babb9 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:23.602255 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6901a5-aa9d-4884-be64-45f58adc8d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:23.603137 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6901a5-aa9d-4884-be64-45f58adc8d35 admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:23.603411 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6901a5-aa9d-4884-be64-45f58adc8d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:23.604169 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6901a5-aa9d-4884-be64-45f58adc8d35 admin admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:23.604277 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 993/1988] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:16:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:16:23.605135 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6901a5-aa9d-4884-be64-45f58adc8d35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:23.608553 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6901a5-aa9d-4884-be64-45f58adc8d35 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:23.620422 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 996/1989] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:16:23 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:16:23.624895 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9b9fa3-6018-4a49-81a4-ef21d929cb14 service neutron] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:23.639060 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9b9fa3-6018-4a49-81a4-ef21d929cb14 service neutron] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:23.644346 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e39b916-956e-41f1-8be0-7ce6e001e5aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:23.645030 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e39b916-956e-41f1-8be0-7ce6e001e5aa admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:23.645313 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e39b916-956e-41f1-8be0-7ce6e001e5aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:23.645584 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e39b916-956e-41f1-8be0-7ce6e001e5aa admin admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:23.646310 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e39b916-956e-41f1-8be0-7ce6e001e5aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:23.648413 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e39b916-956e-41f1-8be0-7ce6e001e5aa admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:23.670062 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 994/1990] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:16:23 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 30 07:16:23.671631 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6901a5-aa9d-4884-be64-45f58adc8d35 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:23.695327 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6901a5-aa9d-4884-be64-45f58adc8d35 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:23.707544 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d504fe7-fde9-47f6-932a-3aa4ccf15537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:23.709211 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d504fe7-fde9-47f6-932a-3aa4ccf15537 admin admin] REQUEST_METHOD: `PUT` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:23.710541 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d504fe7-fde9-47f6-932a-3aa4ccf15537 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:23.710900 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d504fe7-fde9-47f6-932a-3aa4ccf15537 admin admin] PATH_INFO: `/v3/projects/bbba384d41ad40118acb831060e4f0e4/users/73c0eb8828324dec83bf37e541444fb2/roles/5d79031a64754b57ba120367465e2252` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:23.753146 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d504fe7-fde9-47f6-932a-3aa4ccf15537 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbba384d41ad40118acb831060e4f0e4, user_id=73c0eb8828324dec83bf37e541444fb2, role_id=5d79031a64754b57ba120367465e2252)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:23.755833 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d504fe7-fde9-47f6-932a-3aa4ccf15537 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:23.776158 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 997/1991] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:16:23 2022] PUT /identity/v3/projects/bbba384d41ad40118acb831060e4f0e4/users/73c0eb8828324dec83bf37e541444fb2/roles/5d79031a64754b57ba120367465e2252 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 07:16:23.791846 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c295a0a4-29d3-41b2-b665-68d569b52972 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:23.792365 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c295a0a4-29d3-41b2-b665-68d569b52972 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:23.792855 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c295a0a4-29d3-41b2-b665-68d569b52972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:23.838033 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-c295a0a4-29d3-41b2-b665-68d569b52972 None None] MFA Rules not processed for user `73c0eb8828324dec83bf37e541444fb2`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:16:23.838316 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-c295a0a4-29d3-41b2-b665-68d569b52972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:23.984196 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 995/1992] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:16:23 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:16:23.990178 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d504fe7-fde9-47f6-932a-3aa4ccf15537 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:24.067191 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c295a0a4-29d3-41b2-b665-68d569b52972 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:24.070230 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-c295a0a4-29d3-41b2-b665-68d569b52972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:24.107374 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d504fe7-fde9-47f6-932a-3aa4ccf15537 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:24.135797 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c295a0a4-29d3-41b2-b665-68d569b52972 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:24.138019 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9ba179-cdda-408f-8884-b2e95b6ede6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:24.138720 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9ba179-cdda-408f-8884-b2e95b6ede6e admin admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:24.139018 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9ba179-cdda-408f-8884-b2e95b6ede6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:24.139384 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9ba179-cdda-408f-8884-b2e95b6ede6e admin admin] PATH_INFO: `/v3/projects` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:24.140218 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9ba179-cdda-408f-8884-b2e95b6ede6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:24.142705 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9ba179-cdda-408f-8884-b2e95b6ede6e admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:24.145026 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25944410-f3db-4f98-a7f6-dd193482b551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:24.146507 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25944410-f3db-4f98-a7f6-dd193482b551 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:24.152399 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25944410-f3db-4f98-a7f6-dd193482b551 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:24.158027 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25944410-f3db-4f98-a7f6-dd193482b551 admin admin] PATH_INFO: `/v3/projects/54cfcac585b249b0b8c79666a7a6b74a` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:24.163014 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25944410-f3db-4f98-a7f6-dd193482b551 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54cfcac585b249b0b8c79666a7a6b74a)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:24.166328 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25944410-f3db-4f98-a7f6-dd193482b551 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:24.179376 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 998/1993] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Mar 30 07:16:23 2022] POST /identity/v3/projects => generated 363 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:16:24.202367 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9ba179-cdda-408f-8884-b2e95b6ede6e admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:24.286458 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-25944410-f3db-4f98-a7f6-dd193482b551 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54cfcac585b249b0b8c79666a7a6b74a', 'request_id': 'req-25944410-f3db-4f98-a7f6-dd193482b551'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:24.304181 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-25944410-f3db-4f98-a7f6-dd193482b551 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54cfcac585b249b0b8c79666a7a6b74a', 'request_id': 'req-25944410-f3db-4f98-a7f6-dd193482b551'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:24.316650 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-25944410-f3db-4f98-a7f6-dd193482b551 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54cfcac585b249b0b8c79666a7a6b74a', 'request_id': 'req-25944410-f3db-4f98-a7f6-dd193482b551'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:24.341574 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-25944410-f3db-4f98-a7f6-dd193482b551 admin admin] The token cache is being invalidate because project 54cfcac585b249b0b8c79666a7a6b74a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79961) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 07:16:24.342844 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-25944410-f3db-4f98-a7f6-dd193482b551 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:24.344955 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-25944410-f3db-4f98-a7f6-dd193482b551 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:24.351218 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9ba179-cdda-408f-8884-b2e95b6ede6e admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:24.352327 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 996/1994] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Mar 30 07:16:24 2022] DELETE /identity/v3/projects/54cfcac585b249b0b8c79666a7a6b74a => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:16:24.354679 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddcff25-b249-418b-9398-a1f107435e0d None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:24.355175 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddcff25-b249-418b-9398-a1f107435e0d None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:24.355454 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddcff25-b249-418b-9398-a1f107435e0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:24.381679 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-6ddcff25-b249-418b-9398-a1f107435e0d None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:16:24.382119 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-6ddcff25-b249-418b-9398-a1f107435e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:24.446475 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e65060-df2f-45d7-98bf-bd7320648fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:24.447778 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e65060-df2f-45d7-98bf-bd7320648fc0 admin admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:24.451521 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e65060-df2f-45d7-98bf-bd7320648fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:24.451916 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e65060-df2f-45d7-98bf-bd7320648fc0 admin admin] PATH_INFO: `/v3/users` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:24.452701 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e65060-df2f-45d7-98bf-bd7320648fc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:24.454743 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e65060-df2f-45d7-98bf-bd7320648fc0 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:24.497131 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 999/1995] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Mar 30 07:16:24 2022] POST /identity/v3/users => generated 288 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 07:16:24.501005 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e65060-df2f-45d7-98bf-bd7320648fc0 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:24.502979 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-62e65060-df2f-45d7-98bf-bd7320648fc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:24.516341 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 997/1996] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:16:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:16:24.525568 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360a3009-0e5a-4206-9bae-1555d80cb9eb None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:24.525919 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360a3009-0e5a-4206-9bae-1555d80cb9eb None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:24.526291 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360a3009-0e5a-4206-9bae-1555d80cb9eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:24.534249 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e65060-df2f-45d7-98bf-bd7320648fc0 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:24.542813 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e60ecf5-a7c5-40c6-a828-bcd00a180a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:24.543912 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e60ecf5-a7c5-40c6-a828-bcd00a180a42 admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:24.544081 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e60ecf5-a7c5-40c6-a828-bcd00a180a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:24.544447 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e60ecf5-a7c5-40c6-a828-bcd00a180a42 admin admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:24.545187 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e60ecf5-a7c5-40c6-a828-bcd00a180a42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:24.552505 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-360a3009-0e5a-4206-9bae-1555d80cb9eb None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:16:24.557614 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e60ecf5-a7c5-40c6-a828-bcd00a180a42 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:24.557885 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-360a3009-0e5a-4206-9bae-1555d80cb9eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:24.577268 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 998/1997] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:16:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:16:24.584940 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1000/1998] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:16:24 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 30 07:16:24.586490 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360a3009-0e5a-4206-9bae-1555d80cb9eb None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:24.593469 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e60ecf5-a7c5-40c6-a828-bcd00a180a42 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:24.599128 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360a3009-0e5a-4206-9bae-1555d80cb9eb None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:24.604509 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afefaab-371a-4a1e-8d5e-d5702d30dd72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:24.605803 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afefaab-371a-4a1e-8d5e-d5702d30dd72 admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:24.606817 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afefaab-371a-4a1e-8d5e-d5702d30dd72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:24.607317 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afefaab-371a-4a1e-8d5e-d5702d30dd72 admin admin] PATH_INFO: `/v3/domains` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:24.609171 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afefaab-371a-4a1e-8d5e-d5702d30dd72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:16:24.609650 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afefaab-371a-4a1e-8d5e-d5702d30dd72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:24.611483 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afefaab-371a-4a1e-8d5e-d5702d30dd72 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:24.617630 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e60ecf5-a7c5-40c6-a828-bcd00a180a42 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:24.626709 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 999/1999] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Mar 30 07:16:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:16:24.633003 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afefaab-371a-4a1e-8d5e-d5702d30dd72 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:24.641980 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070a626e-386a-4840-8f8f-76d3efdbc1f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:24.644089 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070a626e-386a-4840-8f8f-76d3efdbc1f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:24.644447 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070a626e-386a-4840-8f8f-76d3efdbc1f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:24.644713 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070a626e-386a-4840-8f8f-76d3efdbc1f4 admin admin] PATH_INFO: `/v3/projects/8bb9a5f7b9104c35bc11bd3beed69839/users/f9fd57a305d944d28023a02f254585c5/roles/1c39b9ab8cfd4c0ea71845831920a845` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:24.669357 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afefaab-371a-4a1e-8d5e-d5702d30dd72 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:24.683331 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c398d1-020e-4b4f-a51c-f79ad57dc244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:24.684220 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c398d1-020e-4b4f-a51c-f79ad57dc244 admin admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:24.684415 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070a626e-386a-4840-8f8f-76d3efdbc1f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bb9a5f7b9104c35bc11bd3beed69839, user_id=f9fd57a305d944d28023a02f254585c5, role_id=1c39b9ab8cfd4c0ea71845831920a845)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:24.684573 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c398d1-020e-4b4f-a51c-f79ad57dc244 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:24.684977 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c398d1-020e-4b4f-a51c-f79ad57dc244 admin admin] PATH_INFO: `/v3/projects` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:24.685467 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c398d1-020e-4b4f-a51c-f79ad57dc244 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:24.690377 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c398d1-020e-4b4f-a51c-f79ad57dc244 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:24.694788 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070a626e-386a-4840-8f8f-76d3efdbc1f4 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:24.713330 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1001/2000] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:16:24 2022] PUT /identity/v3/projects/8bb9a5f7b9104c35bc11bd3beed69839/users/f9fd57a305d944d28023a02f254585c5/roles/1c39b9ab8cfd4c0ea71845831920a845 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:16:24.720727 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070a626e-386a-4840-8f8f-76d3efdbc1f4 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:24.753967 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1000/2001] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Mar 30 07:16:24 2022] POST /identity/v3/projects => generated 361 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:16:24.755109 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c398d1-020e-4b4f-a51c-f79ad57dc244 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:24.859021 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070a626e-386a-4840-8f8f-76d3efdbc1f4 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:24.865790 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c398d1-020e-4b4f-a51c-f79ad57dc244 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:24.868116 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f5eedf-6ccd-4801-9ee8-18aab04cf3f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:24.870117 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f5eedf-6ccd-4801-9ee8-18aab04cf3f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:24.870404 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f5eedf-6ccd-4801-9ee8-18aab04cf3f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:24.870679 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f5eedf-6ccd-4801-9ee8-18aab04cf3f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:24.871452 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a61550-532d-4551-bd07-357cd621cbfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:24.871608 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f5eedf-6ccd-4801-9ee8-18aab04cf3f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:24.872376 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a61550-532d-4551-bd07-357cd621cbfa admin admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:24.872752 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a61550-532d-4551-bd07-357cd621cbfa admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:24.873122 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a61550-532d-4551-bd07-357cd621cbfa admin admin] PATH_INFO: `/v3/users` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:24.873827 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f5eedf-6ccd-4801-9ee8-18aab04cf3f8 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:24.874004 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a61550-532d-4551-bd07-357cd621cbfa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:24.879018 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a61550-532d-4551-bd07-357cd621cbfa admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:24.902231 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1002/2002] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:16:24 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 30 07:16:24.915902 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1001/2003] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Mar 30 07:16:24 2022] POST /identity/v3/users => generated 281 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 07:16:24.917292 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f5eedf-6ccd-4801-9ee8-18aab04cf3f8 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:24.919456 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a61550-532d-4551-bd07-357cd621cbfa admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:24.930482 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f5eedf-6ccd-4801-9ee8-18aab04cf3f8 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:24.934681 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a61550-532d-4551-bd07-357cd621cbfa admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:24.938294 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f625a3-1937-4bc3-bf09-b57b7454cd9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:24.939357 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f625a3-1937-4bc3-bf09-b57b7454cd9f admin admin] REQUEST_METHOD: `PUT` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:24.939639 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f625a3-1937-4bc3-bf09-b57b7454cd9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:24.939945 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f625a3-1937-4bc3-bf09-b57b7454cd9f admin admin] PATH_INFO: `/v3/projects/8bb9a5f7b9104c35bc11bd3beed69839/users/f9fd57a305d944d28023a02f254585c5/roles/1c39b9ab8cfd4c0ea71845831920a845` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:24.941662 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ffd820-c242-43af-9299-619d965b8b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:24.942223 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f625a3-1937-4bc3-bf09-b57b7454cd9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bb9a5f7b9104c35bc11bd3beed69839, user_id=f9fd57a305d944d28023a02f254585c5, role_id=1c39b9ab8cfd4c0ea71845831920a845)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:24.943367 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ffd820-c242-43af-9299-619d965b8b4d admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:24.944025 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ffd820-c242-43af-9299-619d965b8b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:24.944526 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ffd820-c242-43af-9299-619d965b8b4d admin admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:24.945452 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f625a3-1937-4bc3-bf09-b57b7454cd9f admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:24.945617 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ffd820-c242-43af-9299-619d965b8b4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:24.947304 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ffd820-c242-43af-9299-619d965b8b4d admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:24.964690 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1003/2004] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:16:24 2022] PUT /identity/v3/projects/8bb9a5f7b9104c35bc11bd3beed69839/users/f9fd57a305d944d28023a02f254585c5/roles/1c39b9ab8cfd4c0ea71845831920a845 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:16:24.964896 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1002/2005] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:16:24 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:16:24.968846 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f625a3-1937-4bc3-bf09-b57b7454cd9f admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:24.970313 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1cead9-c40b-4beb-b894-6dc1df00d121 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:24.970605 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1cead9-c40b-4beb-b894-6dc1df00d121 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:24.970911 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1cead9-c40b-4beb-b894-6dc1df00d121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:25.030389 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-7f1cead9-c40b-4beb-b894-6dc1df00d121 None None] MFA Rules not processed for user `f9fd57a305d944d28023a02f254585c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:16:25.031786 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-7f1cead9-c40b-4beb-b894-6dc1df00d121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:25.113560 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f625a3-1937-4bc3-bf09-b57b7454cd9f admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:25.132537 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cef653-2f43-4509-a399-04cc0c91f0f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:25.133229 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cef653-2f43-4509-a399-04cc0c91f0f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:25.133511 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cef653-2f43-4509-a399-04cc0c91f0f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:25.134016 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cef653-2f43-4509-a399-04cc0c91f0f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:25.134589 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cef653-2f43-4509-a399-04cc0c91f0f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:25.136702 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cef653-2f43-4509-a399-04cc0c91f0f9 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:25.154981 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1004/2006] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:16:24 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:16:25.158917 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cef653-2f43-4509-a399-04cc0c91f0f9 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:25.186544 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1003/2007] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:16:24 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 07:16:25.194564 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cef653-2f43-4509-a399-04cc0c91f0f9 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:25.198986 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1cead9-c40b-4beb-b894-6dc1df00d121 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:25.200262 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af3fc1e-0c80-4327-bf22-4329ea74bff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:25.200929 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-7f1cead9-c40b-4beb-b894-6dc1df00d121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:25.201359 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af3fc1e-0c80-4327-bf22-4329ea74bff6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:25.201640 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af3fc1e-0c80-4327-bf22-4329ea74bff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:25.201916 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af3fc1e-0c80-4327-bf22-4329ea74bff6 admin admin] PATH_INFO: `/v3/projects/6d42052b15b643b8bfc7c2aa5af4847a/users/6f31f9eff6bc4549a93c4790fc04e9dc/roles/5d79031a64754b57ba120367465e2252` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:25.234598 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af3fc1e-0c80-4327-bf22-4329ea74bff6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d42052b15b643b8bfc7c2aa5af4847a, user_id=6f31f9eff6bc4549a93c4790fc04e9dc, role_id=5d79031a64754b57ba120367465e2252)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:25.237643 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af3fc1e-0c80-4327-bf22-4329ea74bff6 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:25.278143 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1005/2008] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:16:25 2022] PUT /identity/v3/projects/6d42052b15b643b8bfc7c2aa5af4847a/users/6f31f9eff6bc4549a93c4790fc04e9dc/roles/5d79031a64754b57ba120367465e2252 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:16:25.280365 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6585be28-0fcf-4be7-a356-8d48c70eedb7 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:25.280828 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6585be28-0fcf-4be7-a356-8d48c70eedb7 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:25.281265 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6585be28-0fcf-4be7-a356-8d48c70eedb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:25.325138 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1cead9-c40b-4beb-b894-6dc1df00d121 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:25.326353 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-6585be28-0fcf-4be7-a356-8d48c70eedb7 None None] MFA Rules not processed for user `6f31f9eff6bc4549a93c4790fc04e9dc`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:16:25.328429 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-6585be28-0fcf-4be7-a356-8d48c70eedb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:25.428219 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abebd3a9-9b76-4f3d-b022-0bf76f519755 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e2fda180e8d448d895c40cdad34bc4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:25.429224 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abebd3a9-9b76-4f3d-b022-0bf76f519755 service cinder] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:25.429651 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abebd3a9-9b76-4f3d-b022-0bf76f519755 service cinder] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:25.430080 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abebd3a9-9b76-4f3d-b022-0bf76f519755 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:25.448107 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1006/2009] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:16:25 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 07:16:25.490726 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6585be28-0fcf-4be7-a356-8d48c70eedb7 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:25.492365 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-6585be28-0fcf-4be7-a356-8d48c70eedb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:25.512928 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6585be28-0fcf-4be7-a356-8d48c70eedb7 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:25.519448 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cceec2c-608a-4ff4-be15-8877b9e4a1ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e2fda180e8d448d895c40cdad34bc4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:25.520253 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cceec2c-608a-4ff4-be15-8877b9e4a1ba service cinder] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:25.520600 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cceec2c-608a-4ff4-be15-8877b9e4a1ba service cinder] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:25.520949 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cceec2c-608a-4ff4-be15-8877b9e4a1ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:25.535263 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cceec2c-608a-4ff4-be15-8877b9e4a1ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:25.536871 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cceec2c-608a-4ff4-be15-8877b9e4a1ba service cinder] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:25.568024 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1007/2010] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:16:25 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:16:25.569971 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cceec2c-608a-4ff4-be15-8877b9e4a1ba service cinder] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:25.594791 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abebd3a9-9b76-4f3d-b022-0bf76f519755 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:25.596554 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abebd3a9-9b76-4f3d-b022-0bf76f519755 service cinder] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:25.622225 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1004/2011] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:16:25 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 30 07:16:25.738687 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abebd3a9-9b76-4f3d-b022-0bf76f519755 service cinder] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:25.767087 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abebd3a9-9b76-4f3d-b022-0bf76f519755 service cinder] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:25.770267 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cceec2c-608a-4ff4-be15-8877b9e4a1ba service cinder] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:25.775328 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88427f65-61a8-477c-86f7-4df128b28a83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e2fda180e8d448d895c40cdad34bc4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:25.776042 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88427f65-61a8-477c-86f7-4df128b28a83 service cinder] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:25.777902 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88427f65-61a8-477c-86f7-4df128b28a83 service cinder] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:25.778212 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88427f65-61a8-477c-86f7-4df128b28a83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:25.780883 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3343c5-0fed-4d93-9fd7-21648e07b601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:25.781786 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3343c5-0fed-4d93-9fd7-21648e07b601 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:25.782064 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3343c5-0fed-4d93-9fd7-21648e07b601 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:25.783605 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-88427f65-61a8-477c-86f7-4df128b28a83 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:25.784733 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3343c5-0fed-4d93-9fd7-21648e07b601 admin admin] PATH_INFO: `/v3/users/6f31f9eff6bc4549a93c4790fc04e9dc` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:25.787800 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3343c5-0fed-4d93-9fd7-21648e07b601 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f31f9eff6bc4549a93c4790fc04e9dc)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:25.790931 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3343c5-0fed-4d93-9fd7-21648e07b601 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:25.910401 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88427f65-61a8-477c-86f7-4df128b28a83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:25.912370 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88427f65-61a8-477c-86f7-4df128b28a83 service cinder] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:25.922757 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-0e3343c5-0fed-4d93-9fd7-21648e07b601 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f31f9eff6bc4549a93c4790fc04e9dc'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:25.925119 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-0e3343c5-0fed-4d93-9fd7-21648e07b601 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f31f9eff6bc4549a93c4790fc04e9dc'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:25.957482 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-0e3343c5-0fed-4d93-9fd7-21648e07b601 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f31f9eff6bc4549a93c4790fc04e9dc'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:25.960098 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1005/2012] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:16:25 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:16:25.998744 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-0e3343c5-0fed-4d93-9fd7-21648e07b601 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f31f9eff6bc4549a93c4790fc04e9dc'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:25.999499 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-0e3343c5-0fed-4d93-9fd7-21648e07b601 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f31f9eff6bc4549a93c4790fc04e9dc'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:26.013335 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1008/2013] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Mar 30 07:16:25 2022] DELETE /identity/v3/users/6f31f9eff6bc4549a93c4790fc04e9dc => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:16:26.018129 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1376eb-d9b6-496f-ba0d-6d1a73200108 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:26.018491 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1376eb-d9b6-496f-ba0d-6d1a73200108 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:26.019166 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1376eb-d9b6-496f-ba0d-6d1a73200108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:26.040579 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-5f1376eb-d9b6-496f-ba0d-6d1a73200108 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:16:26.042227 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-5f1376eb-d9b6-496f-ba0d-6d1a73200108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:26.135265 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1006/2014] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:16:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:16:26.149083 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3343c5-0fed-4d93-9fd7-21648e07b601 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:26.151126 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-0e3343c5-0fed-4d93-9fd7-21648e07b601 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:26.229575 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3343c5-0fed-4d93-9fd7-21648e07b601 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:26.234466 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad77d29-1607-4db4-a869-b1916acd0520 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3802cb341445f994b9204744060ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:26.235139 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad77d29-1607-4db4-a869-b1916acd0520 service neutron] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:26.235696 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad77d29-1607-4db4-a869-b1916acd0520 service neutron] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:26.236050 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad77d29-1607-4db4-a869-b1916acd0520 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:26.247755 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad77d29-1607-4db4-a869-b1916acd0520 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:26.249395 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad77d29-1607-4db4-a869-b1916acd0520 service neutron] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:26.262082 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1009/2015] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:16:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:16:26.578835 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1376eb-d9b6-496f-ba0d-6d1a73200108 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:26.581181 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-5f1376eb-d9b6-496f-ba0d-6d1a73200108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:26.597673 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1376eb-d9b6-496f-ba0d-6d1a73200108 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:26.603316 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0d6e5f-d9cd-4dd8-83f7-f28b3e5f332d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:26.604340 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0d6e5f-d9cd-4dd8-83f7-f28b3e5f332d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:26.604525 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0d6e5f-d9cd-4dd8-83f7-f28b3e5f332d admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:26.604802 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0d6e5f-d9cd-4dd8-83f7-f28b3e5f332d admin admin] PATH_INFO: `/v3/projects/6d42052b15b643b8bfc7c2aa5af4847a` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:26.607559 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0d6e5f-d9cd-4dd8-83f7-f28b3e5f332d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d42052b15b643b8bfc7c2aa5af4847a)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:26.609769 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0d6e5f-d9cd-4dd8-83f7-f28b3e5f332d admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:26.690578 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-9b0d6e5f-d9cd-4dd8-83f7-f28b3e5f332d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d42052b15b643b8bfc7c2aa5af4847a', 'request_id': 'req-9b0d6e5f-d9cd-4dd8-83f7-f28b3e5f332d'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:26.697357 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-9b0d6e5f-d9cd-4dd8-83f7-f28b3e5f332d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d42052b15b643b8bfc7c2aa5af4847a', 'request_id': 'req-9b0d6e5f-d9cd-4dd8-83f7-f28b3e5f332d'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:26.711133 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-9b0d6e5f-d9cd-4dd8-83f7-f28b3e5f332d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d42052b15b643b8bfc7c2aa5af4847a', 'request_id': 'req-9b0d6e5f-d9cd-4dd8-83f7-f28b3e5f332d'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:26.733308 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-9b0d6e5f-d9cd-4dd8-83f7-f28b3e5f332d admin admin] The token cache is being invalidate because project 6d42052b15b643b8bfc7c2aa5af4847a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79961) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 07:16:26.733608 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-9b0d6e5f-d9cd-4dd8-83f7-f28b3e5f332d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:26.734269 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-9b0d6e5f-d9cd-4dd8-83f7-f28b3e5f332d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:26.736285 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1007/2016] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Mar 30 07:16:26 2022] DELETE /identity/v3/projects/6d42052b15b643b8bfc7c2aa5af4847a => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:16:26.741665 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0946f9ed-18cb-494e-9a1b-8e7fce75468e None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:26.742042 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0946f9ed-18cb-494e-9a1b-8e7fce75468e None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:26.742389 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0946f9ed-18cb-494e-9a1b-8e7fce75468e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:26.761505 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-0946f9ed-18cb-494e-9a1b-8e7fce75468e None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:16:26.763291 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-0946f9ed-18cb-494e-9a1b-8e7fce75468e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:26.829445 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1010/2017] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:16:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 07:16:26.838073 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ccdb33-77a1-428d-892a-0b41fcff2bff None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:26.838517 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ccdb33-77a1-428d-892a-0b41fcff2bff None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:26.838891 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ccdb33-77a1-428d-892a-0b41fcff2bff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:26.863514 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-18ccdb33-77a1-428d-892a-0b41fcff2bff None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:16:26.864891 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-18ccdb33-77a1-428d-892a-0b41fcff2bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:26.874174 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1008/2018] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:16:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:16:26.878298 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0946f9ed-18cb-494e-9a1b-8e7fce75468e None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:26.888991 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0946f9ed-18cb-494e-9a1b-8e7fce75468e None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:26.894520 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34b4006-bc22-4c99-87cc-69cadcbe70dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:26.895360 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34b4006-bc22-4c99-87cc-69cadcbe70dc admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:26.895756 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34b4006-bc22-4c99-87cc-69cadcbe70dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:26.896162 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34b4006-bc22-4c99-87cc-69cadcbe70dc admin admin] PATH_INFO: `/v3/domains` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:26.896999 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34b4006-bc22-4c99-87cc-69cadcbe70dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:16:26.897400 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34b4006-bc22-4c99-87cc-69cadcbe70dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:26.899125 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34b4006-bc22-4c99-87cc-69cadcbe70dc admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:26.918693 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1011/2019] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Mar 30 07:16:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:16:26.923270 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ccdb33-77a1-428d-892a-0b41fcff2bff None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:26.936757 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ccdb33-77a1-428d-892a-0b41fcff2bff None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:26.941891 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b699c0b1-748a-4874-9e83-2fccd82e5bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:26.942564 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b699c0b1-748a-4874-9e83-2fccd82e5bc5 admin admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:26.944648 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b699c0b1-748a-4874-9e83-2fccd82e5bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:26.944929 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b699c0b1-748a-4874-9e83-2fccd82e5bc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:26.945665 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b699c0b1-748a-4874-9e83-2fccd82e5bc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:26.947755 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b699c0b1-748a-4874-9e83-2fccd82e5bc5 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:27.018884 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1009/2020] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Mar 30 07:16:26 2022] POST /identity/v3/projects => generated 377 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 07:16:27.020092 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34b4006-bc22-4c99-87cc-69cadcbe70dc admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:27.031789 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34b4006-bc22-4c99-87cc-69cadcbe70dc admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:27.112957 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ddb969-1830-4b2f-9a4f-c27756917a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:27.114361 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ddb969-1830-4b2f-9a4f-c27756917a9c admin admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:27.114756 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ddb969-1830-4b2f-9a4f-c27756917a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:27.115077 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ddb969-1830-4b2f-9a4f-c27756917a9c admin admin] PATH_INFO: `/v3/users` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:27.115871 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ddb969-1830-4b2f-9a4f-c27756917a9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:27.117926 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ddb969-1830-4b2f-9a4f-c27756917a9c admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:27.159342 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1012/2021] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Mar 30 07:16:27 2022] POST /identity/v3/users => generated 289 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:16:27.159978 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b699c0b1-748a-4874-9e83-2fccd82e5bc5 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:27.172745 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b699c0b1-748a-4874-9e83-2fccd82e5bc5 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:27.180451 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e36d7b-7c9f-4798-9178-8dc085aca954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:27.185435 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e36d7b-7c9f-4798-9178-8dc085aca954 admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:27.185808 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e36d7b-7c9f-4798-9178-8dc085aca954 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:27.186156 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e36d7b-7c9f-4798-9178-8dc085aca954 admin admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:27.188486 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e36d7b-7c9f-4798-9178-8dc085aca954 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:27.190612 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e36d7b-7c9f-4798-9178-8dc085aca954 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:27.205678 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1010/2022] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:16:27 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 30 07:16:27.209471 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ddb969-1830-4b2f-9a4f-c27756917a9c admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:27.223892 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ddb969-1830-4b2f-9a4f-c27756917a9c admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:27.232786 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685f2063-a8b3-422e-8694-dfdb26f68059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:27.234347 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685f2063-a8b3-422e-8694-dfdb26f68059 admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:27.234743 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685f2063-a8b3-422e-8694-dfdb26f68059 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:27.235126 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685f2063-a8b3-422e-8694-dfdb26f68059 admin admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:27.236322 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685f2063-a8b3-422e-8694-dfdb26f68059 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:27.238189 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685f2063-a8b3-422e-8694-dfdb26f68059 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:27.254143 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1013/2023] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:16:27 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:16:27.261652 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e36d7b-7c9f-4798-9178-8dc085aca954 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:27.274423 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e36d7b-7c9f-4798-9178-8dc085aca954 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:27.280057 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d81428-812e-46b0-b51c-01219fa1051b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:27.280822 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d81428-812e-46b0-b51c-01219fa1051b admin admin] REQUEST_METHOD: `PUT` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:27.281095 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d81428-812e-46b0-b51c-01219fa1051b admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:27.281371 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d81428-812e-46b0-b51c-01219fa1051b admin admin] PATH_INFO: `/v3/projects/1c28253ccc5f4943a2071b9da75abedc/users/21125a38c0cc4eedbdb6d68c386a259e/roles/5d79031a64754b57ba120367465e2252` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:27.302944 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d81428-812e-46b0-b51c-01219fa1051b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c28253ccc5f4943a2071b9da75abedc, user_id=21125a38c0cc4eedbdb6d68c386a259e, role_id=5d79031a64754b57ba120367465e2252)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:27.306154 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d81428-812e-46b0-b51c-01219fa1051b admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:27.326054 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1011/2024] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:16:27 2022] PUT /identity/v3/projects/1c28253ccc5f4943a2071b9da75abedc/users/21125a38c0cc4eedbdb6d68c386a259e/roles/5d79031a64754b57ba120367465e2252 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:16:27.338092 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ca3504-ddbc-444d-adba-bfc607f938ef None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:27.338387 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ca3504-ddbc-444d-adba-bfc607f938ef None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:27.338658 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ca3504-ddbc-444d-adba-bfc607f938ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:27.369665 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-e0ca3504-ddbc-444d-adba-bfc607f938ef None None] MFA Rules not processed for user `21125a38c0cc4eedbdb6d68c386a259e`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:16:27.371080 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-e0ca3504-ddbc-444d-adba-bfc607f938ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:27.479946 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1014/2025] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:16:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:16:27.490765 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d81428-812e-46b0-b51c-01219fa1051b admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:27.492561 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-00d81428-812e-46b0-b51c-01219fa1051b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:27.569485 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d81428-812e-46b0-b51c-01219fa1051b admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:27.573402 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6426f0d0-97e9-497b-8a6d-ae209e338420 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e2fda180e8d448d895c40cdad34bc4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:27.574067 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6426f0d0-97e9-497b-8a6d-ae209e338420 service cinder] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:27.574386 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6426f0d0-97e9-497b-8a6d-ae209e338420 service cinder] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:27.574743 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6426f0d0-97e9-497b-8a6d-ae209e338420 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:27.584036 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6426f0d0-97e9-497b-8a6d-ae209e338420 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:27.585507 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6426f0d0-97e9-497b-8a6d-ae209e338420 service cinder] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:27.598102 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1012/2026] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:16:27 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:16:44.038917 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ca3504-ddbc-444d-adba-bfc607f938ef None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:44.040307 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-e0ca3504-ddbc-444d-adba-bfc607f938ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:44.108159 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ca3504-ddbc-444d-adba-bfc607f938ef None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:44.113963 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21b2bf5-9082-405d-80aa-b04a1af1d172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:44.115041 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21b2bf5-9082-405d-80aa-b04a1af1d172 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:44.115396 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21b2bf5-9082-405d-80aa-b04a1af1d172 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:44.115713 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21b2bf5-9082-405d-80aa-b04a1af1d172 admin admin] PATH_INFO: `/v3/users/73c0eb8828324dec83bf37e541444fb2` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:44.117408 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21b2bf5-9082-405d-80aa-b04a1af1d172 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73c0eb8828324dec83bf37e541444fb2)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:44.119634 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21b2bf5-9082-405d-80aa-b04a1af1d172 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:44.185029 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-e21b2bf5-9082-405d-80aa-b04a1af1d172 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73c0eb8828324dec83bf37e541444fb2'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:44.187428 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-e21b2bf5-9082-405d-80aa-b04a1af1d172 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73c0eb8828324dec83bf37e541444fb2'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:44.199376 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-e21b2bf5-9082-405d-80aa-b04a1af1d172 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73c0eb8828324dec83bf37e541444fb2'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:44.213127 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-e21b2bf5-9082-405d-80aa-b04a1af1d172 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73c0eb8828324dec83bf37e541444fb2'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:44.213971 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-e21b2bf5-9082-405d-80aa-b04a1af1d172 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73c0eb8828324dec83bf37e541444fb2'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:44.227722 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1015/2027] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Mar 30 07:16:44 2022] DELETE /identity/v3/users/73c0eb8828324dec83bf37e541444fb2 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:16:44.232845 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea28f83f-c1cf-4397-898f-97578d138ff0 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:44.233344 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea28f83f-c1cf-4397-898f-97578d138ff0 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:44.233430 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea28f83f-c1cf-4397-898f-97578d138ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:44.251111 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-ea28f83f-c1cf-4397-898f-97578d138ff0 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:16:44.252540 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-ea28f83f-c1cf-4397-898f-97578d138ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:44.313070 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1013/2028] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:16:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:16:44.325572 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21b2bf5-9082-405d-80aa-b04a1af1d172 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:44.327431 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-e21b2bf5-9082-405d-80aa-b04a1af1d172 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:44.388867 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21b2bf5-9082-405d-80aa-b04a1af1d172 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:44.392817 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d61285-eb2f-4f8b-8dff-06217d5ada7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3802cb341445f994b9204744060ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:44.393480 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d61285-eb2f-4f8b-8dff-06217d5ada7a service neutron] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:44.393764 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d61285-eb2f-4f8b-8dff-06217d5ada7a service neutron] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:44.394040 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d61285-eb2f-4f8b-8dff-06217d5ada7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:44.403342 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d61285-eb2f-4f8b-8dff-06217d5ada7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:44.404936 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d61285-eb2f-4f8b-8dff-06217d5ada7a service neutron] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:44.414483 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1016/2029] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:16:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:16:44.673068 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea28f83f-c1cf-4397-898f-97578d138ff0 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:44.674737 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-ea28f83f-c1cf-4397-898f-97578d138ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:44.688039 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea28f83f-c1cf-4397-898f-97578d138ff0 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:44.693989 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f943a8-c6a4-4ce2-80ef-5e4719a85e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:44.695240 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f943a8-c6a4-4ce2-80ef-5e4719a85e4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:44.695608 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f943a8-c6a4-4ce2-80ef-5e4719a85e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:44.696031 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f943a8-c6a4-4ce2-80ef-5e4719a85e4a admin admin] PATH_INFO: `/v3/users/d766a95dfb444e6c95d1111d933cdd83` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:44.697659 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f943a8-c6a4-4ce2-80ef-5e4719a85e4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d766a95dfb444e6c95d1111d933cdd83)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:44.699834 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f943a8-c6a4-4ce2-80ef-5e4719a85e4a admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:44.713165 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d61285-eb2f-4f8b-8dff-06217d5ada7a service neutron] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:44.714598 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-46d61285-eb2f-4f8b-8dff-06217d5ada7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:44.731920 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d61285-eb2f-4f8b-8dff-06217d5ada7a service neutron] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:44.737130 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762e3756-2010-4c43-ad77-1baef6016175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:44.738259 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762e3756-2010-4c43-ad77-1baef6016175 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:44.738659 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762e3756-2010-4c43-ad77-1baef6016175 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:44.739084 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762e3756-2010-4c43-ad77-1baef6016175 admin admin] PATH_INFO: `/v3/projects/bbba384d41ad40118acb831060e4f0e4` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:44.740518 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762e3756-2010-4c43-ad77-1baef6016175 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbba384d41ad40118acb831060e4f0e4)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:44.743362 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762e3756-2010-4c43-ad77-1baef6016175 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:44.755966 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-98f943a8-c6a4-4ce2-80ef-5e4719a85e4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd766a95dfb444e6c95d1111d933cdd83'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:44.756679 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-98f943a8-c6a4-4ce2-80ef-5e4719a85e4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd766a95dfb444e6c95d1111d933cdd83'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:44.757441 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-98f943a8-c6a4-4ce2-80ef-5e4719a85e4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd766a95dfb444e6c95d1111d933cdd83'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:44.765308 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-98f943a8-c6a4-4ce2-80ef-5e4719a85e4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd766a95dfb444e6c95d1111d933cdd83'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:44.774230 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-98f943a8-c6a4-4ce2-80ef-5e4719a85e4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd766a95dfb444e6c95d1111d933cdd83'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:44.791613 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-762e3756-2010-4c43-ad77-1baef6016175 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbba384d41ad40118acb831060e4f0e4', 'request_id': 'req-762e3756-2010-4c43-ad77-1baef6016175'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:44.792785 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1014/2030] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Mar 30 07:16:44 2022] DELETE /identity/v3/users/d766a95dfb444e6c95d1111d933cdd83 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 07:16:44.799841 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-762e3756-2010-4c43-ad77-1baef6016175 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbba384d41ad40118acb831060e4f0e4', 'request_id': 'req-762e3756-2010-4c43-ad77-1baef6016175'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:44.806145 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-762e3756-2010-4c43-ad77-1baef6016175 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbba384d41ad40118acb831060e4f0e4', 'request_id': 'req-762e3756-2010-4c43-ad77-1baef6016175'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:44.819774 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-762e3756-2010-4c43-ad77-1baef6016175 admin admin] The token cache is being invalidate because project bbba384d41ad40118acb831060e4f0e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79960) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 07:16:44.819774 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-762e3756-2010-4c43-ad77-1baef6016175 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:44.820970 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-762e3756-2010-4c43-ad77-1baef6016175 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:44.823676 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1017/2031] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Mar 30 07:16:44 2022] DELETE /identity/v3/projects/bbba384d41ad40118acb831060e4f0e4 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 07:16:44.827600 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f943a8-c6a4-4ce2-80ef-5e4719a85e4a admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:44.829182 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-98f943a8-c6a4-4ce2-80ef-5e4719a85e4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:44.895595 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f943a8-c6a4-4ce2-80ef-5e4719a85e4a admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:44.900812 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218c0f3c-da16-4df5-a15d-bf0f2d5c2829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:44.901711 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c0f3c-da16-4df5-a15d-bf0f2d5c2829 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:44.902012 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c0f3c-da16-4df5-a15d-bf0f2d5c2829 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:44.902282 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c0f3c-da16-4df5-a15d-bf0f2d5c2829 admin admin] PATH_INFO: `/v3/users/f9fd57a305d944d28023a02f254585c5` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:44.903491 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218c0f3c-da16-4df5-a15d-bf0f2d5c2829 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9fd57a305d944d28023a02f254585c5)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:44.905485 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218c0f3c-da16-4df5-a15d-bf0f2d5c2829 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:44.958459 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-218c0f3c-da16-4df5-a15d-bf0f2d5c2829 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9fd57a305d944d28023a02f254585c5'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:44.959129 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-218c0f3c-da16-4df5-a15d-bf0f2d5c2829 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9fd57a305d944d28023a02f254585c5'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:44.959877 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-218c0f3c-da16-4df5-a15d-bf0f2d5c2829 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9fd57a305d944d28023a02f254585c5'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:44.970402 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-218c0f3c-da16-4df5-a15d-bf0f2d5c2829 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9fd57a305d944d28023a02f254585c5'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:44.979053 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-218c0f3c-da16-4df5-a15d-bf0f2d5c2829 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9fd57a305d944d28023a02f254585c5'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:44.998599 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1015/2032] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Mar 30 07:16:44 2022] DELETE /identity/v3/users/f9fd57a305d944d28023a02f254585c5 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:16:45.000782 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762e3756-2010-4c43-ad77-1baef6016175 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:45.002195 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-762e3756-2010-4c43-ad77-1baef6016175 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:45.087072 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762e3756-2010-4c43-ad77-1baef6016175 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:45.170785 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6102d11e-282f-484a-a569-9173a874b8b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:45.182031 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6102d11e-282f-484a-a569-9173a874b8b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:45.183264 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6102d11e-282f-484a-a569-9173a874b8b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:45.184090 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6102d11e-282f-484a-a569-9173a874b8b9 admin admin] PATH_INFO: `/v3/projects/ad704701fcba49e5adc45e451291ef71` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:45.187088 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6102d11e-282f-484a-a569-9173a874b8b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad704701fcba49e5adc45e451291ef71)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:45.189653 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6102d11e-282f-484a-a569-9173a874b8b9 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:45.268023 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-6102d11e-282f-484a-a569-9173a874b8b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad704701fcba49e5adc45e451291ef71', 'request_id': 'req-6102d11e-282f-484a-a569-9173a874b8b9'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:45.277326 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-6102d11e-282f-484a-a569-9173a874b8b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad704701fcba49e5adc45e451291ef71', 'request_id': 'req-6102d11e-282f-484a-a569-9173a874b8b9'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:45.291628 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-6102d11e-282f-484a-a569-9173a874b8b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad704701fcba49e5adc45e451291ef71', 'request_id': 'req-6102d11e-282f-484a-a569-9173a874b8b9'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:45.309068 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-6102d11e-282f-484a-a569-9173a874b8b9 admin admin] The token cache is being invalidate because project ad704701fcba49e5adc45e451291ef71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79960) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 07:16:45.309371 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-6102d11e-282f-484a-a569-9173a874b8b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:45.310287 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-6102d11e-282f-484a-a569-9173a874b8b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:45.312149 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1018/2033] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Mar 30 07:16:44 2022] DELETE /identity/v3/projects/ad704701fcba49e5adc45e451291ef71 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:16:45.317357 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a9349-2e9e-4dc5-bce3-9eb3b4d42717 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:45.317838 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a9349-2e9e-4dc5-bce3-9eb3b4d42717 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:45.318135 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a9349-2e9e-4dc5-bce3-9eb3b4d42717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:45.330398 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6102d11e-282f-484a-a569-9173a874b8b9 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:45.332058 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-6102d11e-282f-484a-a569-9173a874b8b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:45.340038 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-207a9349-2e9e-4dc5-bce3-9eb3b4d42717 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:16:45.342689 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-207a9349-2e9e-4dc5-bce3-9eb3b4d42717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:45.435921 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1016/2034] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:16:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:16:45.446105 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd86c4b0-ebd9-4db3-b0f9-0a6b3b53648c None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:45.446394 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd86c4b0-ebd9-4db3-b0f9-0a6b3b53648c None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:45.447004 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd86c4b0-ebd9-4db3-b0f9-0a6b3b53648c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:45.452976 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6102d11e-282f-484a-a569-9173a874b8b9 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:45.458208 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdd7d24-163d-43cf-be7a-cc85b7345238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:45.459380 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd7d24-163d-43cf-be7a-cc85b7345238 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:45.460580 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd7d24-163d-43cf-be7a-cc85b7345238 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:45.460946 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd7d24-163d-43cf-be7a-cc85b7345238 admin admin] PATH_INFO: `/v3/projects/8bb9a5f7b9104c35bc11bd3beed69839` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:45.462454 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdd7d24-163d-43cf-be7a-cc85b7345238 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bb9a5f7b9104c35bc11bd3beed69839)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:45.464908 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdd7d24-163d-43cf-be7a-cc85b7345238 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:45.482583 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-bd86c4b0-ebd9-4db3-b0f9-0a6b3b53648c None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:16:45.482583 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-bd86c4b0-ebd9-4db3-b0f9-0a6b3b53648c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:45.493142 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1017/2035] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:16:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:16:45.496986 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd86c4b0-ebd9-4db3-b0f9-0a6b3b53648c None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:45.508268 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd86c4b0-ebd9-4db3-b0f9-0a6b3b53648c None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:45.514077 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ea61b9-42c9-468c-9bf6-537ddb03a371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:45.515050 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea61b9-42c9-468c-9bf6-537ddb03a371 admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:45.515446 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea61b9-42c9-468c-9bf6-537ddb03a371 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:45.515859 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea61b9-42c9-468c-9bf6-537ddb03a371 admin admin] PATH_INFO: `/v3/domains` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:45.517030 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ea61b9-42c9-468c-9bf6-537ddb03a371 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:16:45.517425 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ea61b9-42c9-468c-9bf6-537ddb03a371 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:45.520063 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ea61b9-42c9-468c-9bf6-537ddb03a371 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:45.538398 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1018/2036] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Mar 30 07:16:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:16:45.542610 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ea61b9-42c9-468c-9bf6-537ddb03a371 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:45.544160 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-7bdd7d24-163d-43cf-be7a-cc85b7345238 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bb9a5f7b9104c35bc11bd3beed69839', 'request_id': 'req-7bdd7d24-163d-43cf-be7a-cc85b7345238'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:45.553501 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ea61b9-42c9-468c-9bf6-537ddb03a371 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:45.555636 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-7bdd7d24-163d-43cf-be7a-cc85b7345238 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bb9a5f7b9104c35bc11bd3beed69839', 'request_id': 'req-7bdd7d24-163d-43cf-be7a-cc85b7345238'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:45.564208 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-7bdd7d24-163d-43cf-be7a-cc85b7345238 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bb9a5f7b9104c35bc11bd3beed69839', 'request_id': 'req-7bdd7d24-163d-43cf-be7a-cc85b7345238'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:45.577279 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-7bdd7d24-163d-43cf-be7a-cc85b7345238 admin admin] The token cache is being invalidate because project 8bb9a5f7b9104c35bc11bd3beed69839 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79960) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 07:16:45.577572 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-7bdd7d24-163d-43cf-be7a-cc85b7345238 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:45.579915 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-7bdd7d24-163d-43cf-be7a-cc85b7345238 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:45.581679 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1019/2037] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Mar 30 07:16:45 2022] DELETE /identity/v3/projects/8bb9a5f7b9104c35bc11bd3beed69839 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 07:16:45.587113 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb1ae49-a206-4421-ba26-7e709b6e8da0 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:45.587396 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb1ae49-a206-4421-ba26-7e709b6e8da0 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:45.587708 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb1ae49-a206-4421-ba26-7e709b6e8da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:45.608947 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-8fb1ae49-a206-4421-ba26-7e709b6e8da0 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:16:45.610139 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-8fb1ae49-a206-4421-ba26-7e709b6e8da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:45.615673 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9622f15a-019d-4f11-88ff-64a99b980d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:45.616408 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9622f15a-019d-4f11-88ff-64a99b980d76 admin admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:45.616689 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9622f15a-019d-4f11-88ff-64a99b980d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:45.616963 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9622f15a-019d-4f11-88ff-64a99b980d76 admin admin] PATH_INFO: `/v3/projects` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:45.617657 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9622f15a-019d-4f11-88ff-64a99b980d76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:45.619619 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9622f15a-019d-4f11-88ff-64a99b980d76 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:45.647857 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1019/2038] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Mar 30 07:16:45 2022] POST /identity/v3/projects => generated 357 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:16:45.652834 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9622f15a-019d-4f11-88ff-64a99b980d76 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:45.654765 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-9622f15a-019d-4f11-88ff-64a99b980d76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:45.669115 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1020/2039] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:16:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 07:16:45.676822 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b7d1b8-777c-4da8-a346-e4affaed80d3 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:45.677106 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b7d1b8-777c-4da8-a346-e4affaed80d3 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:45.677382 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b7d1b8-777c-4da8-a346-e4affaed80d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:45.695680 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-04b7d1b8-777c-4da8-a346-e4affaed80d3 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:16:45.696927 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-04b7d1b8-777c-4da8-a346-e4affaed80d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:45.729516 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9622f15a-019d-4f11-88ff-64a99b980d76 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:45.735488 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce57d53-940c-464c-a128-25f12f7649c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:45.736200 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce57d53-940c-464c-a128-25f12f7649c2 admin admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:45.736479 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce57d53-940c-464c-a128-25f12f7649c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:45.736795 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce57d53-940c-464c-a128-25f12f7649c2 admin admin] PATH_INFO: `/v3/users` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:45.737789 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce57d53-940c-464c-a128-25f12f7649c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:45.739751 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce57d53-940c-464c-a128-25f12f7649c2 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:45.755398 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1021/2040] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:16:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 07:16:45.759840 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b7d1b8-777c-4da8-a346-e4affaed80d3 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:45.761396 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1020/2041] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Mar 30 07:16:45 2022] POST /identity/v3/users => generated 279 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:16:45.765076 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce57d53-940c-464c-a128-25f12f7649c2 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:45.769438 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b7d1b8-777c-4da8-a346-e4affaed80d3 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:45.774869 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261591a9-bbf1-4161-8316-be2bf82731f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:45.775074 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce57d53-940c-464c-a128-25f12f7649c2 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:45.775525 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261591a9-bbf1-4161-8316-be2bf82731f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:45.775829 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261591a9-bbf1-4161-8316-be2bf82731f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:45.776260 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261591a9-bbf1-4161-8316-be2bf82731f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:45.776987 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261591a9-bbf1-4161-8316-be2bf82731f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:16:45.777309 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261591a9-bbf1-4161-8316-be2bf82731f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:45.778918 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261591a9-bbf1-4161-8316-be2bf82731f7 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:45.779644 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e0fd2f-4961-41cf-9afe-653d0841cb98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:45.780322 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e0fd2f-4961-41cf-9afe-653d0841cb98 admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:45.780601 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e0fd2f-4961-41cf-9afe-653d0841cb98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:45.780874 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e0fd2f-4961-41cf-9afe-653d0841cb98 admin admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:45.781589 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e0fd2f-4961-41cf-9afe-653d0841cb98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:45.783162 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e0fd2f-4961-41cf-9afe-653d0841cb98 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:45.794442 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1022/2042] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Mar 30 07:16:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:16:45.794604 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1021/2043] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:16:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 30 07:16:45.797658 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261591a9-bbf1-4161-8316-be2bf82731f7 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:45.797771 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e0fd2f-4961-41cf-9afe-653d0841cb98 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:45.807351 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e0fd2f-4961-41cf-9afe-653d0841cb98 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:45.807523 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261591a9-bbf1-4161-8316-be2bf82731f7 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:45.812100 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a759d8-9c6d-44a0-a7d3-89f733d7a77d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:45.812228 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7e3555-83ef-4865-bc8f-339303b4c5be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:45.812746 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e3555-83ef-4865-bc8f-339303b4c5be admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:45.812853 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a759d8-9c6d-44a0-a7d3-89f733d7a77d admin admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:45.813028 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e3555-83ef-4865-bc8f-339303b4c5be admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:45.813127 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a759d8-9c6d-44a0-a7d3-89f733d7a77d admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:45.813363 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a759d8-9c6d-44a0-a7d3-89f733d7a77d admin admin] PATH_INFO: `/v3/projects` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:45.813447 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e3555-83ef-4865-bc8f-339303b4c5be admin admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:45.813994 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a759d8-9c6d-44a0-a7d3-89f733d7a77d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:45.814094 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7e3555-83ef-4865-bc8f-339303b4c5be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:45.815702 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7e3555-83ef-4865-bc8f-339303b4c5be admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:45.815938 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a759d8-9c6d-44a0-a7d3-89f733d7a77d admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:45.828587 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1022/2044] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:16:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 30 07:16:45.833107 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7e3555-83ef-4865-bc8f-339303b4c5be admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:45.843375 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1023/2045] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Mar 30 07:16:45 2022] POST /identity/v3/projects => generated 367 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:16:45.843922 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7e3555-83ef-4865-bc8f-339303b4c5be admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:45.847492 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a759d8-9c6d-44a0-a7d3-89f733d7a77d admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:45.907545 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8735cc53-fa7c-4a3d-bb62-1a7d258abe9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:45.908417 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8735cc53-fa7c-4a3d-bb62-1a7d258abe9c admin admin] REQUEST_METHOD: `PUT` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:45.908693 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8735cc53-fa7c-4a3d-bb62-1a7d258abe9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:45.908961 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8735cc53-fa7c-4a3d-bb62-1a7d258abe9c admin admin] PATH_INFO: `/v3/projects/5314fa07829e4ea5b84250ab30bdc6b3/users/45e27ff54dde41a69a856daf4509b302/roles/5d79031a64754b57ba120367465e2252` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:45.909886 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a759d8-9c6d-44a0-a7d3-89f733d7a77d admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:45.914763 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e1474d-33a6-4aee-ae50-9dfba192b8a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:45.915444 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e1474d-33a6-4aee-ae50-9dfba192b8a9 admin admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:45.915776 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e1474d-33a6-4aee-ae50-9dfba192b8a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:45.916115 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e1474d-33a6-4aee-ae50-9dfba192b8a9 admin admin] PATH_INFO: `/v3/users` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:45.916888 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e1474d-33a6-4aee-ae50-9dfba192b8a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:45.919927 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e1474d-33a6-4aee-ae50-9dfba192b8a9 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:45.925915 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8735cc53-fa7c-4a3d-bb62-1a7d258abe9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5314fa07829e4ea5b84250ab30bdc6b3, user_id=45e27ff54dde41a69a856daf4509b302, role_id=5d79031a64754b57ba120367465e2252)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:45.928871 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8735cc53-fa7c-4a3d-bb62-1a7d258abe9c admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:45.943861 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1024/2046] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Mar 30 07:16:45 2022] POST /identity/v3/users => generated 284 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 07:16:45.947555 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e1474d-33a6-4aee-ae50-9dfba192b8a9 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:45.948754 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1023/2047] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:16:45 2022] PUT /identity/v3/projects/5314fa07829e4ea5b84250ab30bdc6b3/users/45e27ff54dde41a69a856daf4509b302/roles/5d79031a64754b57ba120367465e2252 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:16:45.958816 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef68c6-46af-4d5c-aaf5-160f976e11bb None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:45.959096 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef68c6-46af-4d5c-aaf5-160f976e11bb None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:45.959371 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef68c6-46af-4d5c-aaf5-160f976e11bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:45.959637 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e1474d-33a6-4aee-ae50-9dfba192b8a9 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:45.986414 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-7bef68c6-46af-4d5c-aaf5-160f976e11bb None None] MFA Rules not processed for user `45e27ff54dde41a69a856daf4509b302`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:16:45.987933 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-7bef68c6-46af-4d5c-aaf5-160f976e11bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:46.015774 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8ddb78-95b8-4f5d-9758-4a153d0d9e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:46.016579 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8ddb78-95b8-4f5d-9758-4a153d0d9e5b admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:46.016738 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8ddb78-95b8-4f5d-9758-4a153d0d9e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:46.017007 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8ddb78-95b8-4f5d-9758-4a153d0d9e5b admin admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:46.017728 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8ddb78-95b8-4f5d-9758-4a153d0d9e5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:46.019320 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8ddb78-95b8-4f5d-9758-4a153d0d9e5b admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:46.029336 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1025/2048] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:16:45 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:16:46.033401 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8ddb78-95b8-4f5d-9758-4a153d0d9e5b admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:46.042832 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8ddb78-95b8-4f5d-9758-4a153d0d9e5b admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:46.047399 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcbfa42-db74-4191-9dae-53c48193566e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:46.048072 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcbfa42-db74-4191-9dae-53c48193566e admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:46.048350 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcbfa42-db74-4191-9dae-53c48193566e admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:46.048621 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcbfa42-db74-4191-9dae-53c48193566e admin admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:46.049325 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcbfa42-db74-4191-9dae-53c48193566e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:46.050871 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcbfa42-db74-4191-9dae-53c48193566e admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:46.052439 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1024/2049] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:16:45 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:16:46.056878 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bef68c6-46af-4d5c-aaf5-160f976e11bb None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:46.060713 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1026/2050] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:16:46 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:16:46.064691 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcbfa42-db74-4191-9dae-53c48193566e admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:46.067372 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bef68c6-46af-4d5c-aaf5-160f976e11bb None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:46.072154 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa5c09a-e863-41f8-93d4-998da7e5afe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:46.072800 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa5c09a-e863-41f8-93d4-998da7e5afe2 admin admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:46.073071 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa5c09a-e863-41f8-93d4-998da7e5afe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:46.073341 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa5c09a-e863-41f8-93d4-998da7e5afe2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:46.074022 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa5c09a-e863-41f8-93d4-998da7e5afe2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:46.074954 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcbfa42-db74-4191-9dae-53c48193566e admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:46.075942 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa5c09a-e863-41f8-93d4-998da7e5afe2 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:46.080287 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4632292-60d2-4f1c-8977-1d640dbf40cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:46.081155 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4632292-60d2-4f1c-8977-1d640dbf40cb admin admin] REQUEST_METHOD: `PUT` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:46.081437 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4632292-60d2-4f1c-8977-1d640dbf40cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:46.081710 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4632292-60d2-4f1c-8977-1d640dbf40cb admin admin] PATH_INFO: `/v3/projects/8dc10c2d848b4dcfa96a07b465de3a6b/users/28ca33cd8aba4197a99c980a0cd78033/roles/5d79031a64754b57ba120367465e2252` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:46.096599 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4632292-60d2-4f1c-8977-1d640dbf40cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dc10c2d848b4dcfa96a07b465de3a6b, user_id=28ca33cd8aba4197a99c980a0cd78033, role_id=5d79031a64754b57ba120367465e2252)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:46.099454 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4632292-60d2-4f1c-8977-1d640dbf40cb admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:46.102120 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1025/2051] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Mar 30 07:16:46 2022] POST /identity/v3/projects => generated 357 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 07:16:46.106546 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa5c09a-e863-41f8-93d4-998da7e5afe2 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:46.115392 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1027/2052] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:16:46 2022] PUT /identity/v3/projects/8dc10c2d848b4dcfa96a07b465de3a6b/users/28ca33cd8aba4197a99c980a0cd78033/roles/5d79031a64754b57ba120367465e2252 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 07:16:46.126829 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceba04cc-d211-4231-90d0-e30a82198382 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:46.127106 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceba04cc-d211-4231-90d0-e30a82198382 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:46.127384 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceba04cc-d211-4231-90d0-e30a82198382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:46.154880 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-ceba04cc-d211-4231-90d0-e30a82198382 None None] MFA Rules not processed for user `28ca33cd8aba4197a99c980a0cd78033`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:16:46.156149 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-ceba04cc-d211-4231-90d0-e30a82198382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:46.171848 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa5c09a-e863-41f8-93d4-998da7e5afe2 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:46.222803 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1028/2053] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:16:46 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 07:16:46.227326 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceba04cc-d211-4231-90d0-e30a82198382 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:46.232622 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c95b21-58f5-4bf9-b4a8-832f919b8aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:46.233305 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c95b21-58f5-4bf9-b4a8-832f919b8aa1 admin admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:46.233588 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c95b21-58f5-4bf9-b4a8-832f919b8aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:46.233893 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c95b21-58f5-4bf9-b4a8-832f919b8aa1 admin admin] PATH_INFO: `/v3/users` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:46.234675 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c95b21-58f5-4bf9-b4a8-832f919b8aa1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:46.238498 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c95b21-58f5-4bf9-b4a8-832f919b8aa1 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:46.267472 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1026/2054] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Mar 30 07:16:46 2022] POST /identity/v3/users => generated 285 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 07:16:46.272760 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c95b21-58f5-4bf9-b4a8-832f919b8aa1 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:46.283716 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c95b21-58f5-4bf9-b4a8-832f919b8aa1 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:46.289293 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8909a6b2-b8e0-4fe1-81b0-bbd1bd35dbbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:46.290021 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8909a6b2-b8e0-4fe1-81b0-bbd1bd35dbbf admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:46.290303 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8909a6b2-b8e0-4fe1-81b0-bbd1bd35dbbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:46.290633 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8909a6b2-b8e0-4fe1-81b0-bbd1bd35dbbf admin admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:46.291416 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8909a6b2-b8e0-4fe1-81b0-bbd1bd35dbbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:46.293118 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8909a6b2-b8e0-4fe1-81b0-bbd1bd35dbbf admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:46.298433 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceba04cc-d211-4231-90d0-e30a82198382 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:46.302972 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20f5471-b4d3-4c7c-bb5f-8e78fa2d7ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:46.303099 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1027/2055] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:16:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:16:46.303627 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f5471-b4d3-4c7c-bb5f-8e78fa2d7ba0 admin admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:46.303970 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f5471-b4d3-4c7c-bb5f-8e78fa2d7ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:46.304239 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f5471-b4d3-4c7c-bb5f-8e78fa2d7ba0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:46.305117 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20f5471-b4d3-4c7c-bb5f-8e78fa2d7ba0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:46.306998 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20f5471-b4d3-4c7c-bb5f-8e78fa2d7ba0 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:46.307135 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8909a6b2-b8e0-4fe1-81b0-bbd1bd35dbbf admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:46.316319 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8909a6b2-b8e0-4fe1-81b0-bbd1bd35dbbf admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:46.321228 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ab154d-20b3-4498-bb2b-16a0d4f757f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:46.322090 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab154d-20b3-4498-bb2b-16a0d4f757f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:46.322364 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab154d-20b3-4498-bb2b-16a0d4f757f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:46.322651 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab154d-20b3-4498-bb2b-16a0d4f757f9 admin admin] PATH_INFO: `/v3/projects/fbd0ea69499941148775c3e39e336d7a/users/2f9450fd9af045cfbfd43109b618848c/roles/1c39b9ab8cfd4c0ea71845831920a845` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:46.332953 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1029/2056] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Mar 30 07:16:46 2022] POST /identity/v3/projects => generated 367 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 07:16:46.337178 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20f5471-b4d3-4c7c-bb5f-8e78fa2d7ba0 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:46.340483 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ab154d-20b3-4498-bb2b-16a0d4f757f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbd0ea69499941148775c3e39e336d7a, user_id=2f9450fd9af045cfbfd43109b618848c, role_id=1c39b9ab8cfd4c0ea71845831920a845)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:46.343232 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ab154d-20b3-4498-bb2b-16a0d4f757f9 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:46.357577 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1028/2057] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:16:46 2022] PUT /identity/v3/projects/fbd0ea69499941148775c3e39e336d7a/users/2f9450fd9af045cfbfd43109b618848c/roles/1c39b9ab8cfd4c0ea71845831920a845 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 07:16:46.361416 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ab154d-20b3-4498-bb2b-16a0d4f757f9 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:46.399421 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20f5471-b4d3-4c7c-bb5f-8e78fa2d7ba0 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:46.424938 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ab154d-20b3-4498-bb2b-16a0d4f757f9 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:46.430040 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819f0de4-f26a-4ad0-a390-772af9e5af00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:46.430735 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f0de4-f26a-4ad0-a390-772af9e5af00 admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:46.431015 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f0de4-f26a-4ad0-a390-772af9e5af00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:46.431287 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f0de4-f26a-4ad0-a390-772af9e5af00 admin admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:46.432054 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819f0de4-f26a-4ad0-a390-772af9e5af00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:46.433668 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819f0de4-f26a-4ad0-a390-772af9e5af00 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:46.444033 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1029/2058] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:16:46 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:16:46.448808 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819f0de4-f26a-4ad0-a390-772af9e5af00 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:46.456440 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bbe63a-5e15-44e9-8211-4a47cdcfd8dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:46.457114 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bbe63a-5e15-44e9-8211-4a47cdcfd8dd admin admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:46.457392 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bbe63a-5e15-44e9-8211-4a47cdcfd8dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:46.457659 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bbe63a-5e15-44e9-8211-4a47cdcfd8dd admin admin] PATH_INFO: `/v3/users` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:46.458231 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819f0de4-f26a-4ad0-a390-772af9e5af00 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:46.458332 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bbe63a-5e15-44e9-8211-4a47cdcfd8dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:46.460395 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bbe63a-5e15-44e9-8211-4a47cdcfd8dd admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:46.462723 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021bda59-2bf3-495e-b928-0cd7350d117a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:46.463610 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021bda59-2bf3-495e-b928-0cd7350d117a admin admin] REQUEST_METHOD: `PUT` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:46.463918 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021bda59-2bf3-495e-b928-0cd7350d117a admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:46.464187 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021bda59-2bf3-495e-b928-0cd7350d117a admin admin] PATH_INFO: `/v3/projects/fbd0ea69499941148775c3e39e336d7a/users/2f9450fd9af045cfbfd43109b618848c/roles/1c39b9ab8cfd4c0ea71845831920a845` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:46.466089 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021bda59-2bf3-495e-b928-0cd7350d117a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbd0ea69499941148775c3e39e336d7a, user_id=2f9450fd9af045cfbfd43109b618848c, role_id=1c39b9ab8cfd4c0ea71845831920a845)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:46.468727 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021bda59-2bf3-495e-b928-0cd7350d117a admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:46.482660 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1030/2059] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:16:46 2022] PUT /identity/v3/projects/fbd0ea69499941148775c3e39e336d7a/users/2f9450fd9af045cfbfd43109b618848c/roles/1c39b9ab8cfd4c0ea71845831920a845 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 07:16:46.482860 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1030/2060] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Mar 30 07:16:46 2022] POST /identity/v3/users => generated 290 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 07:16:46.488631 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021bda59-2bf3-495e-b928-0cd7350d117a admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:46.494336 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f21aa70-d8d9-4538-9eb5-88fd9b95f307 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:46.494634 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f21aa70-d8d9-4538-9eb5-88fd9b95f307 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:46.494962 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f21aa70-d8d9-4538-9eb5-88fd9b95f307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:46.524844 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-7f21aa70-d8d9-4538-9eb5-88fd9b95f307 None None] MFA Rules not processed for user `2f9450fd9af045cfbfd43109b618848c`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:16:46.526204 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-7f21aa70-d8d9-4538-9eb5-88fd9b95f307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:46.572352 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021bda59-2bf3-495e-b928-0cd7350d117a admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:46.578205 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f5a69e-f8e5-49f7-8864-2bbf640224ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:46.581327 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f5a69e-f8e5-49f7-8864-2bbf640224ae admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:46.581327 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f5a69e-f8e5-49f7-8864-2bbf640224ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:46.581327 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f5a69e-f8e5-49f7-8864-2bbf640224ae admin admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:46.581327 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f5a69e-f8e5-49f7-8864-2bbf640224ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:46.582359 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f5a69e-f8e5-49f7-8864-2bbf640224ae admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:46.592779 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1031/2061] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:16:46 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:16:46.596791 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f5a69e-f8e5-49f7-8864-2bbf640224ae admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:46.608102 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f5a69e-f8e5-49f7-8864-2bbf640224ae admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:46.614509 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1031/2062] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:16:46 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:16:46.620475 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53cccb6-4c62-4b6f-983c-4c155134a032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:46.621601 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53cccb6-4c62-4b6f-983c-4c155134a032 admin admin] REQUEST_METHOD: `PUT` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:46.621981 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53cccb6-4c62-4b6f-983c-4c155134a032 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:46.622347 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53cccb6-4c62-4b6f-983c-4c155134a032 admin admin] PATH_INFO: `/v3/projects/bb3af7b1a3964f06ae7a79f8ced4890f/users/892778b12c63428696353ba77e598533/roles/1c39b9ab8cfd4c0ea71845831920a845` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:46.627487 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f21aa70-d8d9-4538-9eb5-88fd9b95f307 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:46.629099 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-7f21aa70-d8d9-4538-9eb5-88fd9b95f307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:46.639689 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53cccb6-4c62-4b6f-983c-4c155134a032 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb3af7b1a3964f06ae7a79f8ced4890f, user_id=892778b12c63428696353ba77e598533, role_id=1c39b9ab8cfd4c0ea71845831920a845)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:46.643467 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53cccb6-4c62-4b6f-983c-4c155134a032 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:46.666895 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1032/2063] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:16:46 2022] PUT /identity/v3/projects/bb3af7b1a3964f06ae7a79f8ced4890f/users/892778b12c63428696353ba77e598533/roles/1c39b9ab8cfd4c0ea71845831920a845 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 07:16:46.669182 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53cccb6-4c62-4b6f-983c-4c155134a032 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:46.716664 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f21aa70-d8d9-4538-9eb5-88fd9b95f307 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:46.782071 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572e685e-5d1f-412f-8ce4-ef05bc609dc6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e2fda180e8d448d895c40cdad34bc4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:46.782732 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572e685e-5d1f-412f-8ce4-ef05bc609dc6 service cinder] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:46.783014 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572e685e-5d1f-412f-8ce4-ef05bc609dc6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:46.783290 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572e685e-5d1f-412f-8ce4-ef05bc609dc6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:46.800592 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53cccb6-4c62-4b6f-983c-4c155134a032 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:46.807121 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ce9746-6cd6-4c39-b27c-9627af951ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:46.811238 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ce9746-6cd6-4c39-b27c-9627af951ac1 admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:46.811238 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ce9746-6cd6-4c39-b27c-9627af951ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:46.811238 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ce9746-6cd6-4c39-b27c-9627af951ac1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:46.811238 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ce9746-6cd6-4c39-b27c-9627af951ac1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:46.811238 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ce9746-6cd6-4c39-b27c-9627af951ac1 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:46.826736 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1033/2064] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:16:46 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:16:46.827347 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ce9746-6cd6-4c39-b27c-9627af951ac1 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:46.842258 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ce9746-6cd6-4c39-b27c-9627af951ac1 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:46.846844 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627ca4f6-dd94-4303-a9d6-052e62f95262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:46.847733 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627ca4f6-dd94-4303-a9d6-052e62f95262 admin admin] REQUEST_METHOD: `PUT` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:46.848052 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627ca4f6-dd94-4303-a9d6-052e62f95262 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:46.848328 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627ca4f6-dd94-4303-a9d6-052e62f95262 admin admin] PATH_INFO: `/v3/projects/bb3af7b1a3964f06ae7a79f8ced4890f/users/892778b12c63428696353ba77e598533/roles/1c39b9ab8cfd4c0ea71845831920a845` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:46.850392 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627ca4f6-dd94-4303-a9d6-052e62f95262 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb3af7b1a3964f06ae7a79f8ced4890f, user_id=892778b12c63428696353ba77e598533, role_id=1c39b9ab8cfd4c0ea71845831920a845)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:46.852532 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572e685e-5d1f-412f-8ce4-ef05bc609dc6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:46.853975 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572e685e-5d1f-412f-8ce4-ef05bc609dc6 service cinder] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:46.854104 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627ca4f6-dd94-4303-a9d6-052e62f95262 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:46.864267 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1032/2065] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:16:46 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:16:46.868042 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1034/2066] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:16:46 2022] PUT /identity/v3/projects/bb3af7b1a3964f06ae7a79f8ced4890f/users/892778b12c63428696353ba77e598533/roles/1c39b9ab8cfd4c0ea71845831920a845 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:16:46.878300 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aac9aae-eaf5-4385-8fee-1d1bfc90501c None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:46.878584 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aac9aae-eaf5-4385-8fee-1d1bfc90501c None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:46.878859 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aac9aae-eaf5-4385-8fee-1d1bfc90501c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:46.907600 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-1aac9aae-eaf5-4385-8fee-1d1bfc90501c None None] MFA Rules not processed for user `892778b12c63428696353ba77e598533`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:16:46.908841 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-1aac9aae-eaf5-4385-8fee-1d1bfc90501c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:46.948618 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627ca4f6-dd94-4303-a9d6-052e62f95262 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:46.980244 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1033/2067] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:16:46 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:16:46.993261 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aac9aae-eaf5-4385-8fee-1d1bfc90501c None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:46.994760 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-1aac9aae-eaf5-4385-8fee-1d1bfc90501c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:47.007628 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627ca4f6-dd94-4303-a9d6-052e62f95262 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:47.011546 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce47960-ebe9-4750-84c1-6293da80cc1f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e2fda180e8d448d895c40cdad34bc4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:47.012238 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce47960-ebe9-4750-84c1-6293da80cc1f service cinder] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:47.012526 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce47960-ebe9-4750-84c1-6293da80cc1f service cinder] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:47.012815 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce47960-ebe9-4750-84c1-6293da80cc1f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:47.054382 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aac9aae-eaf5-4385-8fee-1d1bfc90501c None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:47.058273 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c94859b-bf41-4878-b275-aa1f6d4a7c3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e2fda180e8d448d895c40cdad34bc4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:47.058917 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c94859b-bf41-4878-b275-aa1f6d4a7c3b service cinder] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:47.059193 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c94859b-bf41-4878-b275-aa1f6d4a7c3b service cinder] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:47.059562 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c94859b-bf41-4878-b275-aa1f6d4a7c3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:47.069206 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c94859b-bf41-4878-b275-aa1f6d4a7c3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:47.071314 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c94859b-bf41-4878-b275-aa1f6d4a7c3b service cinder] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:47.075210 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce47960-ebe9-4750-84c1-6293da80cc1f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:47.076761 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce47960-ebe9-4750-84c1-6293da80cc1f service cinder] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:47.081093 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1034/2068] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:16:46 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:16:47.085731 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1035/2069] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:16:46 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 30 07:16:48.484086 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c94859b-bf41-4878-b275-aa1f6d4a7c3b service cinder] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:48.549360 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c94859b-bf41-4878-b275-aa1f6d4a7c3b service cinder] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:48.555266 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c458d1c1-f7c7-4bc0-9182-916e4f018678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:48.556176 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c458d1c1-f7c7-4bc0-9182-916e4f018678 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:48.556460 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c458d1c1-f7c7-4bc0-9182-916e4f018678 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:48.556732 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c458d1c1-f7c7-4bc0-9182-916e4f018678 admin admin] PATH_INFO: `/v3/users/28ca33cd8aba4197a99c980a0cd78033` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:48.558118 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c458d1c1-f7c7-4bc0-9182-916e4f018678 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28ca33cd8aba4197a99c980a0cd78033)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:48.560115 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c458d1c1-f7c7-4bc0-9182-916e4f018678 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:48.608211 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-c458d1c1-f7c7-4bc0-9182-916e4f018678 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28ca33cd8aba4197a99c980a0cd78033'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:48.608860 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-c458d1c1-f7c7-4bc0-9182-916e4f018678 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28ca33cd8aba4197a99c980a0cd78033'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:48.617710 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-c458d1c1-f7c7-4bc0-9182-916e4f018678 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28ca33cd8aba4197a99c980a0cd78033'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:48.630197 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-c458d1c1-f7c7-4bc0-9182-916e4f018678 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28ca33cd8aba4197a99c980a0cd78033'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:48.630852 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-c458d1c1-f7c7-4bc0-9182-916e4f018678 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28ca33cd8aba4197a99c980a0cd78033'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:48.643633 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1035/2070] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Mar 30 07:16:48 2022] DELETE /identity/v3/users/28ca33cd8aba4197a99c980a0cd78033 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:16:48.648557 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e0203e-256c-470e-8a0d-87d6d615253d None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:48.649137 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e0203e-256c-470e-8a0d-87d6d615253d None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:48.649301 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e0203e-256c-470e-8a0d-87d6d615253d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:48.668575 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-e9e0203e-256c-470e-8a0d-87d6d615253d None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:16:48.669948 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-e9e0203e-256c-470e-8a0d-87d6d615253d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:48.732540 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1036/2071] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:16:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:16:48.742308 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c458d1c1-f7c7-4bc0-9182-916e4f018678 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:48.743858 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-c458d1c1-f7c7-4bc0-9182-916e4f018678 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:48.799451 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c458d1c1-f7c7-4bc0-9182-916e4f018678 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:48.803484 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e8b895-75bf-415b-a8c3-64844a69e2cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3802cb341445f994b9204744060ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:48.804348 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e8b895-75bf-415b-a8c3-64844a69e2cb service neutron] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:48.804638 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e8b895-75bf-415b-a8c3-64844a69e2cb service neutron] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:48.804911 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e8b895-75bf-415b-a8c3-64844a69e2cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:48.815012 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e8b895-75bf-415b-a8c3-64844a69e2cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:48.816537 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e8b895-75bf-415b-a8c3-64844a69e2cb service neutron] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:48.826083 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1036/2072] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:16:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:16:49.092454 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e0203e-256c-470e-8a0d-87d6d615253d None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:49.094099 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-e9e0203e-256c-470e-8a0d-87d6d615253d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:49.108874 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e0203e-256c-470e-8a0d-87d6d615253d None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:49.113979 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad14248-f76b-4ae3-957e-f51569dcca4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:49.114994 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad14248-f76b-4ae3-957e-f51569dcca4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:49.115273 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad14248-f76b-4ae3-957e-f51569dcca4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:49.115543 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad14248-f76b-4ae3-957e-f51569dcca4d admin admin] PATH_INFO: `/v3/projects/8dc10c2d848b4dcfa96a07b465de3a6b` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:49.117400 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad14248-f76b-4ae3-957e-f51569dcca4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8dc10c2d848b4dcfa96a07b465de3a6b)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:49.119492 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad14248-f76b-4ae3-957e-f51569dcca4d admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:49.171748 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-bad14248-f76b-4ae3-957e-f51569dcca4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8dc10c2d848b4dcfa96a07b465de3a6b', 'request_id': 'req-bad14248-f76b-4ae3-957e-f51569dcca4d'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:49.177440 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-bad14248-f76b-4ae3-957e-f51569dcca4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8dc10c2d848b4dcfa96a07b465de3a6b', 'request_id': 'req-bad14248-f76b-4ae3-957e-f51569dcca4d'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:49.184926 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-bad14248-f76b-4ae3-957e-f51569dcca4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8dc10c2d848b4dcfa96a07b465de3a6b', 'request_id': 'req-bad14248-f76b-4ae3-957e-f51569dcca4d'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:49.196170 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-bad14248-f76b-4ae3-957e-f51569dcca4d admin admin] The token cache is being invalidate because project 8dc10c2d848b4dcfa96a07b465de3a6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79961) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 07:16:49.196454 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-bad14248-f76b-4ae3-957e-f51569dcca4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:49.197089 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-bad14248-f76b-4ae3-957e-f51569dcca4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:49.198637 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1037/2073] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Mar 30 07:16:49 2022] DELETE /identity/v3/projects/8dc10c2d848b4dcfa96a07b465de3a6b => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:16:49.202543 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e8b895-75bf-415b-a8c3-64844a69e2cb service neutron] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:49.212173 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e8b895-75bf-415b-a8c3-64844a69e2cb service neutron] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:49.267541 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d8130c-6b95-47c3-86bf-a8bc97bb5710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:49.268516 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d8130c-6b95-47c3-86bf-a8bc97bb5710 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:49.268800 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d8130c-6b95-47c3-86bf-a8bc97bb5710 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:49.269075 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d8130c-6b95-47c3-86bf-a8bc97bb5710 admin admin] PATH_INFO: `/v3/users/892778b12c63428696353ba77e598533` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:49.270329 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d8130c-6b95-47c3-86bf-a8bc97bb5710 admin admin] RBAC: Authorizing `identity:delete_user(user_id=892778b12c63428696353ba77e598533)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:49.272292 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d8130c-6b95-47c3-86bf-a8bc97bb5710 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:49.318971 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-f4d8130c-6b95-47c3-86bf-a8bc97bb5710 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '892778b12c63428696353ba77e598533'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:49.319628 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-f4d8130c-6b95-47c3-86bf-a8bc97bb5710 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '892778b12c63428696353ba77e598533'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:49.328095 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-f4d8130c-6b95-47c3-86bf-a8bc97bb5710 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '892778b12c63428696353ba77e598533'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:49.340036 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-f4d8130c-6b95-47c3-86bf-a8bc97bb5710 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '892778b12c63428696353ba77e598533'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:49.340604 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-f4d8130c-6b95-47c3-86bf-a8bc97bb5710 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '892778b12c63428696353ba77e598533'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:49.353002 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1037/2074] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Mar 30 07:16:49 2022] DELETE /identity/v3/users/892778b12c63428696353ba77e598533 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:16:49.638643 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad14248-f76b-4ae3-957e-f51569dcca4d admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:49.640329 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-bad14248-f76b-4ae3-957e-f51569dcca4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:49.655800 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad14248-f76b-4ae3-957e-f51569dcca4d admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:49.717551 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a77e7d-aa02-4ef0-9302-1fb44b2f8a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:49.718427 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a77e7d-aa02-4ef0-9302-1fb44b2f8a66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:49.718709 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a77e7d-aa02-4ef0-9302-1fb44b2f8a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:49.718981 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a77e7d-aa02-4ef0-9302-1fb44b2f8a66 admin admin] PATH_INFO: `/v3/projects/bb3af7b1a3964f06ae7a79f8ced4890f` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:49.720350 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a77e7d-aa02-4ef0-9302-1fb44b2f8a66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb3af7b1a3964f06ae7a79f8ced4890f)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:49.722520 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a77e7d-aa02-4ef0-9302-1fb44b2f8a66 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:49.772824 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-e9a77e7d-aa02-4ef0-9302-1fb44b2f8a66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb3af7b1a3964f06ae7a79f8ced4890f', 'request_id': 'req-e9a77e7d-aa02-4ef0-9302-1fb44b2f8a66'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:49.778621 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-e9a77e7d-aa02-4ef0-9302-1fb44b2f8a66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb3af7b1a3964f06ae7a79f8ced4890f', 'request_id': 'req-e9a77e7d-aa02-4ef0-9302-1fb44b2f8a66'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:49.787642 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-e9a77e7d-aa02-4ef0-9302-1fb44b2f8a66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb3af7b1a3964f06ae7a79f8ced4890f', 'request_id': 'req-e9a77e7d-aa02-4ef0-9302-1fb44b2f8a66'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:49.798731 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-e9a77e7d-aa02-4ef0-9302-1fb44b2f8a66 admin admin] The token cache is being invalidate because project bb3af7b1a3964f06ae7a79f8ced4890f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79961) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 07:16:49.799042 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-e9a77e7d-aa02-4ef0-9302-1fb44b2f8a66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:49.799778 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-e9a77e7d-aa02-4ef0-9302-1fb44b2f8a66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:49.801513 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1038/2075] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Mar 30 07:16:49 2022] DELETE /identity/v3/projects/bb3af7b1a3964f06ae7a79f8ced4890f => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:16:49.807734 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4864e0a-99a6-4c72-87a3-c64ede421570 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:49.808263 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4864e0a-99a6-4c72-87a3-c64ede421570 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:49.808343 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4864e0a-99a6-4c72-87a3-c64ede421570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:49.827417 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-a4864e0a-99a6-4c72-87a3-c64ede421570 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:16:49.828710 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-a4864e0a-99a6-4c72-87a3-c64ede421570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:49.894580 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1038/2076] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:16:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:16:49.904120 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b01e3b8-fa8e-477d-bec5-008ccbb48fab None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:49.904488 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b01e3b8-fa8e-477d-bec5-008ccbb48fab None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:49.904839 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b01e3b8-fa8e-477d-bec5-008ccbb48fab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:49.925219 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-0b01e3b8-fa8e-477d-bec5-008ccbb48fab None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:16:49.926847 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-0b01e3b8-fa8e-477d-bec5-008ccbb48fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:49.937788 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1039/2077] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:16:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:16:49.942240 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4864e0a-99a6-4c72-87a3-c64ede421570 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:49.953528 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4864e0a-99a6-4c72-87a3-c64ede421570 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:49.960189 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effca9a7-7174-4f2c-8e89-07962d769587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:49.961160 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effca9a7-7174-4f2c-8e89-07962d769587 admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:49.961451 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effca9a7-7174-4f2c-8e89-07962d769587 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:49.961736 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effca9a7-7174-4f2c-8e89-07962d769587 admin admin] PATH_INFO: `/v3/domains` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:49.962899 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effca9a7-7174-4f2c-8e89-07962d769587 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:16:49.963209 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effca9a7-7174-4f2c-8e89-07962d769587 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:49.965190 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effca9a7-7174-4f2c-8e89-07962d769587 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:49.979142 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1039/2078] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Mar 30 07:16:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:16:49.984199 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b01e3b8-fa8e-477d-bec5-008ccbb48fab None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:49.998384 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b01e3b8-fa8e-477d-bec5-008ccbb48fab None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:50.006615 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b742dae1-1418-46ed-a3a8-199e12ab6d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:50.009225 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b742dae1-1418-46ed-a3a8-199e12ab6d86 admin admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:50.009524 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b742dae1-1418-46ed-a3a8-199e12ab6d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:50.009798 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b742dae1-1418-46ed-a3a8-199e12ab6d86 admin admin] PATH_INFO: `/v3/projects` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:50.010512 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b742dae1-1418-46ed-a3a8-199e12ab6d86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:50.012474 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b742dae1-1418-46ed-a3a8-199e12ab6d86 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:50.042629 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1040/2079] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Mar 30 07:16:49 2022] POST /identity/v3/projects => generated 381 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 07:16:50.048008 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effca9a7-7174-4f2c-8e89-07962d769587 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:50.062939 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effca9a7-7174-4f2c-8e89-07962d769587 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:50.125537 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5231899d-fa41-4435-843e-1725823ed9fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:50.126218 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231899d-fa41-4435-843e-1725823ed9fc admin admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:50.126497 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231899d-fa41-4435-843e-1725823ed9fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:50.126755 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231899d-fa41-4435-843e-1725823ed9fc admin admin] PATH_INFO: `/v3/users` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:50.127441 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5231899d-fa41-4435-843e-1725823ed9fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:50.129373 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5231899d-fa41-4435-843e-1725823ed9fc admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:50.154679 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1040/2080] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Mar 30 07:16:50 2022] POST /identity/v3/users => generated 291 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 07:16:50.155943 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b742dae1-1418-46ed-a3a8-199e12ab6d86 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:50.167022 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b742dae1-1418-46ed-a3a8-199e12ab6d86 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:50.172782 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a21595-7b02-47ce-9588-610db7d316ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:50.173537 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a21595-7b02-47ce-9588-610db7d316ee admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:50.173827 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a21595-7b02-47ce-9588-610db7d316ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:50.174096 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a21595-7b02-47ce-9588-610db7d316ee admin admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:50.174864 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a21595-7b02-47ce-9588-610db7d316ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:50.176801 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a21595-7b02-47ce-9588-610db7d316ee admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:50.189740 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1041/2081] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:16:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:16:50.194011 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5231899d-fa41-4435-843e-1725823ed9fc admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:50.204829 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5231899d-fa41-4435-843e-1725823ed9fc admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:50.211691 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1114a92-fe2b-4ab4-af71-a29da3f50435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:50.216193 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1114a92-fe2b-4ab4-af71-a29da3f50435 admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:50.216612 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1114a92-fe2b-4ab4-af71-a29da3f50435 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:50.217338 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1114a92-fe2b-4ab4-af71-a29da3f50435 admin admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:50.218127 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1114a92-fe2b-4ab4-af71-a29da3f50435 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:50.220067 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1114a92-fe2b-4ab4-af71-a29da3f50435 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:50.234032 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1041/2082] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:16:50 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:16:50.238738 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a21595-7b02-47ce-9588-610db7d316ee admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:50.251097 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a21595-7b02-47ce-9588-610db7d316ee admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:50.255837 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5937bef-b0bf-44f4-b55b-ddefddaa48ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:50.256721 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5937bef-b0bf-44f4-b55b-ddefddaa48ce admin admin] REQUEST_METHOD: `PUT` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:50.257001 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5937bef-b0bf-44f4-b55b-ddefddaa48ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:50.257379 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5937bef-b0bf-44f4-b55b-ddefddaa48ce admin admin] PATH_INFO: `/v3/projects/6b4cdf457c4a420ca4ea8b2b00ff49a2/users/e926b4fcdad04ac1a82858a02afa9321/roles/5d79031a64754b57ba120367465e2252` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:50.274680 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5937bef-b0bf-44f4-b55b-ddefddaa48ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b4cdf457c4a420ca4ea8b2b00ff49a2, user_id=e926b4fcdad04ac1a82858a02afa9321, role_id=5d79031a64754b57ba120367465e2252)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:50.278689 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5937bef-b0bf-44f4-b55b-ddefddaa48ce admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:50.292067 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1042/2083] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:16:50 2022] PUT /identity/v3/projects/6b4cdf457c4a420ca4ea8b2b00ff49a2/users/e926b4fcdad04ac1a82858a02afa9321/roles/5d79031a64754b57ba120367465e2252 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:16:50.303893 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cfa136-20ae-410c-bb38-aa6321029829 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:50.304377 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cfa136-20ae-410c-bb38-aa6321029829 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:50.304908 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cfa136-20ae-410c-bb38-aa6321029829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:50.331873 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-81cfa136-20ae-410c-bb38-aa6321029829 None None] MFA Rules not processed for user `e926b4fcdad04ac1a82858a02afa9321`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:16:50.333013 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-81cfa136-20ae-410c-bb38-aa6321029829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:50.407399 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1042/2084] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:16:50 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:16:50.411826 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5937bef-b0bf-44f4-b55b-ddefddaa48ce admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:50.503698 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5937bef-b0bf-44f4-b55b-ddefddaa48ce admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:50.508480 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e79ce5a-011c-425e-8755-b23787f94a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:50.509141 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e79ce5a-011c-425e-8755-b23787f94a65 admin admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:50.509418 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e79ce5a-011c-425e-8755-b23787f94a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:50.509687 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e79ce5a-011c-425e-8755-b23787f94a65 admin admin] PATH_INFO: `/v3/projects` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:50.510408 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e79ce5a-011c-425e-8755-b23787f94a65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:50.512341 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e79ce5a-011c-425e-8755-b23787f94a65 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:50.541623 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1043/2085] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Mar 30 07:16:50 2022] POST /identity/v3/projects => generated 379 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:16:50.542867 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cfa136-20ae-410c-bb38-aa6321029829 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:50.553757 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cfa136-20ae-410c-bb38-aa6321029829 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:50.615921 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f4fdb3-a9fb-4105-b82c-848c197cb5e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:50.616653 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f4fdb3-a9fb-4105-b82c-848c197cb5e4 admin admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:50.617102 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f4fdb3-a9fb-4105-b82c-848c197cb5e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:50.617558 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f4fdb3-a9fb-4105-b82c-848c197cb5e4 admin admin] PATH_INFO: `/v3/users` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:50.618259 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f4fdb3-a9fb-4105-b82c-848c197cb5e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:50.620270 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f4fdb3-a9fb-4105-b82c-848c197cb5e4 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:50.644429 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1043/2086] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Mar 30 07:16:50 2022] POST /identity/v3/users => generated 296 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 07:16:50.648947 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e79ce5a-011c-425e-8755-b23787f94a65 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:50.659626 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e79ce5a-011c-425e-8755-b23787f94a65 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:50.665638 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d5cfa1-bb8a-475a-86c3-d5414465958e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:50.666557 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d5cfa1-bb8a-475a-86c3-d5414465958e admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:50.666846 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d5cfa1-bb8a-475a-86c3-d5414465958e admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:50.667253 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d5cfa1-bb8a-475a-86c3-d5414465958e admin admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:50.668224 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d5cfa1-bb8a-475a-86c3-d5414465958e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:50.670137 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d5cfa1-bb8a-475a-86c3-d5414465958e admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:50.681718 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1044/2087] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:16:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:16:50.686757 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f4fdb3-a9fb-4105-b82c-848c197cb5e4 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:50.699980 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f4fdb3-a9fb-4105-b82c-848c197cb5e4 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:50.705223 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe131d9-cfbc-422b-96f4-d5beb8eea138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:50.706116 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe131d9-cfbc-422b-96f4-d5beb8eea138 admin admin] REQUEST_METHOD: `PUT` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:50.706421 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe131d9-cfbc-422b-96f4-d5beb8eea138 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:50.706695 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe131d9-cfbc-422b-96f4-d5beb8eea138 admin admin] PATH_INFO: `/v3/projects/ca1438bd79f04ef8bca7e534e873c0e5/users/3bccae6a7a484ac5943733a1010f3bbe/roles/1c39b9ab8cfd4c0ea71845831920a845` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:50.722922 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe131d9-cfbc-422b-96f4-d5beb8eea138 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca1438bd79f04ef8bca7e534e873c0e5, user_id=3bccae6a7a484ac5943733a1010f3bbe, role_id=1c39b9ab8cfd4c0ea71845831920a845)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:50.725802 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe131d9-cfbc-422b-96f4-d5beb8eea138 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:50.741584 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1044/2088] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:16:50 2022] PUT /identity/v3/projects/ca1438bd79f04ef8bca7e534e873c0e5/users/3bccae6a7a484ac5943733a1010f3bbe/roles/1c39b9ab8cfd4c0ea71845831920a845 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:16:50.745881 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d5cfa1-bb8a-475a-86c3-d5414465958e admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:50.755852 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d5cfa1-bb8a-475a-86c3-d5414465958e admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:50.804613 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe131d9-cfbc-422b-96f4-d5beb8eea138 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:50.806878 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-efe131d9-cfbc-422b-96f4-d5beb8eea138 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:50.820510 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754f071e-53df-4212-9111-2f2c3527e7c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:50.821180 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754f071e-53df-4212-9111-2f2c3527e7c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:50.821458 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754f071e-53df-4212-9111-2f2c3527e7c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:50.821724 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754f071e-53df-4212-9111-2f2c3527e7c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:50.822446 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754f071e-53df-4212-9111-2f2c3527e7c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:50.824091 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754f071e-53df-4212-9111-2f2c3527e7c8 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:50.834065 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1045/2089] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:16:50 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:16:50.838645 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754f071e-53df-4212-9111-2f2c3527e7c8 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:50.848634 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754f071e-53df-4212-9111-2f2c3527e7c8 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:50.854196 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af96814d-fc9a-497c-b603-b1336411a6c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:50.855094 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af96814d-fc9a-497c-b603-b1336411a6c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:50.855509 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af96814d-fc9a-497c-b603-b1336411a6c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:50.855789 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af96814d-fc9a-497c-b603-b1336411a6c9 admin admin] PATH_INFO: `/v3/projects/ca1438bd79f04ef8bca7e534e873c0e5/users/3bccae6a7a484ac5943733a1010f3bbe/roles/1c39b9ab8cfd4c0ea71845831920a845` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:50.861258 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af96814d-fc9a-497c-b603-b1336411a6c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca1438bd79f04ef8bca7e534e873c0e5, user_id=3bccae6a7a484ac5943733a1010f3bbe, role_id=1c39b9ab8cfd4c0ea71845831920a845)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:50.864010 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af96814d-fc9a-497c-b603-b1336411a6c9 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:50.874318 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe131d9-cfbc-422b-96f4-d5beb8eea138 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:50.876141 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1046/2090] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:16:50 2022] PUT /identity/v3/projects/ca1438bd79f04ef8bca7e534e873c0e5/users/3bccae6a7a484ac5943733a1010f3bbe/roles/1c39b9ab8cfd4c0ea71845831920a845 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:16:50.886662 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8414eadc-f6dc-4648-88ff-bed7f93c0628 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:50.886964 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8414eadc-f6dc-4648-88ff-bed7f93c0628 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:50.887247 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8414eadc-f6dc-4648-88ff-bed7f93c0628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:50.915230 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-8414eadc-f6dc-4648-88ff-bed7f93c0628 None None] MFA Rules not processed for user `3bccae6a7a484ac5943733a1010f3bbe`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:16:50.916635 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-8414eadc-f6dc-4648-88ff-bed7f93c0628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:50.933980 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c420734b-db85-4079-bb2b-eb41948fde2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:50.935008 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c420734b-db85-4079-bb2b-eb41948fde2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:50.935362 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c420734b-db85-4079-bb2b-eb41948fde2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:50.935697 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c420734b-db85-4079-bb2b-eb41948fde2e admin admin] PATH_INFO: `/v3/users/a601c4c65cec4936a3b83d34f1e8d3cc` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:50.937121 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c420734b-db85-4079-bb2b-eb41948fde2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a601c4c65cec4936a3b83d34f1e8d3cc)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:50.940107 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c420734b-db85-4079-bb2b-eb41948fde2e admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:50.996431 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1047/2091] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:16:50 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:16:50.997976 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-c420734b-db85-4079-bb2b-eb41948fde2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a601c4c65cec4936a3b83d34f1e8d3cc'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:50.998667 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-c420734b-db85-4079-bb2b-eb41948fde2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a601c4c65cec4936a3b83d34f1e8d3cc'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:51.005649 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8414eadc-f6dc-4648-88ff-bed7f93c0628 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:51.007041 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-8414eadc-f6dc-4648-88ff-bed7f93c0628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:51.009029 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-c420734b-db85-4079-bb2b-eb41948fde2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a601c4c65cec4936a3b83d34f1e8d3cc'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:51.024308 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-c420734b-db85-4079-bb2b-eb41948fde2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a601c4c65cec4936a3b83d34f1e8d3cc'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:51.025357 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-c420734b-db85-4079-bb2b-eb41948fde2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a601c4c65cec4936a3b83d34f1e8d3cc'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:51.038519 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1045/2092] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Mar 30 07:16:50 2022] DELETE /identity/v3/users/a601c4c65cec4936a3b83d34f1e8d3cc => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:16:51.043287 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0d0009-8fb4-48c9-8e3b-05d42e796b37 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:51.044051 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0d0009-8fb4-48c9-8e3b-05d42e796b37 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:51.044475 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0d0009-8fb4-48c9-8e3b-05d42e796b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:51.062819 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-ff0d0009-8fb4-48c9-8e3b-05d42e796b37 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:16:51.064172 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-ff0d0009-8fb4-48c9-8e3b-05d42e796b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:51.074631 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8414eadc-f6dc-4648-88ff-bed7f93c0628 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:51.125188 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1046/2093] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:16:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:16:51.132397 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4c48fd-305e-4ed2-baf2-4f4e87d5440a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e2fda180e8d448d895c40cdad34bc4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:51.133145 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c48fd-305e-4ed2-baf2-4f4e87d5440a service cinder] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:51.133537 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c48fd-305e-4ed2-baf2-4f4e87d5440a service cinder] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:51.133901 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c48fd-305e-4ed2-baf2-4f4e87d5440a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:51.136330 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0d0009-8fb4-48c9-8e3b-05d42e796b37 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:51.137755 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-ff0d0009-8fb4-48c9-8e3b-05d42e796b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:51.141770 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-be4c48fd-305e-4ed2-baf2-4f4e87d5440a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:51.196798 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0d0009-8fb4-48c9-8e3b-05d42e796b37 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:51.209489 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b62f0db-e6eb-46aa-a425-81619dd33403 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3802cb341445f994b9204744060ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:51.210220 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b62f0db-e6eb-46aa-a425-81619dd33403 service neutron] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:51.210645 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b62f0db-e6eb-46aa-a425-81619dd33403 service neutron] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:51.210965 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b62f0db-e6eb-46aa-a425-81619dd33403 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:51.221862 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b62f0db-e6eb-46aa-a425-81619dd33403 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:51.224290 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b62f0db-e6eb-46aa-a425-81619dd33403 service neutron] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:51.229633 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4c48fd-305e-4ed2-baf2-4f4e87d5440a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:51.231983 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4c48fd-305e-4ed2-baf2-4f4e87d5440a service cinder] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:51.233799 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1047/2094] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:16:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 30 07:16:51.245045 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1048/2095] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:16:51 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 30 07:16:51.535380 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b62f0db-e6eb-46aa-a425-81619dd33403 service neutron] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:51.536856 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-6b62f0db-e6eb-46aa-a425-81619dd33403 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:51.559478 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b62f0db-e6eb-46aa-a425-81619dd33403 service neutron] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:51.572016 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d217c77f-7fee-4d1f-8c42-8e422323d813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:51.572899 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d217c77f-7fee-4d1f-8c42-8e422323d813 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:51.573177 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d217c77f-7fee-4d1f-8c42-8e422323d813 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:51.573501 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d217c77f-7fee-4d1f-8c42-8e422323d813 admin admin] PATH_INFO: `/v3/projects/9c0e413ae9784525a486e41173a1b27b` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:51.575845 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d217c77f-7fee-4d1f-8c42-8e422323d813 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c0e413ae9784525a486e41173a1b27b)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:51.577750 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d217c77f-7fee-4d1f-8c42-8e422323d813 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:51.640375 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-d217c77f-7fee-4d1f-8c42-8e422323d813 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c0e413ae9784525a486e41173a1b27b', 'request_id': 'req-d217c77f-7fee-4d1f-8c42-8e422323d813'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:51.648244 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-d217c77f-7fee-4d1f-8c42-8e422323d813 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c0e413ae9784525a486e41173a1b27b', 'request_id': 'req-d217c77f-7fee-4d1f-8c42-8e422323d813'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:51.655223 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-d217c77f-7fee-4d1f-8c42-8e422323d813 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c0e413ae9784525a486e41173a1b27b', 'request_id': 'req-d217c77f-7fee-4d1f-8c42-8e422323d813'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:51.667469 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-d217c77f-7fee-4d1f-8c42-8e422323d813 admin admin] The token cache is being invalidate because project 9c0e413ae9784525a486e41173a1b27b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79960) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 07:16:51.667771 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-d217c77f-7fee-4d1f-8c42-8e422323d813 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:51.669091 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-d217c77f-7fee-4d1f-8c42-8e422323d813 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:51.670965 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1048/2096] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Mar 30 07:16:51 2022] DELETE /identity/v3/projects/9c0e413ae9784525a486e41173a1b27b => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:16:51.676580 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b856f-e453-425e-8290-f63985678406 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:51.677556 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b856f-e453-425e-8290-f63985678406 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:51.678069 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b856f-e453-425e-8290-f63985678406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:51.698533 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-7c0b856f-e453-425e-8290-f63985678406 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:16:51.699780 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d217c77f-7fee-4d1f-8c42-8e422323d813 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:51.700656 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-7c0b856f-e453-425e-8290-f63985678406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:51.701243 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-d217c77f-7fee-4d1f-8c42-8e422323d813 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:51.767885 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1049/2097] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:16:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:16:51.773184 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d217c77f-7fee-4d1f-8c42-8e422323d813 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:51.776057 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf47544d-5811-4984-ab3d-dff226601ee4 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:51.776462 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf47544d-5811-4984-ab3d-dff226601ee4 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:51.776836 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf47544d-5811-4984-ab3d-dff226601ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:51.778664 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6999aadf-24a8-454d-86ee-892a5fad5423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:51.779615 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6999aadf-24a8-454d-86ee-892a5fad5423 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:51.779998 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6999aadf-24a8-454d-86ee-892a5fad5423 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:51.780340 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6999aadf-24a8-454d-86ee-892a5fad5423 admin admin] PATH_INFO: `/v3/users/e926b4fcdad04ac1a82858a02afa9321` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:51.781724 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6999aadf-24a8-454d-86ee-892a5fad5423 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e926b4fcdad04ac1a82858a02afa9321)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:51.783789 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6999aadf-24a8-454d-86ee-892a5fad5423 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:51.795715 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-bf47544d-5811-4984-ab3d-dff226601ee4 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:16:51.797156 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-bf47544d-5811-4984-ab3d-dff226601ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:51.806877 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1050/2098] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:16:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 07:16:51.811270 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf47544d-5811-4984-ab3d-dff226601ee4 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:51.821759 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf47544d-5811-4984-ab3d-dff226601ee4 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:51.826630 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8399aca-3f55-4664-8373-15212ccc85e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:51.827487 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8399aca-3f55-4664-8373-15212ccc85e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:51.827943 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8399aca-3f55-4664-8373-15212ccc85e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:51.828401 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8399aca-3f55-4664-8373-15212ccc85e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:51.829968 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8399aca-3f55-4664-8373-15212ccc85e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:16:51.830372 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8399aca-3f55-4664-8373-15212ccc85e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:51.832392 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8399aca-3f55-4664-8373-15212ccc85e5 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:51.847765 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-6999aadf-24a8-454d-86ee-892a5fad5423 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e926b4fcdad04ac1a82858a02afa9321'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:51.848907 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1051/2099] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Mar 30 07:16:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:16:51.852242 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-6999aadf-24a8-454d-86ee-892a5fad5423 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e926b4fcdad04ac1a82858a02afa9321'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:51.853649 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8399aca-3f55-4664-8373-15212ccc85e5 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:51.855427 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-f8399aca-3f55-4664-8373-15212ccc85e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:51.870369 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8399aca-3f55-4664-8373-15212ccc85e5 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:51.872126 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-6999aadf-24a8-454d-86ee-892a5fad5423 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e926b4fcdad04ac1a82858a02afa9321'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:51.875626 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4b1ac1-95f1-41d3-b34c-d9a316e21a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:51.876340 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4b1ac1-95f1-41d3-b34c-d9a316e21a0c admin admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:51.876672 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4b1ac1-95f1-41d3-b34c-d9a316e21a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:51.876939 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4b1ac1-95f1-41d3-b34c-d9a316e21a0c admin admin] PATH_INFO: `/v3/projects` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:51.877671 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4b1ac1-95f1-41d3-b34c-d9a316e21a0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:51.880935 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4b1ac1-95f1-41d3-b34c-d9a316e21a0c admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:51.890695 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-6999aadf-24a8-454d-86ee-892a5fad5423 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e926b4fcdad04ac1a82858a02afa9321'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:51.891567 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-6999aadf-24a8-454d-86ee-892a5fad5423 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e926b4fcdad04ac1a82858a02afa9321'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:51.911023 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1049/2100] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Mar 30 07:16:51 2022] DELETE /identity/v3/users/e926b4fcdad04ac1a82858a02afa9321 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 07:16:51.916969 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7613be25-f860-489b-a76d-e4e1eb0b73b2 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:51.917451 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7613be25-f860-489b-a76d-e4e1eb0b73b2 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:51.917691 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7613be25-f860-489b-a76d-e4e1eb0b73b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:51.920107 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1052/2101] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Mar 30 07:16:51 2022] POST /identity/v3/projects => generated 385 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 07:16:51.924719 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4b1ac1-95f1-41d3-b34c-d9a316e21a0c admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:51.941191 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-7613be25-f860-489b-a76d-e4e1eb0b73b2 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:16:51.942659 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-7613be25-f860-489b-a76d-e4e1eb0b73b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:52.013119 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1050/2102] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:16:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 07:16:52.016388 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4b1ac1-95f1-41d3-b34c-d9a316e21a0c admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:52.020798 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c456c63-9aed-416d-840c-86cfe441d659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:52.021477 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c456c63-9aed-416d-840c-86cfe441d659 admin admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:52.021755 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c456c63-9aed-416d-840c-86cfe441d659 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:52.022150 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c456c63-9aed-416d-840c-86cfe441d659 admin admin] PATH_INFO: `/v3/users` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:52.022899 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c456c63-9aed-416d-840c-86cfe441d659 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:52.025013 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7613be25-f860-489b-a76d-e4e1eb0b73b2 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:52.025181 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c456c63-9aed-416d-840c-86cfe441d659 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:52.027066 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-7613be25-f860-489b-a76d-e4e1eb0b73b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:52.052613 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1053/2103] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Mar 30 07:16:51 2022] POST /identity/v3/users => generated 293 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:16:52.053677 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c456c63-9aed-416d-840c-86cfe441d659 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:52.063627 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c456c63-9aed-416d-840c-86cfe441d659 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:52.068339 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eb2bcc-24b5-4816-81a2-8de56ade9a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:52.068984 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb2bcc-24b5-4816-81a2-8de56ade9a7d admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:52.069256 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb2bcc-24b5-4816-81a2-8de56ade9a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:52.069524 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb2bcc-24b5-4816-81a2-8de56ade9a7d admin admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:52.070515 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eb2bcc-24b5-4816-81a2-8de56ade9a7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:52.072120 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eb2bcc-24b5-4816-81a2-8de56ade9a7d admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:52.085170 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1054/2104] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:16:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 30 07:16:52.086317 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eb2bcc-24b5-4816-81a2-8de56ade9a7d admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:52.087110 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7613be25-f860-489b-a76d-e4e1eb0b73b2 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:52.090890 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090232da-b129-402c-a82e-8a321cc15416 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3802cb341445f994b9204744060ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:52.091570 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090232da-b129-402c-a82e-8a321cc15416 service neutron] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:52.091864 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090232da-b129-402c-a82e-8a321cc15416 service neutron] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:52.092143 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090232da-b129-402c-a82e-8a321cc15416 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:52.096388 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eb2bcc-24b5-4816-81a2-8de56ade9a7d admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:52.101342 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39d7326-4cd0-4236-be45-e7862eb08aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:52.101909 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090232da-b129-402c-a82e-8a321cc15416 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:52.102262 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d7326-4cd0-4236-be45-e7862eb08aa4 admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:52.102544 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d7326-4cd0-4236-be45-e7862eb08aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:52.102815 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d7326-4cd0-4236-be45-e7862eb08aa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:52.103334 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090232da-b129-402c-a82e-8a321cc15416 service neutron] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:52.103531 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39d7326-4cd0-4236-be45-e7862eb08aa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:52.105155 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39d7326-4cd0-4236-be45-e7862eb08aa4 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:52.113436 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1051/2105] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:16:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:16:52.115602 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1055/2106] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:16:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 30 07:16:52.119884 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090232da-b129-402c-a82e-8a321cc15416 service neutron] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:52.129105 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090232da-b129-402c-a82e-8a321cc15416 service neutron] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:52.134088 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc1ecea-b069-4ead-92c3-b0f2c5e09e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:52.134998 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1ecea-b069-4ead-92c3-b0f2c5e09e5b admin admin] REQUEST_METHOD: `PUT` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:52.135279 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1ecea-b069-4ead-92c3-b0f2c5e09e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:52.135665 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1ecea-b069-4ead-92c3-b0f2c5e09e5b admin admin] PATH_INFO: `/v3/projects/896d06d0e7e04443972a84eb4faf4bc2/users/c4c81aa4c27b4e59988edac398336da0/roles/5d79031a64754b57ba120367465e2252` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:52.151905 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc1ecea-b069-4ead-92c3-b0f2c5e09e5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=896d06d0e7e04443972a84eb4faf4bc2, user_id=c4c81aa4c27b4e59988edac398336da0, role_id=5d79031a64754b57ba120367465e2252)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:52.154539 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc1ecea-b069-4ead-92c3-b0f2c5e09e5b admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:52.170458 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1052/2107] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:16:52 2022] PUT /identity/v3/projects/896d06d0e7e04443972a84eb4faf4bc2/users/c4c81aa4c27b4e59988edac398336da0/roles/5d79031a64754b57ba120367465e2252 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:16:52.182207 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9864956e-1657-4f63-a922-465966758f5b None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:52.182633 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9864956e-1657-4f63-a922-465966758f5b None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:52.182966 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9864956e-1657-4f63-a922-465966758f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:52.212371 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-9864956e-1657-4f63-a922-465966758f5b None None] MFA Rules not processed for user `c4c81aa4c27b4e59988edac398336da0`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:16:52.213742 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-9864956e-1657-4f63-a922-465966758f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:52.284467 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1056/2108] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:16:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:16:52.289108 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc1ecea-b069-4ead-92c3-b0f2c5e09e5b admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:52.359954 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc1ecea-b069-4ead-92c3-b0f2c5e09e5b admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:52.368496 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5b58b7-caf9-4d33-9860-e92063ca1da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:52.369168 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b58b7-caf9-4d33-9860-e92063ca1da5 admin admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:52.369443 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b58b7-caf9-4d33-9860-e92063ca1da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:52.369733 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b58b7-caf9-4d33-9860-e92063ca1da5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:52.370435 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5b58b7-caf9-4d33-9860-e92063ca1da5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:52.372368 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5b58b7-caf9-4d33-9860-e92063ca1da5 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:52.399955 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9864956e-1657-4f63-a922-465966758f5b None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:52.401521 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-9864956e-1657-4f63-a922-465966758f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:52.411888 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1053/2109] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Mar 30 07:16:52 2022] POST /identity/v3/projects => generated 385 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:16:52.414799 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5b58b7-caf9-4d33-9860-e92063ca1da5 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:52.428342 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9864956e-1657-4f63-a922-465966758f5b None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:52.482405 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5b58b7-caf9-4d33-9860-e92063ca1da5 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:52.487027 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f61015-f35a-47b1-8f21-61e115ec6610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:52.487705 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f61015-f35a-47b1-8f21-61e115ec6610 admin admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:52.488013 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f61015-f35a-47b1-8f21-61e115ec6610 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:52.488289 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f61015-f35a-47b1-8f21-61e115ec6610 admin admin] PATH_INFO: `/v3/users` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:52.488976 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f61015-f35a-47b1-8f21-61e115ec6610 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:52.490887 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f61015-f35a-47b1-8f21-61e115ec6610 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:52.495889 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac7cb89-cc86-45d5-bd58-e0a095bd302f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:52.496866 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac7cb89-cc86-45d5-bd58-e0a095bd302f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:52.497146 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac7cb89-cc86-45d5-bd58-e0a095bd302f admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:52.497422 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac7cb89-cc86-45d5-bd58-e0a095bd302f admin admin] PATH_INFO: `/v3/projects/6b4cdf457c4a420ca4ea8b2b00ff49a2` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:52.498689 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac7cb89-cc86-45d5-bd58-e0a095bd302f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b4cdf457c4a420ca4ea8b2b00ff49a2)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:52.500658 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac7cb89-cc86-45d5-bd58-e0a095bd302f admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:52.514578 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1054/2110] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Mar 30 07:16:52 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:16:52.521133 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f61015-f35a-47b1-8f21-61e115ec6610 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:52.532455 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f61015-f35a-47b1-8f21-61e115ec6610 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:52.537823 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e672eae9-bcde-4d14-a67a-7632e8b3c175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:52.538650 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e672eae9-bcde-4d14-a67a-7632e8b3c175 admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:52.538932 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e672eae9-bcde-4d14-a67a-7632e8b3c175 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:52.539223 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e672eae9-bcde-4d14-a67a-7632e8b3c175 admin admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:52.539963 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e672eae9-bcde-4d14-a67a-7632e8b3c175 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:52.541591 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e672eae9-bcde-4d14-a67a-7632e8b3c175 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:52.551647 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1055/2111] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:16:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 30 07:16:52.553172 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-1ac7cb89-cc86-45d5-bd58-e0a095bd302f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b4cdf457c4a420ca4ea8b2b00ff49a2', 'request_id': 'req-1ac7cb89-cc86-45d5-bd58-e0a095bd302f'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:52.555799 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e672eae9-bcde-4d14-a67a-7632e8b3c175 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:52.558974 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-1ac7cb89-cc86-45d5-bd58-e0a095bd302f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b4cdf457c4a420ca4ea8b2b00ff49a2', 'request_id': 'req-1ac7cb89-cc86-45d5-bd58-e0a095bd302f'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:52.565171 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e672eae9-bcde-4d14-a67a-7632e8b3c175 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:52.567626 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-1ac7cb89-cc86-45d5-bd58-e0a095bd302f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b4cdf457c4a420ca4ea8b2b00ff49a2', 'request_id': 'req-1ac7cb89-cc86-45d5-bd58-e0a095bd302f'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:52.579029 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-1ac7cb89-cc86-45d5-bd58-e0a095bd302f admin admin] The token cache is being invalidate because project 6b4cdf457c4a420ca4ea8b2b00ff49a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79961) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 07:16:52.579314 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-1ac7cb89-cc86-45d5-bd58-e0a095bd302f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:52.579989 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-1ac7cb89-cc86-45d5-bd58-e0a095bd302f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:52.581756 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1057/2112] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Mar 30 07:16:52 2022] DELETE /identity/v3/projects/6b4cdf457c4a420ca4ea8b2b00ff49a2 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 07:16:52.585825 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac7cb89-cc86-45d5-bd58-e0a095bd302f admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:52.587148 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-1ac7cb89-cc86-45d5-bd58-e0a095bd302f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:52.621251 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8900f5-a3fb-4bce-a045-62f09bc229ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:52.621923 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8900f5-a3fb-4bce-a045-62f09bc229ee admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:52.622202 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8900f5-a3fb-4bce-a045-62f09bc229ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:52.622471 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8900f5-a3fb-4bce-a045-62f09bc229ee admin admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:52.623186 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8900f5-a3fb-4bce-a045-62f09bc229ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:52.624815 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8900f5-a3fb-4bce-a045-62f09bc229ee admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:52.636470 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1056/2113] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:16:52 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:16:52.640403 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8900f5-a3fb-4bce-a045-62f09bc229ee admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:52.642107 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-3b8900f5-a3fb-4bce-a045-62f09bc229ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:52.654032 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac7cb89-cc86-45d5-bd58-e0a095bd302f admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:52.654878 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8900f5-a3fb-4bce-a045-62f09bc229ee admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:52.659604 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b533e46f-7cc1-4d80-84ba-ed41c434323f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:52.660592 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b533e46f-7cc1-4d80-84ba-ed41c434323f admin admin] REQUEST_METHOD: `PUT` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:52.660840 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20128c23-5c48-4ab4-8b75-6e7df8bba09e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:52.660997 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b533e46f-7cc1-4d80-84ba-ed41c434323f admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:52.661307 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b533e46f-7cc1-4d80-84ba-ed41c434323f admin admin] PATH_INFO: `/v3/projects/13b91594a5674456b500208ea7a30b46/users/6200790ab91e4149a0f9cec846c3a56d/roles/5d79031a64754b57ba120367465e2252` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:52.661724 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20128c23-5c48-4ab4-8b75-6e7df8bba09e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:52.662005 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20128c23-5c48-4ab4-8b75-6e7df8bba09e admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:52.662537 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20128c23-5c48-4ab4-8b75-6e7df8bba09e admin admin] PATH_INFO: `/v3/users/3bccae6a7a484ac5943733a1010f3bbe` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:52.664561 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20128c23-5c48-4ab4-8b75-6e7df8bba09e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bccae6a7a484ac5943733a1010f3bbe)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:52.666828 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20128c23-5c48-4ab4-8b75-6e7df8bba09e admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:52.677906 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b533e46f-7cc1-4d80-84ba-ed41c434323f admin admin] RBAC: Authorizing `identity:create_grant(project_id=13b91594a5674456b500208ea7a30b46, user_id=6200790ab91e4149a0f9cec846c3a56d, role_id=5d79031a64754b57ba120367465e2252)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:52.681038 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b533e46f-7cc1-4d80-84ba-ed41c434323f admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:52.698444 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1057/2114] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:16:52 2022] PUT /identity/v3/projects/13b91594a5674456b500208ea7a30b46/users/6200790ab91e4149a0f9cec846c3a56d/roles/5d79031a64754b57ba120367465e2252 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 07:16:52.708779 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b83bf9b-52e5-47dc-b7f1-3aaa38c9c0aa None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:52.709068 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b83bf9b-52e5-47dc-b7f1-3aaa38c9c0aa None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:52.709341 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b83bf9b-52e5-47dc-b7f1-3aaa38c9c0aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:52.724174 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-20128c23-5c48-4ab4-8b75-6e7df8bba09e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bccae6a7a484ac5943733a1010f3bbe'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:52.724870 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-20128c23-5c48-4ab4-8b75-6e7df8bba09e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bccae6a7a484ac5943733a1010f3bbe'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:52.725771 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-20128c23-5c48-4ab4-8b75-6e7df8bba09e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bccae6a7a484ac5943733a1010f3bbe'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:52.736819 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-20128c23-5c48-4ab4-8b75-6e7df8bba09e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bccae6a7a484ac5943733a1010f3bbe'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:52.737671 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-6b83bf9b-52e5-47dc-b7f1-3aaa38c9c0aa None None] MFA Rules not processed for user `6200790ab91e4149a0f9cec846c3a56d`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:16:52.738878 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-6b83bf9b-52e5-47dc-b7f1-3aaa38c9c0aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:52.745750 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-20128c23-5c48-4ab4-8b75-6e7df8bba09e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bccae6a7a484ac5943733a1010f3bbe'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:52.769594 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1058/2115] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Mar 30 07:16:52 2022] DELETE /identity/v3/users/3bccae6a7a484ac5943733a1010f3bbe => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 07:16:52.812775 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1058/2116] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:16:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 07:16:52.817367 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20128c23-5c48-4ab4-8b75-6e7df8bba09e admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:52.818855 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-20128c23-5c48-4ab4-8b75-6e7df8bba09e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:52.884543 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20128c23-5c48-4ab4-8b75-6e7df8bba09e admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:52.889188 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c92f54-9e88-4237-a475-ebac59e08772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:52.889971 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c92f54-9e88-4237-a475-ebac59e08772 admin admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:52.890248 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c92f54-9e88-4237-a475-ebac59e08772 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:52.890518 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c92f54-9e88-4237-a475-ebac59e08772 admin admin] PATH_INFO: `/v3/projects` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:52.891217 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c92f54-9e88-4237-a475-ebac59e08772 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:52.893159 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c92f54-9e88-4237-a475-ebac59e08772 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:52.920349 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1059/2117] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Mar 30 07:16:52 2022] POST /identity/v3/projects => generated 385 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:16:52.924341 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b83bf9b-52e5-47dc-b7f1-3aaa38c9c0aa None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:52.997440 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b83bf9b-52e5-47dc-b7f1-3aaa38c9c0aa None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:53.073412 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803bce19-d84e-4e07-a907-4d3697e9890b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:53.073412 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803bce19-d84e-4e07-a907-4d3697e9890b admin admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:53.073412 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803bce19-d84e-4e07-a907-4d3697e9890b admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:53.073786 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803bce19-d84e-4e07-a907-4d3697e9890b admin admin] PATH_INFO: `/v3/users` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:53.074548 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803bce19-d84e-4e07-a907-4d3697e9890b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:53.075426 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c92f54-9e88-4237-a475-ebac59e08772 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:53.076802 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803bce19-d84e-4e07-a907-4d3697e9890b admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:53.078203 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-44c92f54-9e88-4237-a475-ebac59e08772 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:53.098675 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c92f54-9e88-4237-a475-ebac59e08772 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:53.108247 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1059/2118] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Mar 30 07:16:52 2022] POST /identity/v3/users => generated 299 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 07:16:53.109581 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803bce19-d84e-4e07-a907-4d3697e9890b admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:53.113413 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef27de60-3b84-4c0e-83e3-908136532b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:53.114566 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef27de60-3b84-4c0e-83e3-908136532b63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:53.115330 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef27de60-3b84-4c0e-83e3-908136532b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:53.115668 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef27de60-3b84-4c0e-83e3-908136532b63 admin admin] PATH_INFO: `/v3/projects/ca1438bd79f04ef8bca7e534e873c0e5` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:53.117415 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef27de60-3b84-4c0e-83e3-908136532b63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca1438bd79f04ef8bca7e534e873c0e5)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:53.120792 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef27de60-3b84-4c0e-83e3-908136532b63 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:53.122703 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803bce19-d84e-4e07-a907-4d3697e9890b admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:53.127588 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5449fb3-f7aa-4303-97a5-05ef3839b826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:53.128292 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5449fb3-f7aa-4303-97a5-05ef3839b826 admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:53.128627 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5449fb3-f7aa-4303-97a5-05ef3839b826 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:53.128900 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5449fb3-f7aa-4303-97a5-05ef3839b826 admin admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:53.129627 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5449fb3-f7aa-4303-97a5-05ef3839b826 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:53.131320 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5449fb3-f7aa-4303-97a5-05ef3839b826 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:53.142618 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1060/2119] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:16:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:16:53.146643 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5449fb3-f7aa-4303-97a5-05ef3839b826 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:53.156688 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5449fb3-f7aa-4303-97a5-05ef3839b826 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:53.162774 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74ca07f-ae26-4b0e-b252-fb34ca9cd388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:53.164369 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74ca07f-ae26-4b0e-b252-fb34ca9cd388 admin admin] REQUEST_METHOD: `PUT` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:53.164749 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74ca07f-ae26-4b0e-b252-fb34ca9cd388 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:53.165073 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74ca07f-ae26-4b0e-b252-fb34ca9cd388 admin admin] PATH_INFO: `/v3/projects/2bd24ddda7a740cca3e01d971beeab0c/users/44c3acba3b5f442b8b3813701a08ecfb/roles/1c39b9ab8cfd4c0ea71845831920a845` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:53.180184 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-ef27de60-3b84-4c0e-83e3-908136532b63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca1438bd79f04ef8bca7e534e873c0e5', 'request_id': 'req-ef27de60-3b84-4c0e-83e3-908136532b63'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:53.186366 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-ef27de60-3b84-4c0e-83e3-908136532b63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca1438bd79f04ef8bca7e534e873c0e5', 'request_id': 'req-ef27de60-3b84-4c0e-83e3-908136532b63'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:53.190312 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74ca07f-ae26-4b0e-b252-fb34ca9cd388 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bd24ddda7a740cca3e01d971beeab0c, user_id=44c3acba3b5f442b8b3813701a08ecfb, role_id=1c39b9ab8cfd4c0ea71845831920a845)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:53.192978 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74ca07f-ae26-4b0e-b252-fb34ca9cd388 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:53.194394 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-ef27de60-3b84-4c0e-83e3-908136532b63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca1438bd79f04ef8bca7e534e873c0e5', 'request_id': 'req-ef27de60-3b84-4c0e-83e3-908136532b63'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:53.209342 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-ef27de60-3b84-4c0e-83e3-908136532b63 admin admin] The token cache is being invalidate because project ca1438bd79f04ef8bca7e534e873c0e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79961) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 07:16:53.209901 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-ef27de60-3b84-4c0e-83e3-908136532b63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:53.211008 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-ef27de60-3b84-4c0e-83e3-908136532b63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:53.213311 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1060/2120] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Mar 30 07:16:53 2022] DELETE /identity/v3/projects/ca1438bd79f04ef8bca7e534e873c0e5 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:16:53.218029 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca29d68-9a5d-4247-8fd6-9b933ddb9277 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:53.218496 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca29d68-9a5d-4247-8fd6-9b933ddb9277 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:53.218918 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca29d68-9a5d-4247-8fd6-9b933ddb9277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:53.220965 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1061/2121] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:16:53 2022] PUT /identity/v3/projects/2bd24ddda7a740cca3e01d971beeab0c/users/44c3acba3b5f442b8b3813701a08ecfb/roles/1c39b9ab8cfd4c0ea71845831920a845 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 07:16:53.224602 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74ca07f-ae26-4b0e-b252-fb34ca9cd388 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:53.226353 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-f74ca07f-ae26-4b0e-b252-fb34ca9cd388 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:53.242083 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-5ca29d68-9a5d-4247-8fd6-9b933ddb9277 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:16:53.243573 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-5ca29d68-9a5d-4247-8fd6-9b933ddb9277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:53.296685 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74ca07f-ae26-4b0e-b252-fb34ca9cd388 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:53.302728 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f28cca9-d5bb-4afa-bd90-557524d668b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:53.303408 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f28cca9-d5bb-4afa-bd90-557524d668b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:53.303756 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f28cca9-d5bb-4afa-bd90-557524d668b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:53.304323 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f28cca9-d5bb-4afa-bd90-557524d668b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:53.305496 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f28cca9-d5bb-4afa-bd90-557524d668b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:53.307116 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f28cca9-d5bb-4afa-bd90-557524d668b1 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:53.317604 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1062/2122] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:16:53 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 30 07:16:53.323908 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1061/2123] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:16:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 07:16:53.324054 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f28cca9-d5bb-4afa-bd90-557524d668b1 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:53.330011 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49096427-9ab1-426d-b065-47d8ee3b7aef None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:53.330494 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49096427-9ab1-426d-b065-47d8ee3b7aef None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:53.330914 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49096427-9ab1-426d-b065-47d8ee3b7aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:53.333363 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f28cca9-d5bb-4afa-bd90-557524d668b1 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:53.338048 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c768f311-ad68-4703-a691-39ba0306b271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:53.338932 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768f311-ad68-4703-a691-39ba0306b271 admin admin] REQUEST_METHOD: `PUT` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:53.339847 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768f311-ad68-4703-a691-39ba0306b271 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:53.339847 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768f311-ad68-4703-a691-39ba0306b271 admin admin] PATH_INFO: `/v3/projects/2bd24ddda7a740cca3e01d971beeab0c/users/44c3acba3b5f442b8b3813701a08ecfb/roles/1c39b9ab8cfd4c0ea71845831920a845` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:53.341474 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c768f311-ad68-4703-a691-39ba0306b271 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bd24ddda7a740cca3e01d971beeab0c, user_id=44c3acba3b5f442b8b3813701a08ecfb, role_id=1c39b9ab8cfd4c0ea71845831920a845)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:53.344133 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c768f311-ad68-4703-a691-39ba0306b271 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:53.350654 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-49096427-9ab1-426d-b065-47d8ee3b7aef None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:16:53.352344 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-49096427-9ab1-426d-b065-47d8ee3b7aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:53.365916 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1063/2124] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:16:53 2022] PUT /identity/v3/projects/2bd24ddda7a740cca3e01d971beeab0c/users/44c3acba3b5f442b8b3813701a08ecfb/roles/1c39b9ab8cfd4c0ea71845831920a845 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 07:16:53.367883 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2a414f-e330-4a03-857e-0bb2f02084e5 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:53.368241 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2a414f-e330-4a03-857e-0bb2f02084e5 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:53.368679 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2a414f-e330-4a03-857e-0bb2f02084e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:53.395643 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-4d2a414f-e330-4a03-857e-0bb2f02084e5 None None] MFA Rules not processed for user `44c3acba3b5f442b8b3813701a08ecfb`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:16:53.396868 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-4d2a414f-e330-4a03-857e-0bb2f02084e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:53.418795 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1062/2125] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:16:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:16:53.423125 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49096427-9ab1-426d-b065-47d8ee3b7aef None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:53.433264 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49096427-9ab1-426d-b065-47d8ee3b7aef None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:53.438083 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41538b8c-73fa-4668-b0a3-b37b3ac0ab1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:53.438748 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41538b8c-73fa-4668-b0a3-b37b3ac0ab1c admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:53.439077 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41538b8c-73fa-4668-b0a3-b37b3ac0ab1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:53.439353 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41538b8c-73fa-4668-b0a3-b37b3ac0ab1c admin admin] PATH_INFO: `/v3/domains` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:53.440122 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41538b8c-73fa-4668-b0a3-b37b3ac0ab1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:16:53.440430 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41538b8c-73fa-4668-b0a3-b37b3ac0ab1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:53.442162 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41538b8c-73fa-4668-b0a3-b37b3ac0ab1c admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:53.455754 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1063/2126] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Mar 30 07:16:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:16:53.461383 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41538b8c-73fa-4668-b0a3-b37b3ac0ab1c admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:53.471581 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1064/2127] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:16:53 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:16:53.476252 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41538b8c-73fa-4668-b0a3-b37b3ac0ab1c admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:53.482319 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4abcbf-b043-4609-aea8-329a07b84736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:53.482984 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4abcbf-b043-4609-aea8-329a07b84736 admin admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:53.483376 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4abcbf-b043-4609-aea8-329a07b84736 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:53.483643 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4abcbf-b043-4609-aea8-329a07b84736 admin admin] PATH_INFO: `/v3/projects` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:53.484387 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4abcbf-b043-4609-aea8-329a07b84736 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:53.484582 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2a414f-e330-4a03-857e-0bb2f02084e5 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:53.486039 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-4d2a414f-e330-4a03-857e-0bb2f02084e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:53.486338 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4abcbf-b043-4609-aea8-329a07b84736 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:53.514909 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1064/2128] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Mar 30 07:16:53 2022] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:16:53.519171 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4abcbf-b043-4609-aea8-329a07b84736 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:53.555339 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2a414f-e330-4a03-857e-0bb2f02084e5 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:53.592368 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4abcbf-b043-4609-aea8-329a07b84736 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:53.597284 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7a3c4a-aec6-4c11-a275-f8babd1a5b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:53.597961 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a3c4a-aec6-4c11-a275-f8babd1a5b82 admin admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:53.598250 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a3c4a-aec6-4c11-a275-f8babd1a5b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:53.598524 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a3c4a-aec6-4c11-a275-f8babd1a5b82 admin admin] PATH_INFO: `/v3/users` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:53.599229 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7a3c4a-aec6-4c11-a275-f8babd1a5b82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:53.601350 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7a3c4a-aec6-4c11-a275-f8babd1a5b82 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:53.608648 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95281e7-f898-48be-a801-477da3c4d621 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e2fda180e8d448d895c40cdad34bc4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:53.609315 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95281e7-f898-48be-a801-477da3c4d621 service cinder] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:53.609586 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95281e7-f898-48be-a801-477da3c4d621 service cinder] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:53.609852 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95281e7-f898-48be-a801-477da3c4d621 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:53.611714 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-d95281e7-f898-48be-a801-477da3c4d621 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:53.626659 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1065/2129] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Mar 30 07:16:53 2022] POST /identity/v3/users => generated 292 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 07:16:53.634806 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7a3c4a-aec6-4c11-a275-f8babd1a5b82 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:53.646589 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7a3c4a-aec6-4c11-a275-f8babd1a5b82 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:53.651575 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a33914-7468-4087-a9f7-e3b45ae03d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:53.652279 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a33914-7468-4087-a9f7-e3b45ae03d09 admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:53.652620 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a33914-7468-4087-a9f7-e3b45ae03d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:53.652958 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a33914-7468-4087-a9f7-e3b45ae03d09 admin admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:53.653746 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a33914-7468-4087-a9f7-e3b45ae03d09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:53.655461 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a33914-7468-4087-a9f7-e3b45ae03d09 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:53.668833 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1066/2130] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:16:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 30 07:16:53.670474 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a33914-7468-4087-a9f7-e3b45ae03d09 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:53.678532 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95281e7-f898-48be-a801-477da3c4d621 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:53.680160 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95281e7-f898-48be-a801-477da3c4d621 service cinder] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:53.682042 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a33914-7468-4087-a9f7-e3b45ae03d09 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:53.689329 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1065/2131] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:16:53 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:16:53.690549 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b67796-0f33-49e3-aa86-d042f53256a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:53.691248 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b67796-0f33-49e3-aa86-d042f53256a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:53.691526 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b67796-0f33-49e3-aa86-d042f53256a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:53.691793 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b67796-0f33-49e3-aa86-d042f53256a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:53.692542 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b67796-0f33-49e3-aa86-d042f53256a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:53.695239 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b67796-0f33-49e3-aa86-d042f53256a8 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:53.706904 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1067/2132] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:16:53 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 30 07:16:53.711558 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95281e7-f898-48be-a801-477da3c4d621 service cinder] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:53.726730 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95281e7-f898-48be-a801-477da3c4d621 service cinder] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:53.732650 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ccf8bd-0a22-47fa-836b-3188448f7865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:53.733611 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ccf8bd-0a22-47fa-836b-3188448f7865 admin admin] REQUEST_METHOD: `PUT` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:53.733956 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ccf8bd-0a22-47fa-836b-3188448f7865 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:53.734289 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ccf8bd-0a22-47fa-836b-3188448f7865 admin admin] PATH_INFO: `/v3/projects/d814c230ebb24151bfc5b00bddf886ab/users/cdf171cb6ae44eed81b00b968850bf0a/roles/5d79031a64754b57ba120367465e2252` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:53.750662 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ccf8bd-0a22-47fa-836b-3188448f7865 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d814c230ebb24151bfc5b00bddf886ab, user_id=cdf171cb6ae44eed81b00b968850bf0a, role_id=5d79031a64754b57ba120367465e2252)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:53.753538 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ccf8bd-0a22-47fa-836b-3188448f7865 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:53.769333 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1066/2133] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:16:53 2022] PUT /identity/v3/projects/d814c230ebb24151bfc5b00bddf886ab/users/cdf171cb6ae44eed81b00b968850bf0a/roles/5d79031a64754b57ba120367465e2252 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 07:16:53.780615 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dbce34-1e47-4d54-b74d-b2dc7efacd14 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:53.781127 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dbce34-1e47-4d54-b74d-b2dc7efacd14 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:53.781284 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dbce34-1e47-4d54-b74d-b2dc7efacd14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:53.808306 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-01dbce34-1e47-4d54-b74d-b2dc7efacd14 None None] MFA Rules not processed for user `cdf171cb6ae44eed81b00b968850bf0a`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:16:53.809828 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-01dbce34-1e47-4d54-b74d-b2dc7efacd14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:53.880912 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1068/2134] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:16:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:16:53.885748 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ccf8bd-0a22-47fa-836b-3188448f7865 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:53.961009 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ccf8bd-0a22-47fa-836b-3188448f7865 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:53.967367 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ddc357-eb8c-4e06-ad21-f005632420c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:53.968504 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ddc357-eb8c-4e06-ad21-f005632420c3 admin admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:53.968990 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ddc357-eb8c-4e06-ad21-f005632420c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:53.969277 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ddc357-eb8c-4e06-ad21-f005632420c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:53.969985 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ddc357-eb8c-4e06-ad21-f005632420c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:53.971942 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ddc357-eb8c-4e06-ad21-f005632420c3 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:54.012271 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1067/2135] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Mar 30 07:16:53 2022] POST /identity/v3/projects => generated 383 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 07:16:54.016520 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dbce34-1e47-4d54-b74d-b2dc7efacd14 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:54.029759 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dbce34-1e47-4d54-b74d-b2dc7efacd14 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:54.105444 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b23fb9-957c-49f5-8bf6-25d6fca63c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:54.105444 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b23fb9-957c-49f5-8bf6-25d6fca63c68 admin admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:54.105444 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b23fb9-957c-49f5-8bf6-25d6fca63c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:54.106223 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b23fb9-957c-49f5-8bf6-25d6fca63c68 admin admin] PATH_INFO: `/v3/users` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:54.106770 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b23fb9-957c-49f5-8bf6-25d6fca63c68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:54.108848 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b23fb9-957c-49f5-8bf6-25d6fca63c68 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:54.132139 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1069/2136] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Mar 30 07:16:54 2022] POST /identity/v3/users => generated 298 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 07:16:54.136781 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ddc357-eb8c-4e06-ad21-f005632420c3 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:54.149489 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ddc357-eb8c-4e06-ad21-f005632420c3 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:54.154190 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07f3058-aa94-4f2c-a561-28d788e407bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:54.154861 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07f3058-aa94-4f2c-a561-28d788e407bb admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:54.155138 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07f3058-aa94-4f2c-a561-28d788e407bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:54.155404 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07f3058-aa94-4f2c-a561-28d788e407bb admin admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:54.156172 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07f3058-aa94-4f2c-a561-28d788e407bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:54.157813 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07f3058-aa94-4f2c-a561-28d788e407bb admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:54.168625 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1068/2137] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:16:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:16:54.172982 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b23fb9-957c-49f5-8bf6-25d6fca63c68 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:54.184827 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b23fb9-957c-49f5-8bf6-25d6fca63c68 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:54.191137 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0986fe7-77a1-49c8-8fbc-74f63e7c1fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:54.192177 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0986fe7-77a1-49c8-8fbc-74f63e7c1fa1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:54.192536 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0986fe7-77a1-49c8-8fbc-74f63e7c1fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:54.192764 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0986fe7-77a1-49c8-8fbc-74f63e7c1fa1 admin admin] PATH_INFO: `/v3/projects/e8494ee6daad4f20b2c966a4aca390e8/users/059d361ad4584c1f816ed161caa1ba1e/roles/1c39b9ab8cfd4c0ea71845831920a845` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:54.210269 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0986fe7-77a1-49c8-8fbc-74f63e7c1fa1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8494ee6daad4f20b2c966a4aca390e8, user_id=059d361ad4584c1f816ed161caa1ba1e, role_id=1c39b9ab8cfd4c0ea71845831920a845)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:54.213635 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0986fe7-77a1-49c8-8fbc-74f63e7c1fa1 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:54.232256 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1070/2138] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:16:54 2022] PUT /identity/v3/projects/e8494ee6daad4f20b2c966a4aca390e8/users/059d361ad4584c1f816ed161caa1ba1e/roles/1c39b9ab8cfd4c0ea71845831920a845 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 07:16:54.236581 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07f3058-aa94-4f2c-a561-28d788e407bb admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:54.247094 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07f3058-aa94-4f2c-a561-28d788e407bb admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:54.310870 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc7ae8d-8f1f-4a02-9190-b1b919aac629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:54.311544 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc7ae8d-8f1f-4a02-9190-b1b919aac629 admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:54.311830 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc7ae8d-8f1f-4a02-9190-b1b919aac629 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:54.312111 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc7ae8d-8f1f-4a02-9190-b1b919aac629 admin admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:54.312835 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc7ae8d-8f1f-4a02-9190-b1b919aac629 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:54.314458 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc7ae8d-8f1f-4a02-9190-b1b919aac629 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:54.325473 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1069/2139] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:16:54 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:16:54.330226 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0986fe7-77a1-49c8-8fbc-74f63e7c1fa1 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:54.341590 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0986fe7-77a1-49c8-8fbc-74f63e7c1fa1 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:54.347408 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c470f5c-92e5-43fe-9d05-97ea73a3c48e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:54.348349 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c470f5c-92e5-43fe-9d05-97ea73a3c48e admin admin] REQUEST_METHOD: `PUT` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:54.348621 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c470f5c-92e5-43fe-9d05-97ea73a3c48e admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:54.348886 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c470f5c-92e5-43fe-9d05-97ea73a3c48e admin admin] PATH_INFO: `/v3/projects/e8494ee6daad4f20b2c966a4aca390e8/users/059d361ad4584c1f816ed161caa1ba1e/roles/1c39b9ab8cfd4c0ea71845831920a845` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:54.351077 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c470f5c-92e5-43fe-9d05-97ea73a3c48e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8494ee6daad4f20b2c966a4aca390e8, user_id=059d361ad4584c1f816ed161caa1ba1e, role_id=1c39b9ab8cfd4c0ea71845831920a845)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:54.353833 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c470f5c-92e5-43fe-9d05-97ea73a3c48e admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:54.366319 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1071/2140] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:16:54 2022] PUT /identity/v3/projects/e8494ee6daad4f20b2c966a4aca390e8/users/059d361ad4584c1f816ed161caa1ba1e/roles/1c39b9ab8cfd4c0ea71845831920a845 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 07:16:54.377193 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26587f3-1287-4c36-951f-c01594e5e832 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:54.377511 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26587f3-1287-4c36-951f-c01594e5e832 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:54.377817 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26587f3-1287-4c36-951f-c01594e5e832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:54.405305 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-e26587f3-1287-4c36-951f-c01594e5e832 None None] MFA Rules not processed for user `059d361ad4584c1f816ed161caa1ba1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:16:54.406551 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-e26587f3-1287-4c36-951f-c01594e5e832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:54.477595 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1070/2141] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:16:54 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 07:16:54.488934 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c470f5c-92e5-43fe-9d05-97ea73a3c48e admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:54.490786 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-4c470f5c-92e5-43fe-9d05-97ea73a3c48e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:54.550558 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c470f5c-92e5-43fe-9d05-97ea73a3c48e admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:54.554033 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d392fc78-a2bc-48c3-a681-b7a2fb51dba6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e2fda180e8d448d895c40cdad34bc4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:54.554677 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d392fc78-a2bc-48c3-a681-b7a2fb51dba6 service cinder] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:54.554950 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d392fc78-a2bc-48c3-a681-b7a2fb51dba6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:54.555217 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d392fc78-a2bc-48c3-a681-b7a2fb51dba6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:54.614825 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d392fc78-a2bc-48c3-a681-b7a2fb51dba6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:54.616671 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d392fc78-a2bc-48c3-a681-b7a2fb51dba6 service cinder] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:54.625861 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1072/2142] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:16:54 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:16:54.915446 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26587f3-1287-4c36-951f-c01594e5e832 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:54.917113 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-e26587f3-1287-4c36-951f-c01594e5e832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:54.997944 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26587f3-1287-4c36-951f-c01594e5e832 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:55.002710 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba47705-7bc6-4c63-9a46-16beaf325f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:55.003522 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba47705-7bc6-4c63-9a46-16beaf325f0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:55.003849 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba47705-7bc6-4c63-9a46-16beaf325f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:55.004085 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba47705-7bc6-4c63-9a46-16beaf325f0e admin admin] PATH_INFO: `/v3/users/21125a38c0cc4eedbdb6d68c386a259e` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:55.005457 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba47705-7bc6-4c63-9a46-16beaf325f0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=21125a38c0cc4eedbdb6d68c386a259e)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:55.007314 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba47705-7bc6-4c63-9a46-16beaf325f0e admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:55.057494 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-2ba47705-7bc6-4c63-9a46-16beaf325f0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21125a38c0cc4eedbdb6d68c386a259e'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:55.058271 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-2ba47705-7bc6-4c63-9a46-16beaf325f0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21125a38c0cc4eedbdb6d68c386a259e'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:55.065647 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-2ba47705-7bc6-4c63-9a46-16beaf325f0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21125a38c0cc4eedbdb6d68c386a259e'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:55.078835 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-2ba47705-7bc6-4c63-9a46-16beaf325f0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21125a38c0cc4eedbdb6d68c386a259e'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:55.079527 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-2ba47705-7bc6-4c63-9a46-16beaf325f0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21125a38c0cc4eedbdb6d68c386a259e'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:55.092136 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1071/2143] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Mar 30 07:16:54 2022] DELETE /identity/v3/users/21125a38c0cc4eedbdb6d68c386a259e => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 07:16:55.096939 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3db405-15a7-4255-bfab-f84b9ec1818f None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:55.097406 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3db405-15a7-4255-bfab-f84b9ec1818f None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:55.097498 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3db405-15a7-4255-bfab-f84b9ec1818f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:55.117717 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-ab3db405-15a7-4255-bfab-f84b9ec1818f None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:16:55.117717 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-ab3db405-15a7-4255-bfab-f84b9ec1818f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:55.177757 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1073/2144] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:16:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 07:16:55.187964 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba47705-7bc6-4c63-9a46-16beaf325f0e admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:55.189593 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-2ba47705-7bc6-4c63-9a46-16beaf325f0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:55.229488 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3db405-15a7-4255-bfab-f84b9ec1818f None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:55.231587 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-ab3db405-15a7-4255-bfab-f84b9ec1818f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:55.276309 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba47705-7bc6-4c63-9a46-16beaf325f0e admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:55.280244 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d5646a-1001-4545-be63-7b80c72cec66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3802cb341445f994b9204744060ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:55.280903 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d5646a-1001-4545-be63-7b80c72cec66 service neutron] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:55.281189 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d5646a-1001-4545-be63-7b80c72cec66 service neutron] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:55.281466 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d5646a-1001-4545-be63-7b80c72cec66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:55.296212 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d5646a-1001-4545-be63-7b80c72cec66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:55.297666 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d5646a-1001-4545-be63-7b80c72cec66 service neutron] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:55.308170 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1072/2145] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:16:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:16:55.319469 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3db405-15a7-4255-bfab-f84b9ec1818f None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:55.326555 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff5668d-a011-4ed0-9ff1-f91f9490fb27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e2fda180e8d448d895c40cdad34bc4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:55.327231 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff5668d-a011-4ed0-9ff1-f91f9490fb27 service cinder] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:55.327507 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff5668d-a011-4ed0-9ff1-f91f9490fb27 service cinder] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:55.327775 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff5668d-a011-4ed0-9ff1-f91f9490fb27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:55.329802 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-eff5668d-a011-4ed0-9ff1-f91f9490fb27 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:55.411852 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff5668d-a011-4ed0-9ff1-f91f9490fb27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:55.413416 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff5668d-a011-4ed0-9ff1-f91f9490fb27 service cinder] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:55.423058 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1074/2146] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:16:55 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 30 07:16:55.669752 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d5646a-1001-4545-be63-7b80c72cec66 service neutron] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:55.671170 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-45d5646a-1001-4545-be63-7b80c72cec66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:55.684446 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d5646a-1001-4545-be63-7b80c72cec66 service neutron] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:55.690998 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f68cce-f583-49e6-88fb-d8f4d5852a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:55.692059 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f68cce-f583-49e6-88fb-d8f4d5852a6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:55.692592 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f68cce-f583-49e6-88fb-d8f4d5852a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:55.693065 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f68cce-f583-49e6-88fb-d8f4d5852a6b admin admin] PATH_INFO: `/v3/projects/1c28253ccc5f4943a2071b9da75abedc` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:55.695485 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f68cce-f583-49e6-88fb-d8f4d5852a6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c28253ccc5f4943a2071b9da75abedc)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:55.698128 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f68cce-f583-49e6-88fb-d8f4d5852a6b admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:55.756004 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-11f68cce-f583-49e6-88fb-d8f4d5852a6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c28253ccc5f4943a2071b9da75abedc', 'request_id': 'req-11f68cce-f583-49e6-88fb-d8f4d5852a6b'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:55.763974 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-11f68cce-f583-49e6-88fb-d8f4d5852a6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c28253ccc5f4943a2071b9da75abedc', 'request_id': 'req-11f68cce-f583-49e6-88fb-d8f4d5852a6b'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:55.769475 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-11f68cce-f583-49e6-88fb-d8f4d5852a6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c28253ccc5f4943a2071b9da75abedc', 'request_id': 'req-11f68cce-f583-49e6-88fb-d8f4d5852a6b'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:55.781307 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-11f68cce-f583-49e6-88fb-d8f4d5852a6b admin admin] The token cache is being invalidate because project 1c28253ccc5f4943a2071b9da75abedc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79960) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 07:16:55.781647 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-11f68cce-f583-49e6-88fb-d8f4d5852a6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:55.782287 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-11f68cce-f583-49e6-88fb-d8f4d5852a6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:16:55.783884 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1073/2147] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Mar 30 07:16:55 2022] DELETE /identity/v3/projects/1c28253ccc5f4943a2071b9da75abedc => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:16:55.789890 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6303e76-0b89-4a67-b9e9-94d6b0437740 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:55.790422 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6303e76-0b89-4a67-b9e9-94d6b0437740 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:55.790622 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6303e76-0b89-4a67-b9e9-94d6b0437740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:55.810046 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-e6303e76-0b89-4a67-b9e9-94d6b0437740 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:16:55.811433 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-e6303e76-0b89-4a67-b9e9-94d6b0437740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:55.876914 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1075/2148] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:16:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 07:16:55.887347 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf11a2b-9a62-4385-bd9b-83f40a719abc None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:55.887650 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf11a2b-9a62-4385-bd9b-83f40a719abc None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:55.888016 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf11a2b-9a62-4385-bd9b-83f40a719abc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:55.913706 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-ddf11a2b-9a62-4385-bd9b-83f40a719abc None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:16:55.914968 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-ddf11a2b-9a62-4385-bd9b-83f40a719abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:55.924770 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1074/2149] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:16:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:16:55.929262 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6303e76-0b89-4a67-b9e9-94d6b0437740 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:55.939630 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6303e76-0b89-4a67-b9e9-94d6b0437740 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:55.944571 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e23895-2fa6-4b76-8494-b7e1a2effcc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:55.945333 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e23895-2fa6-4b76-8494-b7e1a2effcc9 admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:55.945606 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e23895-2fa6-4b76-8494-b7e1a2effcc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:55.945865 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e23895-2fa6-4b76-8494-b7e1a2effcc9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:55.946616 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e23895-2fa6-4b76-8494-b7e1a2effcc9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:16:55.946919 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e23895-2fa6-4b76-8494-b7e1a2effcc9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:55.948726 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e23895-2fa6-4b76-8494-b7e1a2effcc9 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:55.964978 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1076/2150] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Mar 30 07:16:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:16:55.970345 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf11a2b-9a62-4385-bd9b-83f40a719abc None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:55.981984 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf11a2b-9a62-4385-bd9b-83f40a719abc None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:55.986985 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ac6722-051a-4a58-9389-005d068d5f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:55.987760 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac6722-051a-4a58-9389-005d068d5f17 admin admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:55.988141 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac6722-051a-4a58-9389-005d068d5f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:55.988497 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac6722-051a-4a58-9389-005d068d5f17 admin admin] PATH_INFO: `/v3/projects` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:55.989266 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ac6722-051a-4a58-9389-005d068d5f17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:55.991319 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ac6722-051a-4a58-9389-005d068d5f17 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:56.027571 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1075/2151] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Mar 30 07:16:55 2022] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:16:56.028784 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e23895-2fa6-4b76-8494-b7e1a2effcc9 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:56.049089 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e23895-2fa6-4b76-8494-b7e1a2effcc9 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:56.107523 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ac6722-051a-4a58-9389-005d068d5f17 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:56.109533 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-90ac6722-051a-4a58-9389-005d068d5f17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:56.114082 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9a7434-f227-4108-b6d8-e0098616e194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:56.114941 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9a7434-f227-4108-b6d8-e0098616e194 admin admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:56.115222 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9a7434-f227-4108-b6d8-e0098616e194 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:56.115494 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9a7434-f227-4108-b6d8-e0098616e194 admin admin] PATH_INFO: `/v3/users` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:56.116798 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9a7434-f227-4108-b6d8-e0098616e194 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:56.118768 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9a7434-f227-4108-b6d8-e0098616e194 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:56.144277 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1077/2152] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Mar 30 07:16:56 2022] POST /identity/v3/users => generated 292 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 07:16:56.145356 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9a7434-f227-4108-b6d8-e0098616e194 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:56.155154 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9a7434-f227-4108-b6d8-e0098616e194 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:56.160139 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d31660-151c-4be6-9a89-b905a9244a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:56.160923 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d31660-151c-4be6-9a89-b905a9244a8c admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:56.161109 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d31660-151c-4be6-9a89-b905a9244a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:56.161325 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d31660-151c-4be6-9a89-b905a9244a8c admin admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:56.162045 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d31660-151c-4be6-9a89-b905a9244a8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:56.163742 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d31660-151c-4be6-9a89-b905a9244a8c admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:56.172527 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ac6722-051a-4a58-9389-005d068d5f17 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:56.174089 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1078/2153] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:16:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 30 07:16:56.178727 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d31660-151c-4be6-9a89-b905a9244a8c admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:56.179905 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085bfa9e-daaa-4d62-ae3d-9f3efeb7c179 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e2fda180e8d448d895c40cdad34bc4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:56.180570 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085bfa9e-daaa-4d62-ae3d-9f3efeb7c179 service cinder] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:56.180848 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085bfa9e-daaa-4d62-ae3d-9f3efeb7c179 service cinder] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:56.181105 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085bfa9e-daaa-4d62-ae3d-9f3efeb7c179 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:56.182908 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-085bfa9e-daaa-4d62-ae3d-9f3efeb7c179 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:56.196057 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d31660-151c-4be6-9a89-b905a9244a8c admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:56.201866 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34482743-252c-4a6b-84d7-a45312b096bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:56.202672 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34482743-252c-4a6b-84d7-a45312b096bc admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:56.202959 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34482743-252c-4a6b-84d7-a45312b096bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:56.203236 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34482743-252c-4a6b-84d7-a45312b096bc admin admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:56.204959 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34482743-252c-4a6b-84d7-a45312b096bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:56.206125 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34482743-252c-4a6b-84d7-a45312b096bc admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:56.220658 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1079/2154] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:16:56 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 30 07:16:56.224728 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34482743-252c-4a6b-84d7-a45312b096bc admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:56.237161 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34482743-252c-4a6b-84d7-a45312b096bc admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:56.245518 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca37f95-f87c-4774-b1ef-39cedf40d711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:56.246788 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca37f95-f87c-4774-b1ef-39cedf40d711 admin admin] REQUEST_METHOD: `PUT` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:56.247290 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca37f95-f87c-4774-b1ef-39cedf40d711 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:56.247898 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca37f95-f87c-4774-b1ef-39cedf40d711 admin admin] PATH_INFO: `/v3/projects/fdbabd5e38b749abb59cbf2680697a54/users/b25ac073374a491899b09b5c7810eb84/roles/5d79031a64754b57ba120367465e2252` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:56.269253 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca37f95-f87c-4774-b1ef-39cedf40d711 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdbabd5e38b749abb59cbf2680697a54, user_id=b25ac073374a491899b09b5c7810eb84, role_id=5d79031a64754b57ba120367465e2252)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:56.269717 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085bfa9e-daaa-4d62-ae3d-9f3efeb7c179 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:56.271199 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085bfa9e-daaa-4d62-ae3d-9f3efeb7c179 service cinder] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:56.273206 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca37f95-f87c-4774-b1ef-39cedf40d711 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:56.282192 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1076/2155] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:16:56 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 30 07:16:56.291769 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1080/2156] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:16:56 2022] PUT /identity/v3/projects/fdbabd5e38b749abb59cbf2680697a54/users/b25ac073374a491899b09b5c7810eb84/roles/5d79031a64754b57ba120367465e2252 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 07:16:56.297374 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1d7500-9dac-4ef5-accd-d710e4ffe591 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:56.297662 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1d7500-9dac-4ef5-accd-d710e4ffe591 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:56.297977 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1d7500-9dac-4ef5-accd-d710e4ffe591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:56.316348 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-3d1d7500-9dac-4ef5-accd-d710e4ffe591 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:16:56.317542 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-3d1d7500-9dac-4ef5-accd-d710e4ffe591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:56.379378 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1077/2157] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:16:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 07:16:56.390096 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca37f95-f87c-4774-b1ef-39cedf40d711 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:56.392426 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-dca37f95-f87c-4774-b1ef-39cedf40d711 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:56.505495 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca37f95-f87c-4774-b1ef-39cedf40d711 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:56.509443 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf05e7c-b80c-44e6-8179-95a4ea85cf9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3802cb341445f994b9204744060ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:56.510131 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf05e7c-b80c-44e6-8179-95a4ea85cf9a service neutron] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:56.510412 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf05e7c-b80c-44e6-8179-95a4ea85cf9a service neutron] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:56.510963 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf05e7c-b80c-44e6-8179-95a4ea85cf9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:56.524853 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf05e7c-b80c-44e6-8179-95a4ea85cf9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:56.526495 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf05e7c-b80c-44e6-8179-95a4ea85cf9a service neutron] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:56.547224 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1081/2158] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:16:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:16:57.340399 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b966399a-349a-4c8e-b65f-53b3d5fda101 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:57.341001 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b966399a-349a-4c8e-b65f-53b3d5fda101 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:57.341001 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b966399a-349a-4c8e-b65f-53b3d5fda101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:57.368734 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-b966399a-349a-4c8e-b65f-53b3d5fda101 None None] MFA Rules not processed for user `b25ac073374a491899b09b5c7810eb84`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:16:57.369867 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-b966399a-349a-4c8e-b65f-53b3d5fda101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:57.436389 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1078/2159] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:16:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:16:57.447613 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf05e7c-b80c-44e6-8179-95a4ea85cf9a service neutron] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:57.510969 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf05e7c-b80c-44e6-8179-95a4ea85cf9a service neutron] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:57.514856 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648701ba-216a-4879-a52e-a957ef1eaef2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e2fda180e8d448d895c40cdad34bc4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:57.515731 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648701ba-216a-4879-a52e-a957ef1eaef2 service cinder] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:57.516039 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648701ba-216a-4879-a52e-a957ef1eaef2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:57.516311 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648701ba-216a-4879-a52e-a957ef1eaef2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:57.524933 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648701ba-216a-4879-a52e-a957ef1eaef2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:57.526393 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648701ba-216a-4879-a52e-a957ef1eaef2 service cinder] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:57.535475 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1082/2160] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:16:57 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:16:58.907729 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af0f51-7a0d-4e53-9f2f-96aafae724f2 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:58.908321 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af0f51-7a0d-4e53-9f2f-96aafae724f2 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:58.908321 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af0f51-7a0d-4e53-9f2f-96aafae724f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:58.926087 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-98af0f51-7a0d-4e53-9f2f-96aafae724f2 None None] MFA Rules not processed for user `b25ac073374a491899b09b5c7810eb84`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:16:58.927313 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-98af0f51-7a0d-4e53-9f2f-96aafae724f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:58.934816 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1079/2161] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:16:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 07:16:59.249758 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648701ba-216a-4879-a52e-a957ef1eaef2 service cinder] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:16:59.251207 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-648701ba-216a-4879-a52e-a957ef1eaef2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:59.262431 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648701ba-216a-4879-a52e-a957ef1eaef2 service cinder] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:16:59.265940 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f12962-f0ab-49f6-ade0-5384a7f6d2c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e2fda180e8d448d895c40cdad34bc4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:16:59.266625 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f12962-f0ab-49f6-ade0-5384a7f6d2c1 service cinder] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:16:59.266900 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f12962-f0ab-49f6-ade0-5384a7f6d2c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:16:59.267168 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f12962-f0ab-49f6-ade0-5384a7f6d2c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:16:59.268914 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-65f12962-f0ab-49f6-ade0-5384a7f6d2c1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:16:59.328780 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f12962-f0ab-49f6-ade0-5384a7f6d2c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:16:59.331701 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f12962-f0ab-49f6-ade0-5384a7f6d2c1 service cinder] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:16:59.345626 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1083/2162] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:16:59 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:17:03.459114 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98af0f51-7a0d-4e53-9f2f-96aafae724f2 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:17:03.462015 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-98af0f51-7a0d-4e53-9f2f-96aafae724f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:17:03.475921 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98af0f51-7a0d-4e53-9f2f-96aafae724f2 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:17:03.481313 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f3c18c-702b-4d40-beca-69a3b3f94a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:17:03.482194 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f3c18c-702b-4d40-beca-69a3b3f94a91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:03.482473 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f3c18c-702b-4d40-beca-69a3b3f94a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:03.482739 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f3c18c-702b-4d40-beca-69a3b3f94a91 admin admin] PATH_INFO: `/v3/users/c4c81aa4c27b4e59988edac398336da0` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:03.484004 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f3c18c-702b-4d40-beca-69a3b3f94a91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4c81aa4c27b4e59988edac398336da0)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:17:03.485909 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f3c18c-702b-4d40-beca-69a3b3f94a91 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:17:03.534834 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-15f3c18c-702b-4d40-beca-69a3b3f94a91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4c81aa4c27b4e59988edac398336da0'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:03.535536 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-15f3c18c-702b-4d40-beca-69a3b3f94a91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4c81aa4c27b4e59988edac398336da0'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:03.543344 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-15f3c18c-702b-4d40-beca-69a3b3f94a91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4c81aa4c27b4e59988edac398336da0'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:03.559847 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-15f3c18c-702b-4d40-beca-69a3b3f94a91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4c81aa4c27b4e59988edac398336da0'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:03.560857 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-15f3c18c-702b-4d40-beca-69a3b3f94a91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4c81aa4c27b4e59988edac398336da0'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:03.573635 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1080/2163] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Mar 30 07:17:03 2022] DELETE /identity/v3/users/c4c81aa4c27b4e59988edac398336da0 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:17:03.579154 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634e568c-57b1-47e9-b28f-c054e1b93863 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:03.579664 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634e568c-57b1-47e9-b28f-c054e1b93863 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:03.579742 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634e568c-57b1-47e9-b28f-c054e1b93863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:03.599646 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-634e568c-57b1-47e9-b28f-c054e1b93863 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:17:03.601150 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-634e568c-57b1-47e9-b28f-c054e1b93863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:17:03.664637 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1084/2164] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:17:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:17:03.671206 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f3c18c-702b-4d40-beca-69a3b3f94a91 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:17:03.673032 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-15f3c18c-702b-4d40-beca-69a3b3f94a91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:17:03.734449 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f3c18c-702b-4d40-beca-69a3b3f94a91 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:17:03.738445 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbf2368-4d26-4f3f-a5f7-2a29e83a6d1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3802cb341445f994b9204744060ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:17:03.739149 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf2368-4d26-4f3f-a5f7-2a29e83a6d1b service neutron] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:03.739429 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf2368-4d26-4f3f-a5f7-2a29e83a6d1b service neutron] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:03.739696 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf2368-4d26-4f3f-a5f7-2a29e83a6d1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:03.749311 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbf2368-4d26-4f3f-a5f7-2a29e83a6d1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:17:03.750745 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbf2368-4d26-4f3f-a5f7-2a29e83a6d1b service neutron] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:17:03.761027 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1081/2165] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:17:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:17:04.274322 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634e568c-57b1-47e9-b28f-c054e1b93863 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:17:04.276105 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-634e568c-57b1-47e9-b28f-c054e1b93863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:17:04.290814 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634e568c-57b1-47e9-b28f-c054e1b93863 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:17:04.295358 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df31045-8603-46d0-8267-ddb005ffa91f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:17:04.296272 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df31045-8603-46d0-8267-ddb005ffa91f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:04.296551 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df31045-8603-46d0-8267-ddb005ffa91f admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:04.296821 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df31045-8603-46d0-8267-ddb005ffa91f admin admin] PATH_INFO: `/v3/projects/896d06d0e7e04443972a84eb4faf4bc2` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:04.298041 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df31045-8603-46d0-8267-ddb005ffa91f admin admin] RBAC: Authorizing `identity:delete_project(project_id=896d06d0e7e04443972a84eb4faf4bc2)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:17:04.300032 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df31045-8603-46d0-8267-ddb005ffa91f admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:17:04.347400 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-9df31045-8603-46d0-8267-ddb005ffa91f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '896d06d0e7e04443972a84eb4faf4bc2', 'request_id': 'req-9df31045-8603-46d0-8267-ddb005ffa91f'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:04.353089 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-9df31045-8603-46d0-8267-ddb005ffa91f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '896d06d0e7e04443972a84eb4faf4bc2', 'request_id': 'req-9df31045-8603-46d0-8267-ddb005ffa91f'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:04.360858 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-9df31045-8603-46d0-8267-ddb005ffa91f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '896d06d0e7e04443972a84eb4faf4bc2', 'request_id': 'req-9df31045-8603-46d0-8267-ddb005ffa91f'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:04.372236 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-9df31045-8603-46d0-8267-ddb005ffa91f admin admin] The token cache is being invalidate because project 896d06d0e7e04443972a84eb4faf4bc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79961) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 07:17:04.372525 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-9df31045-8603-46d0-8267-ddb005ffa91f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:04.373167 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-9df31045-8603-46d0-8267-ddb005ffa91f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:04.374924 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1085/2166] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Mar 30 07:17:04 2022] DELETE /identity/v3/projects/896d06d0e7e04443972a84eb4faf4bc2 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 07:17:04.378706 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbf2368-4d26-4f3f-a5f7-2a29e83a6d1b service neutron] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:17:04.388631 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbf2368-4d26-4f3f-a5f7-2a29e83a6d1b service neutron] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:17:04.443541 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b661ba-d9da-48ef-9ed6-9e15e8aa591b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:17:04.444561 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b661ba-d9da-48ef-9ed6-9e15e8aa591b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:04.444841 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b661ba-d9da-48ef-9ed6-9e15e8aa591b admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:04.445154 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b661ba-d9da-48ef-9ed6-9e15e8aa591b admin admin] PATH_INFO: `/v3/users/6200790ab91e4149a0f9cec846c3a56d` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:04.446435 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b661ba-d9da-48ef-9ed6-9e15e8aa591b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6200790ab91e4149a0f9cec846c3a56d)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:17:04.448589 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b661ba-d9da-48ef-9ed6-9e15e8aa591b admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:17:04.498385 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-03b661ba-d9da-48ef-9ed6-9e15e8aa591b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6200790ab91e4149a0f9cec846c3a56d'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:04.499111 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-03b661ba-d9da-48ef-9ed6-9e15e8aa591b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6200790ab91e4149a0f9cec846c3a56d'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:04.508255 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-03b661ba-d9da-48ef-9ed6-9e15e8aa591b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6200790ab91e4149a0f9cec846c3a56d'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:04.520841 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-03b661ba-d9da-48ef-9ed6-9e15e8aa591b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6200790ab91e4149a0f9cec846c3a56d'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:04.521565 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-03b661ba-d9da-48ef-9ed6-9e15e8aa591b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6200790ab91e4149a0f9cec846c3a56d'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:04.534503 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1082/2167] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Mar 30 07:17:04 2022] DELETE /identity/v3/users/6200790ab91e4149a0f9cec846c3a56d => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:17:04.961515 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df31045-8603-46d0-8267-ddb005ffa91f admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:17:04.963003 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-9df31045-8603-46d0-8267-ddb005ffa91f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:17:04.991290 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df31045-8603-46d0-8267-ddb005ffa91f admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:17:05.051857 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff39a33b-4ba3-4192-9ad9-39af7dc7635f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:17:05.052663 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff39a33b-4ba3-4192-9ad9-39af7dc7635f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:05.052961 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff39a33b-4ba3-4192-9ad9-39af7dc7635f admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:05.053234 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff39a33b-4ba3-4192-9ad9-39af7dc7635f admin admin] PATH_INFO: `/v3/projects/13b91594a5674456b500208ea7a30b46` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:05.054584 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff39a33b-4ba3-4192-9ad9-39af7dc7635f admin admin] RBAC: Authorizing `identity:delete_project(project_id=13b91594a5674456b500208ea7a30b46)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:17:05.056550 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff39a33b-4ba3-4192-9ad9-39af7dc7635f admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:17:05.103488 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-ff39a33b-4ba3-4192-9ad9-39af7dc7635f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13b91594a5674456b500208ea7a30b46', 'request_id': 'req-ff39a33b-4ba3-4192-9ad9-39af7dc7635f'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:05.109757 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-ff39a33b-4ba3-4192-9ad9-39af7dc7635f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13b91594a5674456b500208ea7a30b46', 'request_id': 'req-ff39a33b-4ba3-4192-9ad9-39af7dc7635f'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:05.118227 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-ff39a33b-4ba3-4192-9ad9-39af7dc7635f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13b91594a5674456b500208ea7a30b46', 'request_id': 'req-ff39a33b-4ba3-4192-9ad9-39af7dc7635f'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:05.133913 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-ff39a33b-4ba3-4192-9ad9-39af7dc7635f admin admin] The token cache is being invalidate because project 13b91594a5674456b500208ea7a30b46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79961) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 07:17:05.134203 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-ff39a33b-4ba3-4192-9ad9-39af7dc7635f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:05.134909 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-ff39a33b-4ba3-4192-9ad9-39af7dc7635f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:05.136646 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1086/2168] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Mar 30 07:17:04 2022] DELETE /identity/v3/projects/13b91594a5674456b500208ea7a30b46 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:17:05.140923 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b661ba-d9da-48ef-9ed6-9e15e8aa591b admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:17:05.142549 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-03b661ba-d9da-48ef-9ed6-9e15e8aa591b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:17:05.157612 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b661ba-d9da-48ef-9ed6-9e15e8aa591b admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:17:05.224104 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c1682b-698d-4e87-abb6-6e210ccf5bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:17:05.225121 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c1682b-698d-4e87-abb6-6e210ccf5bc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:05.225630 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c1682b-698d-4e87-abb6-6e210ccf5bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:05.225995 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c1682b-698d-4e87-abb6-6e210ccf5bc2 admin admin] PATH_INFO: `/v3/users/44c3acba3b5f442b8b3813701a08ecfb` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:05.227493 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c1682b-698d-4e87-abb6-6e210ccf5bc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44c3acba3b5f442b8b3813701a08ecfb)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:17:05.229897 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c1682b-698d-4e87-abb6-6e210ccf5bc2 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:17:05.307421 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-34c1682b-698d-4e87-abb6-6e210ccf5bc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44c3acba3b5f442b8b3813701a08ecfb'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:05.308294 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-34c1682b-698d-4e87-abb6-6e210ccf5bc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44c3acba3b5f442b8b3813701a08ecfb'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:05.324188 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-34c1682b-698d-4e87-abb6-6e210ccf5bc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44c3acba3b5f442b8b3813701a08ecfb'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:05.342383 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-34c1682b-698d-4e87-abb6-6e210ccf5bc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44c3acba3b5f442b8b3813701a08ecfb'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:05.343276 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-34c1682b-698d-4e87-abb6-6e210ccf5bc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44c3acba3b5f442b8b3813701a08ecfb'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:05.359330 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1083/2169] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Mar 30 07:17:05 2022] DELETE /identity/v3/users/44c3acba3b5f442b8b3813701a08ecfb => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:17:05.703074 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff39a33b-4ba3-4192-9ad9-39af7dc7635f admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:17:05.704601 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-ff39a33b-4ba3-4192-9ad9-39af7dc7635f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:17:05.717283 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff39a33b-4ba3-4192-9ad9-39af7dc7635f admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:17:05.774408 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6e370b-add6-4f34-86aa-37a81440b12a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:17:05.775311 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6e370b-add6-4f34-86aa-37a81440b12a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:05.775587 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6e370b-add6-4f34-86aa-37a81440b12a admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:05.775886 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6e370b-add6-4f34-86aa-37a81440b12a admin admin] PATH_INFO: `/v3/projects/2bd24ddda7a740cca3e01d971beeab0c` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:05.777063 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6e370b-add6-4f34-86aa-37a81440b12a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bd24ddda7a740cca3e01d971beeab0c)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:17:05.779051 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6e370b-add6-4f34-86aa-37a81440b12a admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:17:05.824409 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-ac6e370b-add6-4f34-86aa-37a81440b12a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bd24ddda7a740cca3e01d971beeab0c', 'request_id': 'req-ac6e370b-add6-4f34-86aa-37a81440b12a'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:05.830969 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-ac6e370b-add6-4f34-86aa-37a81440b12a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bd24ddda7a740cca3e01d971beeab0c', 'request_id': 'req-ac6e370b-add6-4f34-86aa-37a81440b12a'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:05.839684 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-ac6e370b-add6-4f34-86aa-37a81440b12a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bd24ddda7a740cca3e01d971beeab0c', 'request_id': 'req-ac6e370b-add6-4f34-86aa-37a81440b12a'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:05.851318 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-ac6e370b-add6-4f34-86aa-37a81440b12a admin admin] The token cache is being invalidate because project 2bd24ddda7a740cca3e01d971beeab0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79961) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 07:17:05.851607 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-ac6e370b-add6-4f34-86aa-37a81440b12a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:05.852291 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-ac6e370b-add6-4f34-86aa-37a81440b12a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:05.853991 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1087/2170] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Mar 30 07:17:05 2022] DELETE /identity/v3/projects/2bd24ddda7a740cca3e01d971beeab0c => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:17:05.860219 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a528c736-3de4-45b2-8f8a-6c7835567161 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:05.860711 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a528c736-3de4-45b2-8f8a-6c7835567161 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:05.860803 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a528c736-3de4-45b2-8f8a-6c7835567161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:05.879351 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-a528c736-3de4-45b2-8f8a-6c7835567161 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:17:05.880534 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-a528c736-3de4-45b2-8f8a-6c7835567161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:17:05.943924 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1084/2171] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:17:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:17:05.952793 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb9468-b260-4a6e-bef4-f28350a8607f None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:05.953187 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb9468-b260-4a6e-bef4-f28350a8607f None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:05.953466 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb9468-b260-4a6e-bef4-f28350a8607f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:05.972216 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-9deb9468-b260-4a6e-bef4-f28350a8607f None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:17:05.973424 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-9deb9468-b260-4a6e-bef4-f28350a8607f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:17:05.984588 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1088/2172] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:17:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:17:05.990192 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a528c736-3de4-45b2-8f8a-6c7835567161 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:17:06.003858 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a528c736-3de4-45b2-8f8a-6c7835567161 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:17:06.009921 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7974847e-3948-44d9-9b71-89bb173da45e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:17:06.010577 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7974847e-3948-44d9-9b71-89bb173da45e admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:06.010859 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7974847e-3948-44d9-9b71-89bb173da45e admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:06.011131 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7974847e-3948-44d9-9b71-89bb173da45e admin admin] PATH_INFO: `/v3/domains` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:06.011892 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7974847e-3948-44d9-9b71-89bb173da45e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:17:06.012199 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7974847e-3948-44d9-9b71-89bb173da45e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:17:06.013909 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7974847e-3948-44d9-9b71-89bb173da45e admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:17:06.029734 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1085/2173] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Mar 30 07:17:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:17:06.031104 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deb9468-b260-4a6e-bef4-f28350a8607f None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:17:06.044645 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deb9468-b260-4a6e-bef4-f28350a8607f None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:17:06.049842 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c92778-e454-496c-8c39-c5359eee446e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:17:06.050529 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c92778-e454-496c-8c39-c5359eee446e admin admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:06.051361 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c92778-e454-496c-8c39-c5359eee446e admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:06.051835 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c92778-e454-496c-8c39-c5359eee446e admin admin] PATH_INFO: `/v3/projects` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:06.052560 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c92778-e454-496c-8c39-c5359eee446e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:17:06.054971 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c92778-e454-496c-8c39-c5359eee446e admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:17:06.087452 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1089/2174] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Mar 30 07:17:06 2022] POST /identity/v3/projects => generated 371 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:17:06.089337 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7974847e-3948-44d9-9b71-89bb173da45e admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:17:06.100403 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7974847e-3948-44d9-9b71-89bb173da45e admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:17:06.162147 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd923747-1ebc-47aa-9a3e-a354eec98eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:17:06.162838 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd923747-1ebc-47aa-9a3e-a354eec98eec admin admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:06.163164 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd923747-1ebc-47aa-9a3e-a354eec98eec admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:06.163439 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd923747-1ebc-47aa-9a3e-a354eec98eec admin admin] PATH_INFO: `/v3/users` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:06.164241 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd923747-1ebc-47aa-9a3e-a354eec98eec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:17:06.166200 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd923747-1ebc-47aa-9a3e-a354eec98eec admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:17:06.186183 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1086/2175] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Mar 30 07:17:06 2022] POST /identity/v3/users => generated 286 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:17:06.190552 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c92778-e454-496c-8c39-c5359eee446e admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:17:06.201206 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c92778-e454-496c-8c39-c5359eee446e admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:17:06.206273 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1632c0-48be-4e62-ab9e-9a9588489f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:17:06.207029 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1632c0-48be-4e62-ab9e-9a9588489f29 admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:06.207312 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1632c0-48be-4e62-ab9e-9a9588489f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:06.207610 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1632c0-48be-4e62-ab9e-9a9588489f29 admin admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:06.208368 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1632c0-48be-4e62-ab9e-9a9588489f29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:17:06.210017 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1632c0-48be-4e62-ab9e-9a9588489f29 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:17:06.221970 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1090/2176] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:17:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:17:06.226249 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd923747-1ebc-47aa-9a3e-a354eec98eec admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:17:06.237078 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd923747-1ebc-47aa-9a3e-a354eec98eec admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:17:06.241927 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1c7b3a-3687-477d-8874-88754ff4dcee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:17:06.242595 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1c7b3a-3687-477d-8874-88754ff4dcee admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:06.242886 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1c7b3a-3687-477d-8874-88754ff4dcee admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:06.243233 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1c7b3a-3687-477d-8874-88754ff4dcee admin admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:06.244044 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1c7b3a-3687-477d-8874-88754ff4dcee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:17:06.245647 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1c7b3a-3687-477d-8874-88754ff4dcee admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:17:06.257440 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1087/2177] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:17:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:17:06.261273 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1632c0-48be-4e62-ab9e-9a9588489f29 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:17:06.272224 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1632c0-48be-4e62-ab9e-9a9588489f29 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:17:06.277378 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181c7c69-10bd-4ce1-aa1f-294594b0140a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:17:06.278548 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c7c69-10bd-4ce1-aa1f-294594b0140a admin admin] REQUEST_METHOD: `PUT` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:06.278823 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c7c69-10bd-4ce1-aa1f-294594b0140a admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:06.279112 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c7c69-10bd-4ce1-aa1f-294594b0140a admin admin] PATH_INFO: `/v3/projects/a94d5f8bbf634c3bbe541efbd5d10028/users/261ba0750bf840f48ebdaf936c773792/roles/5d79031a64754b57ba120367465e2252` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:06.294257 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181c7c69-10bd-4ce1-aa1f-294594b0140a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a94d5f8bbf634c3bbe541efbd5d10028, user_id=261ba0750bf840f48ebdaf936c773792, role_id=5d79031a64754b57ba120367465e2252)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:17:06.297089 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181c7c69-10bd-4ce1-aa1f-294594b0140a admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:17:06.312521 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1091/2178] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:17:06 2022] PUT /identity/v3/projects/a94d5f8bbf634c3bbe541efbd5d10028/users/261ba0750bf840f48ebdaf936c773792/roles/5d79031a64754b57ba120367465e2252 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:17:06.323721 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd551a2e-5c34-4209-b308-a14bb6b48c94 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:06.324137 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd551a2e-5c34-4209-b308-a14bb6b48c94 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:06.324423 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd551a2e-5c34-4209-b308-a14bb6b48c94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:06.353187 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-cd551a2e-5c34-4209-b308-a14bb6b48c94 None None] MFA Rules not processed for user `261ba0750bf840f48ebdaf936c773792`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:17:06.354485 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-cd551a2e-5c34-4209-b308-a14bb6b48c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:17:06.422561 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1088/2179] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:17:06 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:17:06.434985 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181c7c69-10bd-4ce1-aa1f-294594b0140a admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:17:06.436858 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-181c7c69-10bd-4ce1-aa1f-294594b0140a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:17:06.484095 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd551a2e-5c34-4209-b308-a14bb6b48c94 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:17:06.485641 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-cd551a2e-5c34-4209-b308-a14bb6b48c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:17:06.501646 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181c7c69-10bd-4ce1-aa1f-294594b0140a admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:17:06.506358 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6135ad-cbb9-4098-97c0-14fc2f249c21 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e2fda180e8d448d895c40cdad34bc4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:17:06.508680 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6135ad-cbb9-4098-97c0-14fc2f249c21 service cinder] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:06.508680 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6135ad-cbb9-4098-97c0-14fc2f249c21 service cinder] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:06.508680 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6135ad-cbb9-4098-97c0-14fc2f249c21 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:06.517631 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6135ad-cbb9-4098-97c0-14fc2f249c21 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:17:06.519221 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6135ad-cbb9-4098-97c0-14fc2f249c21 service cinder] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:17:06.530600 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1092/2180] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:17:06 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:17:06.557476 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6135ad-cbb9-4098-97c0-14fc2f249c21 service cinder] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:17:06.586433 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd551a2e-5c34-4209-b308-a14bb6b48c94 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:17:06.593880 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d99f39e-91f4-4cb7-8a69-b359545f4bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:17:06.594806 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d99f39e-91f4-4cb7-8a69-b359545f4bc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:06.595757 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d99f39e-91f4-4cb7-8a69-b359545f4bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:06.596073 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d99f39e-91f4-4cb7-8a69-b359545f4bc0 admin admin] PATH_INFO: `/v3/users/cdf171cb6ae44eed81b00b968850bf0a` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:06.597491 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d99f39e-91f4-4cb7-8a69-b359545f4bc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdf171cb6ae44eed81b00b968850bf0a)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:17:06.600162 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d99f39e-91f4-4cb7-8a69-b359545f4bc0 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:17:06.631577 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6135ad-cbb9-4098-97c0-14fc2f249c21 service cinder] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:17:06.639960 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6982a6-0848-4ab9-a54e-2e61349eac7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:17:06.641162 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6982a6-0848-4ab9-a54e-2e61349eac7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:06.641637 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6982a6-0848-4ab9-a54e-2e61349eac7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:06.641851 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6982a6-0848-4ab9-a54e-2e61349eac7d admin admin] PATH_INFO: `/v3/users/261ba0750bf840f48ebdaf936c773792` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:06.643257 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6982a6-0848-4ab9-a54e-2e61349eac7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=261ba0750bf840f48ebdaf936c773792)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:17:06.645362 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6982a6-0848-4ab9-a54e-2e61349eac7d admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:17:06.661533 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-6d99f39e-91f4-4cb7-8a69-b359545f4bc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdf171cb6ae44eed81b00b968850bf0a'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:06.662335 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-6d99f39e-91f4-4cb7-8a69-b359545f4bc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdf171cb6ae44eed81b00b968850bf0a'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:06.673683 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-6d99f39e-91f4-4cb7-8a69-b359545f4bc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdf171cb6ae44eed81b00b968850bf0a'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:06.691421 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-6d99f39e-91f4-4cb7-8a69-b359545f4bc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdf171cb6ae44eed81b00b968850bf0a'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:06.692806 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-6d99f39e-91f4-4cb7-8a69-b359545f4bc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdf171cb6ae44eed81b00b968850bf0a'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:06.707867 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1089/2181] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Mar 30 07:17:06 2022] DELETE /identity/v3/users/cdf171cb6ae44eed81b00b968850bf0a => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:17:06.711844 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f261e-5d91-4538-b6e5-7c20da4bc4f0 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:06.712141 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f261e-5d91-4538-b6e5-7c20da4bc4f0 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:06.712421 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f261e-5d91-4538-b6e5-7c20da4bc4f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:06.729082 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-cb6982a6-0848-4ab9-a54e-2e61349eac7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '261ba0750bf840f48ebdaf936c773792'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:06.729871 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-cb6982a6-0848-4ab9-a54e-2e61349eac7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '261ba0750bf840f48ebdaf936c773792'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:06.730503 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-cb6982a6-0848-4ab9-a54e-2e61349eac7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '261ba0750bf840f48ebdaf936c773792'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:06.742570 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-652f261e-5d91-4538-b6e5-7c20da4bc4f0 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:17:06.743852 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-652f261e-5d91-4538-b6e5-7c20da4bc4f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:17:06.747215 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-cb6982a6-0848-4ab9-a54e-2e61349eac7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '261ba0750bf840f48ebdaf936c773792'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:06.761901 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-cb6982a6-0848-4ab9-a54e-2e61349eac7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '261ba0750bf840f48ebdaf936c773792'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:06.785258 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1093/2182] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Mar 30 07:17:06 2022] DELETE /identity/v3/users/261ba0750bf840f48ebdaf936c773792 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:17:06.804324 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d5c9cf-248c-4cf9-9ba8-31ff55d7dd75 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:06.804892 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d5c9cf-248c-4cf9-9ba8-31ff55d7dd75 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:06.805355 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d5c9cf-248c-4cf9-9ba8-31ff55d7dd75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:06.814376 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1090/2183] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:17:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:17:06.824710 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652f261e-5d91-4538-b6e5-7c20da4bc4f0 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:17:06.826654 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-652f261e-5d91-4538-b6e5-7c20da4bc4f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:17:06.831976 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-87d5c9cf-248c-4cf9-9ba8-31ff55d7dd75 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:17:06.833266 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-87d5c9cf-248c-4cf9-9ba8-31ff55d7dd75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:17:06.888847 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652f261e-5d91-4538-b6e5-7c20da4bc4f0 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:17:06.899513 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1094/2184] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:17:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:17:06.909884 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d5c9cf-248c-4cf9-9ba8-31ff55d7dd75 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:17:06.911716 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-87d5c9cf-248c-4cf9-9ba8-31ff55d7dd75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:17:06.943722 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d256f9-728f-451e-b3f4-225b6498db0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3802cb341445f994b9204744060ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:17:06.944474 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d256f9-728f-451e-b3f4-225b6498db0e service neutron] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:06.944764 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d256f9-728f-451e-b3f4-225b6498db0e service neutron] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:06.945043 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d256f9-728f-451e-b3f4-225b6498db0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:06.955505 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d256f9-728f-451e-b3f4-225b6498db0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:17:06.957028 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d256f9-728f-451e-b3f4-225b6498db0e service neutron] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:17:06.966947 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1091/2185] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:17:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:17:06.972894 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d5c9cf-248c-4cf9-9ba8-31ff55d7dd75 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:17:06.976916 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688355b5-83ce-4c83-a9a5-cb4222660095 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3802cb341445f994b9204744060ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:17:06.977660 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688355b5-83ce-4c83-a9a5-cb4222660095 service neutron] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:06.978795 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688355b5-83ce-4c83-a9a5-cb4222660095 service neutron] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:06.979140 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688355b5-83ce-4c83-a9a5-cb4222660095 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:06.989563 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688355b5-83ce-4c83-a9a5-cb4222660095 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:17:06.991416 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688355b5-83ce-4c83-a9a5-cb4222660095 service neutron] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:17:07.001617 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1095/2186] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:17:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:17:07.018990 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d256f9-728f-451e-b3f4-225b6498db0e service neutron] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:17:07.020555 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-a0d256f9-728f-451e-b3f4-225b6498db0e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:17:07.035083 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d256f9-728f-451e-b3f4-225b6498db0e service neutron] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:17:07.043109 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3ae629-969b-47cf-b6f6-00f48c3c1267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:17:07.044558 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ae629-969b-47cf-b6f6-00f48c3c1267 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:07.044867 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ae629-969b-47cf-b6f6-00f48c3c1267 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:07.045215 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ae629-969b-47cf-b6f6-00f48c3c1267 admin admin] PATH_INFO: `/v3/users/45e27ff54dde41a69a856daf4509b302` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:07.046506 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3ae629-969b-47cf-b6f6-00f48c3c1267 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45e27ff54dde41a69a856daf4509b302)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:17:07.048600 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3ae629-969b-47cf-b6f6-00f48c3c1267 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:17:07.113755 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-4c3ae629-969b-47cf-b6f6-00f48c3c1267 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45e27ff54dde41a69a856daf4509b302'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:07.115284 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-4c3ae629-969b-47cf-b6f6-00f48c3c1267 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45e27ff54dde41a69a856daf4509b302'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:07.131424 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-4c3ae629-969b-47cf-b6f6-00f48c3c1267 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45e27ff54dde41a69a856daf4509b302'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:07.153945 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-4c3ae629-969b-47cf-b6f6-00f48c3c1267 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45e27ff54dde41a69a856daf4509b302'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:07.154863 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-4c3ae629-969b-47cf-b6f6-00f48c3c1267 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45e27ff54dde41a69a856daf4509b302'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:07.172794 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1092/2187] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Mar 30 07:17:07 2022] DELETE /identity/v3/users/45e27ff54dde41a69a856daf4509b302 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:17:07.178180 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4502e66b-9ff2-43a8-a93f-c6148a61517d None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:07.179124 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4502e66b-9ff2-43a8-a93f-c6148a61517d None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:07.179566 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4502e66b-9ff2-43a8-a93f-c6148a61517d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:07.195640 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3ae629-969b-47cf-b6f6-00f48c3c1267 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:17:07.198447 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-4c3ae629-969b-47cf-b6f6-00f48c3c1267 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:17:07.214461 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-4502e66b-9ff2-43a8-a93f-c6148a61517d None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:17:07.216585 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-4502e66b-9ff2-43a8-a93f-c6148a61517d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:17:07.314085 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1096/2188] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:17:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 07:17:07.316759 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3ae629-969b-47cf-b6f6-00f48c3c1267 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:17:07.323994 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a4fe94-328e-442d-b511-1bc9b66e64bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:17:07.324948 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a4fe94-328e-442d-b511-1bc9b66e64bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:07.325235 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a4fe94-328e-442d-b511-1bc9b66e64bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:07.325510 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a4fe94-328e-442d-b511-1bc9b66e64bf admin admin] PATH_INFO: `/v3/users/4a1956a5792b4f9c8b1a96e4994b1d34` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:07.326863 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a4fe94-328e-442d-b511-1bc9b66e64bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a1956a5792b4f9c8b1a96e4994b1d34)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:17:07.328864 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a4fe94-328e-442d-b511-1bc9b66e64bf admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:17:07.329832 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4502e66b-9ff2-43a8-a93f-c6148a61517d None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:17:07.331963 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-4502e66b-9ff2-43a8-a93f-c6148a61517d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:17:07.411375 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-79a4fe94-328e-442d-b511-1bc9b66e64bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a1956a5792b4f9c8b1a96e4994b1d34'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:07.412117 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-79a4fe94-328e-442d-b511-1bc9b66e64bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a1956a5792b4f9c8b1a96e4994b1d34'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:07.423050 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-79a4fe94-328e-442d-b511-1bc9b66e64bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a1956a5792b4f9c8b1a96e4994b1d34'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:07.423236 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4502e66b-9ff2-43a8-a93f-c6148a61517d None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:17:07.435971 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cb8250-a9e8-4589-9e40-e44528162378 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3802cb341445f994b9204744060ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:17:07.436629 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cb8250-a9e8-4589-9e40-e44528162378 service neutron] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:07.436961 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cb8250-a9e8-4589-9e40-e44528162378 service neutron] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:07.437155 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cb8250-a9e8-4589-9e40-e44528162378 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:07.439475 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-f4cb8250-a9e8-4589-9e40-e44528162378 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:17:07.440913 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-79a4fe94-328e-442d-b511-1bc9b66e64bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a1956a5792b4f9c8b1a96e4994b1d34'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:07.441684 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-79a4fe94-328e-442d-b511-1bc9b66e64bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a1956a5792b4f9c8b1a96e4994b1d34'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:07.453744 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cb8250-a9e8-4589-9e40-e44528162378 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:17:07.455203 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cb8250-a9e8-4589-9e40-e44528162378 service neutron] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:17:07.457091 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1093/2189] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Mar 30 07:17:07 2022] DELETE /identity/v3/users/4a1956a5792b4f9c8b1a96e4994b1d34 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:17:07.460697 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a4fe94-328e-442d-b511-1bc9b66e64bf admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:17:07.462080 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-79a4fe94-328e-442d-b511-1bc9b66e64bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:17:07.465497 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1097/2190] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:17:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:17:07.466195 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cb8250-a9e8-4589-9e40-e44528162378 service neutron] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:17:07.467484 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-f4cb8250-a9e8-4589-9e40-e44528162378 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:17:07.479323 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cb8250-a9e8-4589-9e40-e44528162378 service neutron] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:17:07.533542 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a4fe94-328e-442d-b511-1bc9b66e64bf admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:17:07.539614 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2d8aaa-49c9-47bb-ba0a-a81ce2d0c58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:17:07.541821 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dea179-5121-4562-87fb-b10829097b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:17:07.541988 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d8aaa-49c9-47bb-ba0a-a81ce2d0c58d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:07.542380 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d8aaa-49c9-47bb-ba0a-a81ce2d0c58d admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:07.542724 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d8aaa-49c9-47bb-ba0a-a81ce2d0c58d admin admin] PATH_INFO: `/v3/projects/d814c230ebb24151bfc5b00bddf886ab` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:07.542824 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dea179-5121-4562-87fb-b10829097b4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:07.543012 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dea179-5121-4562-87fb-b10829097b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:07.543389 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dea179-5121-4562-87fb-b10829097b4e admin admin] PATH_INFO: `/v3/projects/a94d5f8bbf634c3bbe541efbd5d10028` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:07.544382 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2d8aaa-49c9-47bb-ba0a-a81ce2d0c58d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d814c230ebb24151bfc5b00bddf886ab)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:17:07.544794 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dea179-5121-4562-87fb-b10829097b4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a94d5f8bbf634c3bbe541efbd5d10028)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:17:07.546766 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dea179-5121-4562-87fb-b10829097b4e admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:17:07.546961 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2d8aaa-49c9-47bb-ba0a-a81ce2d0c58d admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:17:07.608713 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-84dea179-5121-4562-87fb-b10829097b4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a94d5f8bbf634c3bbe541efbd5d10028', 'request_id': 'req-84dea179-5121-4562-87fb-b10829097b4e'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:07.608938 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-da2d8aaa-49c9-47bb-ba0a-a81ce2d0c58d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd814c230ebb24151bfc5b00bddf886ab', 'request_id': 'req-da2d8aaa-49c9-47bb-ba0a-a81ce2d0c58d'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:07.616336 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-84dea179-5121-4562-87fb-b10829097b4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a94d5f8bbf634c3bbe541efbd5d10028', 'request_id': 'req-84dea179-5121-4562-87fb-b10829097b4e'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:07.619138 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-da2d8aaa-49c9-47bb-ba0a-a81ce2d0c58d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd814c230ebb24151bfc5b00bddf886ab', 'request_id': 'req-da2d8aaa-49c9-47bb-ba0a-a81ce2d0c58d'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:07.624798 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-84dea179-5121-4562-87fb-b10829097b4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a94d5f8bbf634c3bbe541efbd5d10028', 'request_id': 'req-84dea179-5121-4562-87fb-b10829097b4e'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:07.626765 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-da2d8aaa-49c9-47bb-ba0a-a81ce2d0c58d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd814c230ebb24151bfc5b00bddf886ab', 'request_id': 'req-da2d8aaa-49c9-47bb-ba0a-a81ce2d0c58d'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:07.638505 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-da2d8aaa-49c9-47bb-ba0a-a81ce2d0c58d admin admin] The token cache is being invalidate because project d814c230ebb24151bfc5b00bddf886ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79960) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 07:17:07.638847 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-da2d8aaa-49c9-47bb-ba0a-a81ce2d0c58d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:07.639385 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-84dea179-5121-4562-87fb-b10829097b4e admin admin] The token cache is being invalidate because project a94d5f8bbf634c3bbe541efbd5d10028 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79961) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 07:17:07.639678 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-84dea179-5121-4562-87fb-b10829097b4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:07.640331 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-da2d8aaa-49c9-47bb-ba0a-a81ce2d0c58d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:07.640452 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-84dea179-5121-4562-87fb-b10829097b4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:07.641981 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1094/2191] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Mar 30 07:17:07 2022] DELETE /identity/v3/projects/d814c230ebb24151bfc5b00bddf886ab => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:17:07.657387 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1098/2192] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Mar 30 07:17:07 2022] DELETE /identity/v3/projects/a94d5f8bbf634c3bbe541efbd5d10028 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:17:07.658402 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca015e2d-03e7-4f8c-9c9f-0d7a8fd4b73e None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:07.658402 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca015e2d-03e7-4f8c-9c9f-0d7a8fd4b73e None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:07.658402 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca015e2d-03e7-4f8c-9c9f-0d7a8fd4b73e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:07.658634 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dea179-5121-4562-87fb-b10829097b4e admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:17:07.658634 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-84dea179-5121-4562-87fb-b10829097b4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:17:07.682530 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-ca015e2d-03e7-4f8c-9c9f-0d7a8fd4b73e None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:17:07.684244 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-ca015e2d-03e7-4f8c-9c9f-0d7a8fd4b73e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:17:07.755326 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dea179-5121-4562-87fb-b10829097b4e admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:17:07.771385 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51b52e4-ca58-40f1-88dd-9ed2ac5062df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:17:07.773158 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51b52e4-ca58-40f1-88dd-9ed2ac5062df admin admin] REQUEST_METHOD: `DELETE` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:07.773443 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51b52e4-ca58-40f1-88dd-9ed2ac5062df admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:07.773722 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51b52e4-ca58-40f1-88dd-9ed2ac5062df admin admin] PATH_INFO: `/v3/users/059d361ad4584c1f816ed161caa1ba1e` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:07.776884 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51b52e4-ca58-40f1-88dd-9ed2ac5062df admin admin] RBAC: Authorizing `identity:delete_user(user_id=059d361ad4584c1f816ed161caa1ba1e)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:17:07.778742 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51b52e4-ca58-40f1-88dd-9ed2ac5062df admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:17:07.808218 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1095/2193] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:17:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:17:07.860964 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca015e2d-03e7-4f8c-9c9f-0d7a8fd4b73e None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:17:07.863605 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-ca015e2d-03e7-4f8c-9c9f-0d7a8fd4b73e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:17:07.872461 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-e51b52e4-ca58-40f1-88dd-9ed2ac5062df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '059d361ad4584c1f816ed161caa1ba1e'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:07.873364 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-e51b52e4-ca58-40f1-88dd-9ed2ac5062df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '059d361ad4584c1f816ed161caa1ba1e'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:07.873843 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-e51b52e4-ca58-40f1-88dd-9ed2ac5062df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '059d361ad4584c1f816ed161caa1ba1e'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:07.888807 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-e51b52e4-ca58-40f1-88dd-9ed2ac5062df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '059d361ad4584c1f816ed161caa1ba1e'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:07.912306 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-e51b52e4-ca58-40f1-88dd-9ed2ac5062df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '059d361ad4584c1f816ed161caa1ba1e'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:07.964462 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1099/2194] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Mar 30 07:17:07 2022] DELETE /identity/v3/users/059d361ad4584c1f816ed161caa1ba1e => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 07:17:07.965067 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51b52e4-ca58-40f1-88dd-9ed2ac5062df admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:17:07.968965 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-e51b52e4-ca58-40f1-88dd-9ed2ac5062df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:17:07.981319 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca015e2d-03e7-4f8c-9c9f-0d7a8fd4b73e None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:17:08.046880 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52482b8-71ac-46ee-ba99-05fce1b820e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3802cb341445f994b9204744060ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:17:08.047703 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52482b8-71ac-46ee-ba99-05fce1b820e2 service neutron] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:08.048158 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52482b8-71ac-46ee-ba99-05fce1b820e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:08.048573 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52482b8-71ac-46ee-ba99-05fce1b820e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:08.052191 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-e52482b8-71ac-46ee-ba99-05fce1b820e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:17:08.071425 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51b52e4-ca58-40f1-88dd-9ed2ac5062df admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:17:08.077906 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b187fe-f6ab-4b70-ae2c-f8c9930c6cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:17:08.078799 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b187fe-f6ab-4b70-ae2c-f8c9930c6cac admin admin] REQUEST_METHOD: `DELETE` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:08.079077 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b187fe-f6ab-4b70-ae2c-f8c9930c6cac admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:08.079405 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b187fe-f6ab-4b70-ae2c-f8c9930c6cac admin admin] PATH_INFO: `/v3/projects/5314fa07829e4ea5b84250ab30bdc6b3` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:08.080960 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b187fe-f6ab-4b70-ae2c-f8c9930c6cac admin admin] RBAC: Authorizing `identity:delete_project(project_id=5314fa07829e4ea5b84250ab30bdc6b3)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:17:08.082793 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b187fe-f6ab-4b70-ae2c-f8c9930c6cac admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:17:08.141549 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52482b8-71ac-46ee-ba99-05fce1b820e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:17:08.142585 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-91b187fe-f6ab-4b70-ae2c-f8c9930c6cac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5314fa07829e4ea5b84250ab30bdc6b3', 'request_id': 'req-91b187fe-f6ab-4b70-ae2c-f8c9930c6cac'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:08.143360 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52482b8-71ac-46ee-ba99-05fce1b820e2 service neutron] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:17:08.149086 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-91b187fe-f6ab-4b70-ae2c-f8c9930c6cac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5314fa07829e4ea5b84250ab30bdc6b3', 'request_id': 'req-91b187fe-f6ab-4b70-ae2c-f8c9930c6cac'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:08.156162 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1096/2195] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:17:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:17:08.160777 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-91b187fe-f6ab-4b70-ae2c-f8c9930c6cac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5314fa07829e4ea5b84250ab30bdc6b3', 'request_id': 'req-91b187fe-f6ab-4b70-ae2c-f8c9930c6cac'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:08.175410 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-91b187fe-f6ab-4b70-ae2c-f8c9930c6cac admin admin] The token cache is being invalidate because project 5314fa07829e4ea5b84250ab30bdc6b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79961) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 07:17:08.175699 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-91b187fe-f6ab-4b70-ae2c-f8c9930c6cac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:08.176399 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-91b187fe-f6ab-4b70-ae2c-f8c9930c6cac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:08.177983 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1100/2196] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Mar 30 07:17:07 2022] DELETE /identity/v3/projects/5314fa07829e4ea5b84250ab30bdc6b3 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:17:08.182484 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52482b8-71ac-46ee-ba99-05fce1b820e2 service neutron] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:17:08.192524 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52482b8-71ac-46ee-ba99-05fce1b820e2 service neutron] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:17:08.256215 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaada491-23e9-4592-bf79-8099e9ffca11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:17:08.257650 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaada491-23e9-4592-bf79-8099e9ffca11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:08.258064 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaada491-23e9-4592-bf79-8099e9ffca11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:08.258190 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaada491-23e9-4592-bf79-8099e9ffca11 admin admin] PATH_INFO: `/v3/users/2f9450fd9af045cfbfd43109b618848c` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:08.259457 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaada491-23e9-4592-bf79-8099e9ffca11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f9450fd9af045cfbfd43109b618848c)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:17:08.261441 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaada491-23e9-4592-bf79-8099e9ffca11 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:17:08.311445 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-eaada491-23e9-4592-bf79-8099e9ffca11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f9450fd9af045cfbfd43109b618848c'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:08.312173 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-eaada491-23e9-4592-bf79-8099e9ffca11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f9450fd9af045cfbfd43109b618848c'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:08.322195 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-eaada491-23e9-4592-bf79-8099e9ffca11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f9450fd9af045cfbfd43109b618848c'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:08.337253 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-eaada491-23e9-4592-bf79-8099e9ffca11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f9450fd9af045cfbfd43109b618848c'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:08.337964 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-eaada491-23e9-4592-bf79-8099e9ffca11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f9450fd9af045cfbfd43109b618848c'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:08.353119 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1097/2197] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Mar 30 07:17:08 2022] DELETE /identity/v3/users/2f9450fd9af045cfbfd43109b618848c => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:17:08.354381 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b187fe-f6ab-4b70-ae2c-f8c9930c6cac admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:17:08.356438 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-91b187fe-f6ab-4b70-ae2c-f8c9930c6cac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:17:08.369923 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b187fe-f6ab-4b70-ae2c-f8c9930c6cac admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:17:08.439187 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61296fbf-acec-4940-a4ec-db643f6afc12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:17:08.440132 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61296fbf-acec-4940-a4ec-db643f6afc12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:08.440410 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61296fbf-acec-4940-a4ec-db643f6afc12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:08.440686 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61296fbf-acec-4940-a4ec-db643f6afc12 admin admin] PATH_INFO: `/v3/projects/e8494ee6daad4f20b2c966a4aca390e8` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:08.441886 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61296fbf-acec-4940-a4ec-db643f6afc12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8494ee6daad4f20b2c966a4aca390e8)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:17:08.443826 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61296fbf-acec-4940-a4ec-db643f6afc12 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:17:08.492677 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-61296fbf-acec-4940-a4ec-db643f6afc12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8494ee6daad4f20b2c966a4aca390e8', 'request_id': 'req-61296fbf-acec-4940-a4ec-db643f6afc12'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:08.498041 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-61296fbf-acec-4940-a4ec-db643f6afc12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8494ee6daad4f20b2c966a4aca390e8', 'request_id': 'req-61296fbf-acec-4940-a4ec-db643f6afc12'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:08.505845 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-61296fbf-acec-4940-a4ec-db643f6afc12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8494ee6daad4f20b2c966a4aca390e8', 'request_id': 'req-61296fbf-acec-4940-a4ec-db643f6afc12'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:08.518090 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-61296fbf-acec-4940-a4ec-db643f6afc12 admin admin] The token cache is being invalidate because project e8494ee6daad4f20b2c966a4aca390e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79961) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 07:17:08.518361 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-61296fbf-acec-4940-a4ec-db643f6afc12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:08.519109 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-61296fbf-acec-4940-a4ec-db643f6afc12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:08.520898 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1101/2198] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Mar 30 07:17:08 2022] DELETE /identity/v3/projects/e8494ee6daad4f20b2c966a4aca390e8 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:17:08.527445 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4744db16-9f5f-4628-9276-ee35ff197188 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:08.527789 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4744db16-9f5f-4628-9276-ee35ff197188 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:08.528109 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4744db16-9f5f-4628-9276-ee35ff197188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:08.546698 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-4744db16-9f5f-4628-9276-ee35ff197188 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:17:08.547932 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-4744db16-9f5f-4628-9276-ee35ff197188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:17:08.612412 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61296fbf-acec-4940-a4ec-db643f6afc12 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:17:08.614592 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1098/2199] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:17:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 07:17:08.620377 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-61296fbf-acec-4940-a4ec-db643f6afc12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:17:08.624461 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648eeb95-3a7b-4878-b1fb-35356b742374 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:08.624755 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648eeb95-3a7b-4878-b1fb-35356b742374 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:08.625033 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648eeb95-3a7b-4878-b1fb-35356b742374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:08.635244 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61296fbf-acec-4940-a4ec-db643f6afc12 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:17:08.647463 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c34f32-b69b-4826-9f4e-6530d9226211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:17:08.648650 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c34f32-b69b-4826-9f4e-6530d9226211 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:08.648936 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c34f32-b69b-4826-9f4e-6530d9226211 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:08.649047 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-648eeb95-3a7b-4878-b1fb-35356b742374 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:17:08.649211 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c34f32-b69b-4826-9f4e-6530d9226211 admin admin] PATH_INFO: `/v3/projects/3c48a8adc1d14a1d813ad9755c7ff057` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:08.650736 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c34f32-b69b-4826-9f4e-6530d9226211 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c48a8adc1d14a1d813ad9755c7ff057)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:17:08.651051 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-648eeb95-3a7b-4878-b1fb-35356b742374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:17:08.652832 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c34f32-b69b-4826-9f4e-6530d9226211 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:17:08.659677 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1099/2200] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:17:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:17:08.664237 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648eeb95-3a7b-4878-b1fb-35356b742374 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:17:08.675419 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648eeb95-3a7b-4878-b1fb-35356b742374 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:17:08.683739 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c835ada-78fd-4ed0-bf6a-d1dc5421bd9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:17:08.684453 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c835ada-78fd-4ed0-bf6a-d1dc5421bd9f admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:08.684904 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c835ada-78fd-4ed0-bf6a-d1dc5421bd9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:08.685320 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c835ada-78fd-4ed0-bf6a-d1dc5421bd9f admin admin] PATH_INFO: `/v3/domains` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:08.686049 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c835ada-78fd-4ed0-bf6a-d1dc5421bd9f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:17:08.686483 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c835ada-78fd-4ed0-bf6a-d1dc5421bd9f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:17:08.688668 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c835ada-78fd-4ed0-bf6a-d1dc5421bd9f admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:17:08.701493 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1100/2201] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Mar 30 07:17:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:17:08.705934 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c835ada-78fd-4ed0-bf6a-d1dc5421bd9f admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:17:08.712232 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-d6c34f32-b69b-4826-9f4e-6530d9226211 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c48a8adc1d14a1d813ad9755c7ff057', 'request_id': 'req-d6c34f32-b69b-4826-9f4e-6530d9226211'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:08.719705 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c835ada-78fd-4ed0-bf6a-d1dc5421bd9f admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:17:08.722451 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-d6c34f32-b69b-4826-9f4e-6530d9226211 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c48a8adc1d14a1d813ad9755c7ff057', 'request_id': 'req-d6c34f32-b69b-4826-9f4e-6530d9226211'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:08.730479 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-d6c34f32-b69b-4826-9f4e-6530d9226211 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c48a8adc1d14a1d813ad9755c7ff057', 'request_id': 'req-d6c34f32-b69b-4826-9f4e-6530d9226211'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:08.742909 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-d6c34f32-b69b-4826-9f4e-6530d9226211 admin admin] The token cache is being invalidate because project 3c48a8adc1d14a1d813ad9755c7ff057 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79961) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 07:17:08.743222 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-d6c34f32-b69b-4826-9f4e-6530d9226211 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:08.744383 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-d6c34f32-b69b-4826-9f4e-6530d9226211 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:08.746074 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1102/2202] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Mar 30 07:17:08 2022] DELETE /identity/v3/projects/3c48a8adc1d14a1d813ad9755c7ff057 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:17:08.747030 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c34f32-b69b-4826-9f4e-6530d9226211 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:17:08.748385 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-d6c34f32-b69b-4826-9f4e-6530d9226211 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:17:08.808116 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d0c87e-6ad2-4613-b177-edc60b35f3ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:17:08.809106 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d0c87e-6ad2-4613-b177-edc60b35f3ec admin admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:08.809542 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d0c87e-6ad2-4613-b177-edc60b35f3ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:08.810009 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d0c87e-6ad2-4613-b177-edc60b35f3ec admin admin] PATH_INFO: `/v3/projects` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:08.810723 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d0c87e-6ad2-4613-b177-edc60b35f3ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:17:08.812735 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d0c87e-6ad2-4613-b177-edc60b35f3ec admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:17:08.825018 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c34f32-b69b-4826-9f4e-6530d9226211 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:17:08.831295 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73411b0-8365-49a5-b7b4-c81c43cf0d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:17:08.832289 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73411b0-8365-49a5-b7b4-c81c43cf0d7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:08.832572 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73411b0-8365-49a5-b7b4-c81c43cf0d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:08.832864 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73411b0-8365-49a5-b7b4-c81c43cf0d7f admin admin] PATH_INFO: `/v3/projects/fbd0ea69499941148775c3e39e336d7a` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:08.834146 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73411b0-8365-49a5-b7b4-c81c43cf0d7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbd0ea69499941148775c3e39e336d7a)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:17:08.836138 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73411b0-8365-49a5-b7b4-c81c43cf0d7f admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:17:08.844226 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1101/2203] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Mar 30 07:17:08 2022] POST /identity/v3/projects => generated 373 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 07:17:08.848095 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d0c87e-6ad2-4613-b177-edc60b35f3ec admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:17:08.850048 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-67d0c87e-6ad2-4613-b177-edc60b35f3ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:17:08.897836 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-f73411b0-8365-49a5-b7b4-c81c43cf0d7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbd0ea69499941148775c3e39e336d7a', 'request_id': 'req-f73411b0-8365-49a5-b7b4-c81c43cf0d7f'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:08.903719 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-f73411b0-8365-49a5-b7b4-c81c43cf0d7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbd0ea69499941148775c3e39e336d7a', 'request_id': 'req-f73411b0-8365-49a5-b7b4-c81c43cf0d7f'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:08.914380 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-f73411b0-8365-49a5-b7b4-c81c43cf0d7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbd0ea69499941148775c3e39e336d7a', 'request_id': 'req-f73411b0-8365-49a5-b7b4-c81c43cf0d7f'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:08.923686 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d0c87e-6ad2-4613-b177-edc60b35f3ec admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:17:08.927559 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-f73411b0-8365-49a5-b7b4-c81c43cf0d7f admin admin] The token cache is being invalidate because project fbd0ea69499941148775c3e39e336d7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79961) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 07:17:08.928036 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-f73411b0-8365-49a5-b7b4-c81c43cf0d7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:08.928944 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-f73411b0-8365-49a5-b7b4-c81c43cf0d7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:08.931713 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1103/2204] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Mar 30 07:17:08 2022] DELETE /identity/v3/projects/fbd0ea69499941148775c3e39e336d7a => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:17:08.937611 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3ed2a8-5818-4da4-a85c-a2c369f8d75b None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:08.937900 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3ed2a8-5818-4da4-a85c-a2c369f8d75b None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:08.938180 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3ed2a8-5818-4da4-a85c-a2c369f8d75b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:08.961146 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-5b3ed2a8-5818-4da4-a85c-a2c369f8d75b None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:17:08.962384 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-5b3ed2a8-5818-4da4-a85c-a2c369f8d75b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:17:08.997837 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eaed53-8ff1-4676-82b6-833be0551451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:17:08.998409 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eaed53-8ff1-4676-82b6-833be0551451 admin admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:08.998694 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eaed53-8ff1-4676-82b6-833be0551451 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:08.998968 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eaed53-8ff1-4676-82b6-833be0551451 admin admin] PATH_INFO: `/v3/users` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:08.999658 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eaed53-8ff1-4676-82b6-833be0551451 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:17:09.001619 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eaed53-8ff1-4676-82b6-833be0551451 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:17:09.026321 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1102/2205] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Mar 30 07:17:08 2022] POST /identity/v3/users => generated 287 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 07:17:09.026521 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1104/2206] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:17:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 07:17:09.027767 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eaed53-8ff1-4676-82b6-833be0551451 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:17:09.029605 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-01eaed53-8ff1-4676-82b6-833be0551451 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:17:09.029921 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb76741e-2c41-4273-ac75-ed80ebe9edfd None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:09.030206 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb76741e-2c41-4273-ac75-ed80ebe9edfd None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:09.030480 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb76741e-2c41-4273-ac75-ed80ebe9edfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:09.041707 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eaed53-8ff1-4676-82b6-833be0551451 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:17:09.046401 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d9d6ca-9b18-4eca-85ae-4fa01cf376ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:17:09.047062 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d9d6ca-9b18-4eca-85ae-4fa01cf376ab admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:09.047344 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d9d6ca-9b18-4eca-85ae-4fa01cf376ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:09.047619 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d9d6ca-9b18-4eca-85ae-4fa01cf376ab admin admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:09.048375 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d9d6ca-9b18-4eca-85ae-4fa01cf376ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:17:09.049410 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-fb76741e-2c41-4273-ac75-ed80ebe9edfd None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:17:09.049981 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d9d6ca-9b18-4eca-85ae-4fa01cf376ab admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:17:09.050599 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-fb76741e-2c41-4273-ac75-ed80ebe9edfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:17:09.059561 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1105/2207] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:17:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 07:17:09.060755 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1103/2208] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:17:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:17:09.064136 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb76741e-2c41-4273-ac75-ed80ebe9edfd None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:17:09.064425 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d9d6ca-9b18-4eca-85ae-4fa01cf376ab admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:17:09.073997 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d9d6ca-9b18-4eca-85ae-4fa01cf376ab admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:17:09.075584 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb76741e-2c41-4273-ac75-ed80ebe9edfd None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:17:09.079726 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fa4f50-d33c-41c9-b9cc-36ca403d1c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:17:09.080238 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8737b71-4ee4-4f54-a94d-fa2b7a012167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:17:09.080419 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fa4f50-d33c-41c9-b9cc-36ca403d1c2a admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:09.080702 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fa4f50-d33c-41c9-b9cc-36ca403d1c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:09.080973 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fa4f50-d33c-41c9-b9cc-36ca403d1c2a admin admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:09.081516 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8737b71-4ee4-4f54-a94d-fa2b7a012167 admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:09.081703 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fa4f50-d33c-41c9-b9cc-36ca403d1c2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:17:09.082066 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8737b71-4ee4-4f54-a94d-fa2b7a012167 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:09.082478 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8737b71-4ee4-4f54-a94d-fa2b7a012167 admin admin] PATH_INFO: `/v3/domains` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:09.083638 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fa4f50-d33c-41c9-b9cc-36ca403d1c2a admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:17:09.083725 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8737b71-4ee4-4f54-a94d-fa2b7a012167 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:17:09.083725 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8737b71-4ee4-4f54-a94d-fa2b7a012167 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:17:09.085496 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8737b71-4ee4-4f54-a94d-fa2b7a012167 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:17:09.094212 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1104/2209] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:17:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 30 07:17:09.101090 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1106/2210] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Mar 30 07:17:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:17:09.101292 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fa4f50-d33c-41c9-b9cc-36ca403d1c2a admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:17:09.102010 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8737b71-4ee4-4f54-a94d-fa2b7a012167 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:17:09.113795 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fa4f50-d33c-41c9-b9cc-36ca403d1c2a admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:17:09.114048 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8737b71-4ee4-4f54-a94d-fa2b7a012167 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:17:09.120365 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cffcca1-db13-4e7f-b5ea-ac3c0cf182bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:17:09.121502 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99b0dba-661e-41e8-9e35-a49bde249e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:17:09.121628 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cffcca1-db13-4e7f-b5ea-ac3c0cf182bc admin admin] REQUEST_METHOD: `PUT` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:09.121869 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cffcca1-db13-4e7f-b5ea-ac3c0cf182bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:09.122207 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cffcca1-db13-4e7f-b5ea-ac3c0cf182bc admin admin] PATH_INFO: `/v3/projects/c7ad5fa9994340d78e5489bc40885480/users/23be35231cd6493e917259e81b849c8d/roles/5d79031a64754b57ba120367465e2252` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:09.122311 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b0dba-661e-41e8-9e35-a49bde249e35 admin admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:09.122532 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b0dba-661e-41e8-9e35-a49bde249e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:09.122803 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b0dba-661e-41e8-9e35-a49bde249e35 admin admin] PATH_INFO: `/v3/projects` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:09.123687 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99b0dba-661e-41e8-9e35-a49bde249e35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:17:09.126445 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99b0dba-661e-41e8-9e35-a49bde249e35 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:17:09.139043 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cffcca1-db13-4e7f-b5ea-ac3c0cf182bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7ad5fa9994340d78e5489bc40885480, user_id=23be35231cd6493e917259e81b849c8d, role_id=5d79031a64754b57ba120367465e2252)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:17:09.141991 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cffcca1-db13-4e7f-b5ea-ac3c0cf182bc admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:17:09.161970 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1107/2211] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Mar 30 07:17:09 2022] POST /identity/v3/projects => generated 409 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:17:09.163145 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99b0dba-661e-41e8-9e35-a49bde249e35 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:17:09.163598 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1105/2212] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:17:09 2022] PUT /identity/v3/projects/c7ad5fa9994340d78e5489bc40885480/users/23be35231cd6493e917259e81b849c8d/roles/5d79031a64754b57ba120367465e2252 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 07:17:09.168418 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28274e7-d67b-45d8-8035-dc81cc420200 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:09.168709 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28274e7-d67b-45d8-8035-dc81cc420200 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:09.168990 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28274e7-d67b-45d8-8035-dc81cc420200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:09.196576 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-e28274e7-d67b-45d8-8035-dc81cc420200 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:17:09.197857 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-e28274e7-d67b-45d8-8035-dc81cc420200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:17:09.236388 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99b0dba-661e-41e8-9e35-a49bde249e35 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:17:09.241574 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fde827a-8f7f-49d9-9426-2c9666178119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:17:09.242265 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fde827a-8f7f-49d9-9426-2c9666178119 admin admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:09.242543 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fde827a-8f7f-49d9-9426-2c9666178119 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:09.242823 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fde827a-8f7f-49d9-9426-2c9666178119 admin admin] PATH_INFO: `/v3/users` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:09.243521 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fde827a-8f7f-49d9-9426-2c9666178119 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:17:09.245512 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fde827a-8f7f-49d9-9426-2c9666178119 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:17:09.269507 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1108/2213] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Mar 30 07:17:09 2022] POST /identity/v3/users => generated 305 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:17:09.273815 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fde827a-8f7f-49d9-9426-2c9666178119 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:17:09.281284 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1106/2214] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:17:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 07:17:09.286360 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fde827a-8f7f-49d9-9426-2c9666178119 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:17:09.290951 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28274e7-d67b-45d8-8035-dc81cc420200 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:17:09.292024 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e870c04-b634-4943-9341-4efbd5445ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:17:09.292860 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e870c04-b634-4943-9341-4efbd5445ede admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:09.292971 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-e28274e7-d67b-45d8-8035-dc81cc420200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:17:09.293237 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e870c04-b634-4943-9341-4efbd5445ede admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:09.293577 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e870c04-b634-4943-9341-4efbd5445ede admin admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:09.295166 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e870c04-b634-4943-9341-4efbd5445ede admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:17:09.296930 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e870c04-b634-4943-9341-4efbd5445ede admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:17:09.309598 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1109/2215] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:17:09 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 30 07:17:09.313683 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e870c04-b634-4943-9341-4efbd5445ede admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:17:09.325994 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e870c04-b634-4943-9341-4efbd5445ede admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:17:09.331155 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9b4dea-3ae2-4c53-a5ef-e06293374e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:17:09.332085 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9b4dea-3ae2-4c53-a5ef-e06293374e13 admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:09.332548 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9b4dea-3ae2-4c53-a5ef-e06293374e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:09.332995 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9b4dea-3ae2-4c53-a5ef-e06293374e13 admin admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:09.333980 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9b4dea-3ae2-4c53-a5ef-e06293374e13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:17:09.336039 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9b4dea-3ae2-4c53-a5ef-e06293374e13 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:17:09.347314 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1110/2216] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:17:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 30 07:17:09.351992 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9b4dea-3ae2-4c53-a5ef-e06293374e13 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:17:09.364326 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9b4dea-3ae2-4c53-a5ef-e06293374e13 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:17:09.364440 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28274e7-d67b-45d8-8035-dc81cc420200 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:17:09.370817 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f8dff5-ebca-4436-a2bb-ef944b07ca1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3802cb341445f994b9204744060ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:17:09.371676 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f8dff5-ebca-4436-a2bb-ef944b07ca1e service neutron] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:09.372207 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a123d2-14e5-4ad7-b627-e353042630b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:17:09.372462 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f8dff5-ebca-4436-a2bb-ef944b07ca1e service neutron] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:09.374233 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f8dff5-ebca-4436-a2bb-ef944b07ca1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:09.381495 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a123d2-14e5-4ad7-b627-e353042630b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:09.381966 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a123d2-14e5-4ad7-b627-e353042630b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:09.382313 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a123d2-14e5-4ad7-b627-e353042630b4 admin admin] PATH_INFO: `/v3/projects/46903c025ad74bdfb4e16df48f79f87c/users/1ed1a56ac6964b0cae5df9399b6ff54d/roles/5d79031a64754b57ba120367465e2252` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:09.385194 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f8dff5-ebca-4436-a2bb-ef944b07ca1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:17:09.386882 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f8dff5-ebca-4436-a2bb-ef944b07ca1e service neutron] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:17:09.402708 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a123d2-14e5-4ad7-b627-e353042630b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46903c025ad74bdfb4e16df48f79f87c, user_id=1ed1a56ac6964b0cae5df9399b6ff54d, role_id=5d79031a64754b57ba120367465e2252)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:17:09.405811 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a123d2-14e5-4ad7-b627-e353042630b4 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:17:09.410331 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1107/2217] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:17:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:17:09.430693 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1111/2218] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:17:09 2022] PUT /identity/v3/projects/46903c025ad74bdfb4e16df48f79f87c/users/1ed1a56ac6964b0cae5df9399b6ff54d/roles/5d79031a64754b57ba120367465e2252 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 07:17:09.443288 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dc337d-fa63-4e4e-9860-202a0d62fbbd None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:09.443589 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dc337d-fa63-4e4e-9860-202a0d62fbbd None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:09.443895 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dc337d-fa63-4e4e-9860-202a0d62fbbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:09.474532 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-b1dc337d-fa63-4e4e-9860-202a0d62fbbd None None] MFA Rules not processed for user `1ed1a56ac6964b0cae5df9399b6ff54d`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:17:09.476361 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-b1dc337d-fa63-4e4e-9860-202a0d62fbbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:17:09.548888 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1108/2219] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:17:09 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:17:09.553600 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a123d2-14e5-4ad7-b627-e353042630b4 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:17:09.625668 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a123d2-14e5-4ad7-b627-e353042630b4 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:17:09.630528 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b92758-8b7d-4673-8c23-32555088b80f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:17:09.631194 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b92758-8b7d-4673-8c23-32555088b80f admin admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:09.631681 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b92758-8b7d-4673-8c23-32555088b80f admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:09.632158 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b92758-8b7d-4673-8c23-32555088b80f admin admin] PATH_INFO: `/v3/projects` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:09.633105 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b92758-8b7d-4673-8c23-32555088b80f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:17:09.635021 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b92758-8b7d-4673-8c23-32555088b80f admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:17:09.663908 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1112/2220] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Mar 30 07:17:09 2022] POST /identity/v3/projects => generated 407 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:17:09.666022 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dc337d-fa63-4e4e-9860-202a0d62fbbd None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:17:09.678192 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dc337d-fa63-4e4e-9860-202a0d62fbbd None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:17:09.738612 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a759db8d-b259-44b8-9c66-f772de98fb85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:17:09.739889 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a759db8d-b259-44b8-9c66-f772de98fb85 admin admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:09.739889 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a759db8d-b259-44b8-9c66-f772de98fb85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:09.739889 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a759db8d-b259-44b8-9c66-f772de98fb85 admin admin] PATH_INFO: `/v3/users` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:09.741151 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a759db8d-b259-44b8-9c66-f772de98fb85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:17:09.744519 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a759db8d-b259-44b8-9c66-f772de98fb85 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:17:09.777088 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1109/2221] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Mar 30 07:17:09 2022] POST /identity/v3/users => generated 310 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:17:09.781822 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b92758-8b7d-4673-8c23-32555088b80f admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:17:09.795340 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b92758-8b7d-4673-8c23-32555088b80f admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:17:09.800256 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3b1c08-25fa-41cc-9d6c-851c38039a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:17:09.800930 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3b1c08-25fa-41cc-9d6c-851c38039a93 admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:09.801205 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3b1c08-25fa-41cc-9d6c-851c38039a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:09.801475 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3b1c08-25fa-41cc-9d6c-851c38039a93 admin admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:09.802202 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3b1c08-25fa-41cc-9d6c-851c38039a93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:17:09.804034 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3b1c08-25fa-41cc-9d6c-851c38039a93 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:17:09.822427 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1113/2222] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:17:09 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:17:09.823615 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a759db8d-b259-44b8-9c66-f772de98fb85 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:17:09.833812 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a759db8d-b259-44b8-9c66-f772de98fb85 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:17:09.838749 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7fc431-ed51-417c-9f8f-1266d9aca47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:17:09.839700 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7fc431-ed51-417c-9f8f-1266d9aca47c admin admin] REQUEST_METHOD: `PUT` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:09.840005 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7fc431-ed51-417c-9f8f-1266d9aca47c admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:09.840275 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7fc431-ed51-417c-9f8f-1266d9aca47c admin admin] PATH_INFO: `/v3/projects/a31dde60ac264cdab45f3cc0d3a4611d/users/95ba19d59cda4b9782b60118c693ffad/roles/1c39b9ab8cfd4c0ea71845831920a845` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:09.856285 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7fc431-ed51-417c-9f8f-1266d9aca47c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a31dde60ac264cdab45f3cc0d3a4611d, user_id=95ba19d59cda4b9782b60118c693ffad, role_id=1c39b9ab8cfd4c0ea71845831920a845)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:17:09.858961 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7fc431-ed51-417c-9f8f-1266d9aca47c admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:17:09.872862 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1110/2223] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:17:09 2022] PUT /identity/v3/projects/a31dde60ac264cdab45f3cc0d3a4611d/users/95ba19d59cda4b9782b60118c693ffad/roles/1c39b9ab8cfd4c0ea71845831920a845 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:17:09.876789 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3b1c08-25fa-41cc-9d6c-851c38039a93 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:17:09.887219 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3b1c08-25fa-41cc-9d6c-851c38039a93 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:17:09.945433 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3739115-1586-424c-878a-64be22e4ed24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:17:09.946118 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3739115-1586-424c-878a-64be22e4ed24 admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:09.946403 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3739115-1586-424c-878a-64be22e4ed24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:09.946674 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3739115-1586-424c-878a-64be22e4ed24 admin admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:09.947577 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3739115-1586-424c-878a-64be22e4ed24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:17:09.949051 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3739115-1586-424c-878a-64be22e4ed24 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:17:09.959294 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1114/2224] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:17:09 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:17:09.963776 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7fc431-ed51-417c-9f8f-1266d9aca47c admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:17:09.974255 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7fc431-ed51-417c-9f8f-1266d9aca47c admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:17:09.979102 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3df9f66-b46f-4714-89ea-ad803607d597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:17:09.979902 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df9f66-b46f-4714-89ea-ad803607d597 admin admin] REQUEST_METHOD: `PUT` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:09.980193 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df9f66-b46f-4714-89ea-ad803607d597 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:09.980456 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df9f66-b46f-4714-89ea-ad803607d597 admin admin] PATH_INFO: `/v3/projects/a31dde60ac264cdab45f3cc0d3a4611d/users/95ba19d59cda4b9782b60118c693ffad/roles/1c39b9ab8cfd4c0ea71845831920a845` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:09.982855 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3df9f66-b46f-4714-89ea-ad803607d597 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a31dde60ac264cdab45f3cc0d3a4611d, user_id=95ba19d59cda4b9782b60118c693ffad, role_id=1c39b9ab8cfd4c0ea71845831920a845)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:17:09.985540 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3df9f66-b46f-4714-89ea-ad803607d597 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:17:09.996494 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1111/2225] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:17:09 2022] PUT /identity/v3/projects/a31dde60ac264cdab45f3cc0d3a4611d/users/95ba19d59cda4b9782b60118c693ffad/roles/1c39b9ab8cfd4c0ea71845831920a845 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 07:17:10.006857 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf81fe2-d8df-4fc2-ae23-e3092fd3d7d0 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:10.007289 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf81fe2-d8df-4fc2-ae23-e3092fd3d7d0 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:10.007768 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf81fe2-d8df-4fc2-ae23-e3092fd3d7d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:10.039356 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-faf81fe2-d8df-4fc2-ae23-e3092fd3d7d0 None None] MFA Rules not processed for user `95ba19d59cda4b9782b60118c693ffad`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:17:10.040649 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-faf81fe2-d8df-4fc2-ae23-e3092fd3d7d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:17:10.075464 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14510be4-455c-4efa-959f-66c7250e8a7f None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:10.076056 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14510be4-455c-4efa-959f-66c7250e8a7f None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:10.076056 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14510be4-455c-4efa-959f-66c7250e8a7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:10.104898 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-14510be4-455c-4efa-959f-66c7250e8a7f None None] MFA Rules not processed for user `23be35231cd6493e917259e81b849c8d`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:17:10.106490 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-14510be4-455c-4efa-959f-66c7250e8a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:17:10.116173 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1115/2226] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:17:10 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:17:10.129091 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf81fe2-d8df-4fc2-ae23-e3092fd3d7d0 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:17:10.130627 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-faf81fe2-d8df-4fc2-ae23-e3092fd3d7d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:17:10.181263 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1112/2227] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:17:10 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:17:10.189399 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf81fe2-d8df-4fc2-ae23-e3092fd3d7d0 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:17:10.192302 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14510be4-455c-4efa-959f-66c7250e8a7f None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:17:10.193198 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84899f9e-7025-48c9-a6e0-30a7f27aefd1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e2fda180e8d448d895c40cdad34bc4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:17:10.193927 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-14510be4-455c-4efa-959f-66c7250e8a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:17:10.194132 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84899f9e-7025-48c9-a6e0-30a7f27aefd1 service cinder] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:10.194629 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84899f9e-7025-48c9-a6e0-30a7f27aefd1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:10.194997 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84899f9e-7025-48c9-a6e0-30a7f27aefd1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:10.205066 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84899f9e-7025-48c9-a6e0-30a7f27aefd1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:17:10.206529 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84899f9e-7025-48c9-a6e0-30a7f27aefd1 service cinder] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:17:10.216634 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1116/2228] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:17:10 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 30 07:17:10.216811 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14510be4-455c-4efa-959f-66c7250e8a7f None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:17:10.222645 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1de3d1-3837-4d86-9dff-f3a7f19ec286 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e2fda180e8d448d895c40cdad34bc4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:17:10.223494 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1de3d1-3837-4d86-9dff-f3a7f19ec286 service cinder] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:10.223774 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1de3d1-3837-4d86-9dff-f3a7f19ec286 service cinder] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:10.224098 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1de3d1-3837-4d86-9dff-f3a7f19ec286 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:10.234145 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1de3d1-3837-4d86-9dff-f3a7f19ec286 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:17:10.235579 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1de3d1-3837-4d86-9dff-f3a7f19ec286 service cinder] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:17:10.245938 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1113/2229] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:17:10 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:17:10.373221 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84899f9e-7025-48c9-a6e0-30a7f27aefd1 service cinder] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:17:10.382581 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84899f9e-7025-48c9-a6e0-30a7f27aefd1 service cinder] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:17:10.386833 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605cee04-0cd8-4a92-8141-513f119754d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e2fda180e8d448d895c40cdad34bc4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:17:10.387497 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605cee04-0cd8-4a92-8141-513f119754d7 service cinder] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:10.387843 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605cee04-0cd8-4a92-8141-513f119754d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:10.388252 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605cee04-0cd8-4a92-8141-513f119754d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:10.484953 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605cee04-0cd8-4a92-8141-513f119754d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:17:10.486480 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605cee04-0cd8-4a92-8141-513f119754d7 service cinder] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:17:10.505859 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1117/2230] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:17:10 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:17:11.624807 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baffb07d-721a-43ae-ba0e-04e1fa5f675c None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:11.625333 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baffb07d-721a-43ae-ba0e-04e1fa5f675c None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:11.625333 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baffb07d-721a-43ae-ba0e-04e1fa5f675c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:11.646322 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-baffb07d-721a-43ae-ba0e-04e1fa5f675c None None] MFA Rules not processed for user `23be35231cd6493e917259e81b849c8d`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:17:11.647505 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-baffb07d-721a-43ae-ba0e-04e1fa5f675c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:17:11.655208 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1114/2231] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:17:11 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 07:17:17.959312 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605cee04-0cd8-4a92-8141-513f119754d7 service cinder] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:17:18.035150 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605cee04-0cd8-4a92-8141-513f119754d7 service cinder] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:17:18.037872 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c5da71-b6fe-4c91-9e14-229c1f442bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:17:18.038810 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c5da71-b6fe-4c91-9e14-229c1f442bd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:18.039092 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c5da71-b6fe-4c91-9e14-229c1f442bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:18.039366 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c5da71-b6fe-4c91-9e14-229c1f442bd5 admin admin] PATH_INFO: `/v3/users/1ed1a56ac6964b0cae5df9399b6ff54d` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:18.040558 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c5da71-b6fe-4c91-9e14-229c1f442bd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ed1a56ac6964b0cae5df9399b6ff54d)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:17:18.042987 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c5da71-b6fe-4c91-9e14-229c1f442bd5 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:17:18.102344 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-64c5da71-b6fe-4c91-9e14-229c1f442bd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ed1a56ac6964b0cae5df9399b6ff54d'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:18.103269 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-64c5da71-b6fe-4c91-9e14-229c1f442bd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ed1a56ac6964b0cae5df9399b6ff54d'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:18.104417 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-64c5da71-b6fe-4c91-9e14-229c1f442bd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ed1a56ac6964b0cae5df9399b6ff54d'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:18.114297 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-64c5da71-b6fe-4c91-9e14-229c1f442bd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ed1a56ac6964b0cae5df9399b6ff54d'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:18.123107 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-64c5da71-b6fe-4c91-9e14-229c1f442bd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ed1a56ac6964b0cae5df9399b6ff54d'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:18.147550 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1118/2232] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Mar 30 07:17:17 2022] DELETE /identity/v3/users/1ed1a56ac6964b0cae5df9399b6ff54d => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:17:18.149398 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002c14c-14dd-413e-a417-e333be832e59 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:18.149931 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002c14c-14dd-413e-a417-e333be832e59 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:18.150034 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002c14c-14dd-413e-a417-e333be832e59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:18.168442 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-0002c14c-14dd-413e-a417-e333be832e59 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:17:18.169881 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-0002c14c-14dd-413e-a417-e333be832e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:17:18.247952 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1115/2233] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:17:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:17:18.256299 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c5da71-b6fe-4c91-9e14-229c1f442bd5 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:17:18.257715 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-64c5da71-b6fe-4c91-9e14-229c1f442bd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:17:18.485166 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c5da71-b6fe-4c91-9e14-229c1f442bd5 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:17:18.491801 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933aa519-e2b0-4e0b-9e8e-589e4ef802f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3802cb341445f994b9204744060ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:17:18.492492 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933aa519-e2b0-4e0b-9e8e-589e4ef802f7 service neutron] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:18.492936 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933aa519-e2b0-4e0b-9e8e-589e4ef802f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:18.493209 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933aa519-e2b0-4e0b-9e8e-589e4ef802f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:18.503950 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933aa519-e2b0-4e0b-9e8e-589e4ef802f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:17:18.505391 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933aa519-e2b0-4e0b-9e8e-589e4ef802f7 service neutron] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:17:18.520195 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1119/2234] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:17:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:17:18.885636 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0002c14c-14dd-413e-a417-e333be832e59 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:17:18.887435 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-0002c14c-14dd-413e-a417-e333be832e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:17:18.901811 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0002c14c-14dd-413e-a417-e333be832e59 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:17:18.907529 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b28524-e5bf-4362-bba7-6fcd6d076ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:17:18.917176 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b28524-e5bf-4362-bba7-6fcd6d076ed8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:18.917467 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b28524-e5bf-4362-bba7-6fcd6d076ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:18.917756 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b28524-e5bf-4362-bba7-6fcd6d076ed8 admin admin] PATH_INFO: `/v3/projects/46903c025ad74bdfb4e16df48f79f87c` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:18.919062 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b28524-e5bf-4362-bba7-6fcd6d076ed8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46903c025ad74bdfb4e16df48f79f87c)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:17:18.921011 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b28524-e5bf-4362-bba7-6fcd6d076ed8 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:17:18.974526 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-b3b28524-e5bf-4362-bba7-6fcd6d076ed8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46903c025ad74bdfb4e16df48f79f87c', 'request_id': 'req-b3b28524-e5bf-4362-bba7-6fcd6d076ed8'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:18.984729 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-b3b28524-e5bf-4362-bba7-6fcd6d076ed8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46903c025ad74bdfb4e16df48f79f87c', 'request_id': 'req-b3b28524-e5bf-4362-bba7-6fcd6d076ed8'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:18.990420 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-b3b28524-e5bf-4362-bba7-6fcd6d076ed8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46903c025ad74bdfb4e16df48f79f87c', 'request_id': 'req-b3b28524-e5bf-4362-bba7-6fcd6d076ed8'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:19.002225 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-b3b28524-e5bf-4362-bba7-6fcd6d076ed8 admin admin] The token cache is being invalidate because project 46903c025ad74bdfb4e16df48f79f87c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79960) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 07:17:19.002604 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-b3b28524-e5bf-4362-bba7-6fcd6d076ed8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:19.003262 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-b3b28524-e5bf-4362-bba7-6fcd6d076ed8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:19.004952 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1116/2235] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Mar 30 07:17:18 2022] DELETE /identity/v3/projects/46903c025ad74bdfb4e16df48f79f87c => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:17:19.009242 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933aa519-e2b0-4e0b-9e8e-589e4ef802f7 service neutron] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:17:19.019139 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933aa519-e2b0-4e0b-9e8e-589e4ef802f7 service neutron] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:17:19.085235 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf83bed-28de-4ada-85e0-b4101600f417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:17:19.086114 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf83bed-28de-4ada-85e0-b4101600f417 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:19.086388 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf83bed-28de-4ada-85e0-b4101600f417 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:19.086659 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf83bed-28de-4ada-85e0-b4101600f417 admin admin] PATH_INFO: `/v3/users/95ba19d59cda4b9782b60118c693ffad` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:19.088063 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf83bed-28de-4ada-85e0-b4101600f417 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95ba19d59cda4b9782b60118c693ffad)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:17:19.089995 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf83bed-28de-4ada-85e0-b4101600f417 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:17:19.141725 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-faf83bed-28de-4ada-85e0-b4101600f417 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95ba19d59cda4b9782b60118c693ffad'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:19.142434 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-faf83bed-28de-4ada-85e0-b4101600f417 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95ba19d59cda4b9782b60118c693ffad'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:19.143108 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-faf83bed-28de-4ada-85e0-b4101600f417 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95ba19d59cda4b9782b60118c693ffad'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:19.152334 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-faf83bed-28de-4ada-85e0-b4101600f417 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95ba19d59cda4b9782b60118c693ffad'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:19.160286 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-faf83bed-28de-4ada-85e0-b4101600f417 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95ba19d59cda4b9782b60118c693ffad'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:19.178518 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1120/2236] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Mar 30 07:17:19 2022] DELETE /identity/v3/users/95ba19d59cda4b9782b60118c693ffad => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:17:19.654917 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b28524-e5bf-4362-bba7-6fcd6d076ed8 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:17:19.656382 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-b3b28524-e5bf-4362-bba7-6fcd6d076ed8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:17:19.672519 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b28524-e5bf-4362-bba7-6fcd6d076ed8 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:17:19.759712 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262d56f6-27ce-4263-ae2a-d694b055bbcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:17:19.760681 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262d56f6-27ce-4263-ae2a-d694b055bbcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:19.760956 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262d56f6-27ce-4263-ae2a-d694b055bbcc admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:19.763653 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262d56f6-27ce-4263-ae2a-d694b055bbcc admin admin] PATH_INFO: `/v3/projects/a31dde60ac264cdab45f3cc0d3a4611d` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:19.765022 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262d56f6-27ce-4263-ae2a-d694b055bbcc admin admin] RBAC: Authorizing `identity:delete_project(project_id=a31dde60ac264cdab45f3cc0d3a4611d)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:17:19.766864 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262d56f6-27ce-4263-ae2a-d694b055bbcc admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:17:19.818278 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-262d56f6-27ce-4263-ae2a-d694b055bbcc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a31dde60ac264cdab45f3cc0d3a4611d', 'request_id': 'req-262d56f6-27ce-4263-ae2a-d694b055bbcc'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:19.826283 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-262d56f6-27ce-4263-ae2a-d694b055bbcc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a31dde60ac264cdab45f3cc0d3a4611d', 'request_id': 'req-262d56f6-27ce-4263-ae2a-d694b055bbcc'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:19.833598 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-262d56f6-27ce-4263-ae2a-d694b055bbcc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a31dde60ac264cdab45f3cc0d3a4611d', 'request_id': 'req-262d56f6-27ce-4263-ae2a-d694b055bbcc'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:19.845424 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-262d56f6-27ce-4263-ae2a-d694b055bbcc admin admin] The token cache is being invalidate because project a31dde60ac264cdab45f3cc0d3a4611d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79960) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 07:17:19.845726 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-262d56f6-27ce-4263-ae2a-d694b055bbcc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:19.846597 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-262d56f6-27ce-4263-ae2a-d694b055bbcc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:19.852218 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1117/2237] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Mar 30 07:17:19 2022] DELETE /identity/v3/projects/a31dde60ac264cdab45f3cc0d3a4611d => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:17:19.854126 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4acadfd-f390-44c2-a896-121259146a28 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:19.854497 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4acadfd-f390-44c2-a896-121259146a28 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:19.854805 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4acadfd-f390-44c2-a896-121259146a28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:19.876526 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-a4acadfd-f390-44c2-a896-121259146a28 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:17:19.877844 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-a4acadfd-f390-44c2-a896-121259146a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:17:19.939610 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1121/2238] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:17:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:17:19.947407 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7e2fd4-7128-426e-8f7c-181cf257f419 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:19.947692 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7e2fd4-7128-426e-8f7c-181cf257f419 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:19.948011 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7e2fd4-7128-426e-8f7c-181cf257f419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:19.967672 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-6e7e2fd4-7128-426e-8f7c-181cf257f419 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:17:19.969029 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-6e7e2fd4-7128-426e-8f7c-181cf257f419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:17:19.977310 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1118/2239] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:17:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:17:19.981696 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4acadfd-f390-44c2-a896-121259146a28 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:17:19.991964 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4acadfd-f390-44c2-a896-121259146a28 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:17:19.997243 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d466f6-162b-480f-bd7d-ae7b67b70229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:17:20.006297 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d466f6-162b-480f-bd7d-ae7b67b70229 admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:20.006297 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d466f6-162b-480f-bd7d-ae7b67b70229 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:20.006297 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d466f6-162b-480f-bd7d-ae7b67b70229 admin admin] PATH_INFO: `/v3/domains` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:20.006297 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d466f6-162b-480f-bd7d-ae7b67b70229 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:17:20.006297 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d466f6-162b-480f-bd7d-ae7b67b70229 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:17:20.006297 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d466f6-162b-480f-bd7d-ae7b67b70229 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:17:20.016869 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1122/2240] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Mar 30 07:17:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:17:20.021184 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7e2fd4-7128-426e-8f7c-181cf257f419 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:17:20.030494 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7e2fd4-7128-426e-8f7c-181cf257f419 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:17:20.035109 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc41bbc-94ab-4fe0-9ed7-b0c06b73f571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:17:20.035757 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc41bbc-94ab-4fe0-9ed7-b0c06b73f571 admin admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:20.036067 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc41bbc-94ab-4fe0-9ed7-b0c06b73f571 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:20.036339 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc41bbc-94ab-4fe0-9ed7-b0c06b73f571 admin admin] PATH_INFO: `/v3/projects` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:20.037030 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc41bbc-94ab-4fe0-9ed7-b0c06b73f571 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:17:20.038940 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc41bbc-94ab-4fe0-9ed7-b0c06b73f571 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:17:20.070884 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1119/2241] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Mar 30 07:17:20 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:17:20.075382 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d466f6-162b-480f-bd7d-ae7b67b70229 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:17:20.086145 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d466f6-162b-480f-bd7d-ae7b67b70229 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:17:20.148955 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a516b44e-eb6a-4568-a6b5-385eb1212cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:17:20.149635 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a516b44e-eb6a-4568-a6b5-385eb1212cb2 admin admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:20.149912 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a516b44e-eb6a-4568-a6b5-385eb1212cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:20.150247 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a516b44e-eb6a-4568-a6b5-385eb1212cb2 admin admin] PATH_INFO: `/v3/users` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:20.151100 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a516b44e-eb6a-4568-a6b5-385eb1212cb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:17:20.153100 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a516b44e-eb6a-4568-a6b5-385eb1212cb2 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:17:20.178764 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1123/2242] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Mar 30 07:17:20 2022] POST /identity/v3/users => generated 287 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:17:20.180344 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc41bbc-94ab-4fe0-9ed7-b0c06b73f571 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:17:20.191621 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc41bbc-94ab-4fe0-9ed7-b0c06b73f571 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:17:20.196459 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1839d9-ab54-402f-bafb-dd4348c934db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:17:20.197265 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1839d9-ab54-402f-bafb-dd4348c934db admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:20.197556 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1839d9-ab54-402f-bafb-dd4348c934db admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:20.197849 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1839d9-ab54-402f-bafb-dd4348c934db admin admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:20.198876 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1839d9-ab54-402f-bafb-dd4348c934db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:17:20.200206 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1839d9-ab54-402f-bafb-dd4348c934db admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:17:20.213201 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1120/2243] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:17:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:17:20.218354 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a516b44e-eb6a-4568-a6b5-385eb1212cb2 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:17:20.230097 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a516b44e-eb6a-4568-a6b5-385eb1212cb2 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:17:20.236229 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b912f0f-2f15-480a-855b-f564f3903c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:17:20.236906 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b912f0f-2f15-480a-855b-f564f3903c30 admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:20.237184 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b912f0f-2f15-480a-855b-f564f3903c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:20.237456 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b912f0f-2f15-480a-855b-f564f3903c30 admin admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:20.238192 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b912f0f-2f15-480a-855b-f564f3903c30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:17:20.239788 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b912f0f-2f15-480a-855b-f564f3903c30 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:17:20.253695 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1124/2244] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:17:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:17:20.254951 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1839d9-ab54-402f-bafb-dd4348c934db admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:17:20.265486 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1839d9-ab54-402f-bafb-dd4348c934db admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:17:20.270640 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94543ef-53eb-4414-b5fc-9906058575b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:17:20.271462 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94543ef-53eb-4414-b5fc-9906058575b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:20.271738 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94543ef-53eb-4414-b5fc-9906058575b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:20.272037 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94543ef-53eb-4414-b5fc-9906058575b1 admin admin] PATH_INFO: `/v3/projects/75230d3d4ede4826b909bdb023694a6e/users/c3a713a781dd45fda0ecbd6a6b966bff/roles/5d79031a64754b57ba120367465e2252` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:20.286933 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94543ef-53eb-4414-b5fc-9906058575b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75230d3d4ede4826b909bdb023694a6e, user_id=c3a713a781dd45fda0ecbd6a6b966bff, role_id=5d79031a64754b57ba120367465e2252)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:17:20.289600 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94543ef-53eb-4414-b5fc-9906058575b1 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:17:20.305970 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1121/2245] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:17:20 2022] PUT /identity/v3/projects/75230d3d4ede4826b909bdb023694a6e/users/c3a713a781dd45fda0ecbd6a6b966bff/roles/5d79031a64754b57ba120367465e2252 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:17:20.317894 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829a8d34-cf8e-4812-8986-5ca9a3b47189 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:20.318162 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829a8d34-cf8e-4812-8986-5ca9a3b47189 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:20.318430 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829a8d34-cf8e-4812-8986-5ca9a3b47189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:20.345709 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-829a8d34-cf8e-4812-8986-5ca9a3b47189 None None] MFA Rules not processed for user `c3a713a781dd45fda0ecbd6a6b966bff`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:17:20.346948 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-829a8d34-cf8e-4812-8986-5ca9a3b47189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:17:20.414462 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1125/2246] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:17:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:17:20.425769 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94543ef-53eb-4414-b5fc-9906058575b1 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:17:20.428374 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-b94543ef-53eb-4414-b5fc-9906058575b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:17:20.496976 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94543ef-53eb-4414-b5fc-9906058575b1 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:17:20.500788 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f6c6f7-78d2-45ad-9426-7c0a8a99dff0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e2fda180e8d448d895c40cdad34bc4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:17:20.501442 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f6c6f7-78d2-45ad-9426-7c0a8a99dff0 service cinder] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:20.501746 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f6c6f7-78d2-45ad-9426-7c0a8a99dff0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:20.502022 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f6c6f7-78d2-45ad-9426-7c0a8a99dff0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:20.511031 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f6c6f7-78d2-45ad-9426-7c0a8a99dff0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:17:20.512507 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f6c6f7-78d2-45ad-9426-7c0a8a99dff0 service cinder] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:17:20.521222 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1122/2247] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:17:20 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:17:20.540319 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829a8d34-cf8e-4812-8986-5ca9a3b47189 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:17:20.598778 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829a8d34-cf8e-4812-8986-5ca9a3b47189 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:17:20.604118 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc6b9c5-96f2-4424-9d53-dbf976d47859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:17:20.605059 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc6b9c5-96f2-4424-9d53-dbf976d47859 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:20.605339 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc6b9c5-96f2-4424-9d53-dbf976d47859 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:20.605926 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc6b9c5-96f2-4424-9d53-dbf976d47859 admin admin] PATH_INFO: `/v3/users/c3a713a781dd45fda0ecbd6a6b966bff` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:20.607236 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc6b9c5-96f2-4424-9d53-dbf976d47859 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3a713a781dd45fda0ecbd6a6b966bff)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:17:20.609394 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc6b9c5-96f2-4424-9d53-dbf976d47859 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:17:20.660219 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-4cc6b9c5-96f2-4424-9d53-dbf976d47859 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3a713a781dd45fda0ecbd6a6b966bff'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:20.660939 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-4cc6b9c5-96f2-4424-9d53-dbf976d47859 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3a713a781dd45fda0ecbd6a6b966bff'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:20.661572 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-4cc6b9c5-96f2-4424-9d53-dbf976d47859 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3a713a781dd45fda0ecbd6a6b966bff'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:20.669776 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-4cc6b9c5-96f2-4424-9d53-dbf976d47859 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3a713a781dd45fda0ecbd6a6b966bff'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:20.680554 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-4cc6b9c5-96f2-4424-9d53-dbf976d47859 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3a713a781dd45fda0ecbd6a6b966bff'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:20.706313 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1126/2248] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Mar 30 07:17:20 2022] DELETE /identity/v3/users/c3a713a781dd45fda0ecbd6a6b966bff => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:17:20.711122 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31427e6f-c176-4d6c-a1fc-a7ac4c1982f8 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:20.711603 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31427e6f-c176-4d6c-a1fc-a7ac4c1982f8 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:20.711691 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31427e6f-c176-4d6c-a1fc-a7ac4c1982f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:20.731753 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-31427e6f-c176-4d6c-a1fc-a7ac4c1982f8 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:17:20.732944 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-31427e6f-c176-4d6c-a1fc-a7ac4c1982f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:17:20.798952 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1123/2249] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:17:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:17:20.808749 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc6b9c5-96f2-4424-9d53-dbf976d47859 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:17:20.810389 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-4cc6b9c5-96f2-4424-9d53-dbf976d47859 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:17:20.872163 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc6b9c5-96f2-4424-9d53-dbf976d47859 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:17:20.876753 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e493d5a-24cb-46ec-81eb-fe2a657f1bd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3802cb341445f994b9204744060ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:17:20.877394 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e493d5a-24cb-46ec-81eb-fe2a657f1bd1 service neutron] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:20.877671 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e493d5a-24cb-46ec-81eb-fe2a657f1bd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:20.877942 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e493d5a-24cb-46ec-81eb-fe2a657f1bd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:20.887948 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e493d5a-24cb-46ec-81eb-fe2a657f1bd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:17:20.889379 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e493d5a-24cb-46ec-81eb-fe2a657f1bd1 service neutron] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:17:20.898639 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1127/2250] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:17:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:17:21.174824 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31427e6f-c176-4d6c-a1fc-a7ac4c1982f8 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:17:21.177718 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-31427e6f-c176-4d6c-a1fc-a7ac4c1982f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:17:21.190500 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31427e6f-c176-4d6c-a1fc-a7ac4c1982f8 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:17:21.195881 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a362b19a-7b06-45b9-b1fb-e105e1d78da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:17:21.196759 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a362b19a-7b06-45b9-b1fb-e105e1d78da3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:21.197080 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a362b19a-7b06-45b9-b1fb-e105e1d78da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:21.197347 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a362b19a-7b06-45b9-b1fb-e105e1d78da3 admin admin] PATH_INFO: `/v3/projects/75230d3d4ede4826b909bdb023694a6e` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:21.198657 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a362b19a-7b06-45b9-b1fb-e105e1d78da3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75230d3d4ede4826b909bdb023694a6e)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:17:21.200683 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a362b19a-7b06-45b9-b1fb-e105e1d78da3 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:17:21.258877 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-a362b19a-7b06-45b9-b1fb-e105e1d78da3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75230d3d4ede4826b909bdb023694a6e', 'request_id': 'req-a362b19a-7b06-45b9-b1fb-e105e1d78da3'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:21.267356 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-a362b19a-7b06-45b9-b1fb-e105e1d78da3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75230d3d4ede4826b909bdb023694a6e', 'request_id': 'req-a362b19a-7b06-45b9-b1fb-e105e1d78da3'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:21.273531 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-a362b19a-7b06-45b9-b1fb-e105e1d78da3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75230d3d4ede4826b909bdb023694a6e', 'request_id': 'req-a362b19a-7b06-45b9-b1fb-e105e1d78da3'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:21.285336 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-a362b19a-7b06-45b9-b1fb-e105e1d78da3 admin admin] The token cache is being invalidate because project 75230d3d4ede4826b909bdb023694a6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79960) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 07:17:21.285628 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-a362b19a-7b06-45b9-b1fb-e105e1d78da3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:21.286268 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-a362b19a-7b06-45b9-b1fb-e105e1d78da3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:21.288061 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1124/2251] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Mar 30 07:17:21 2022] DELETE /identity/v3/projects/75230d3d4ede4826b909bdb023694a6e => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:17:21.292818 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb871ff0-03a1-4d63-8e3a-ad5c259b921b None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:21.293298 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb871ff0-03a1-4d63-8e3a-ad5c259b921b None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:21.293391 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb871ff0-03a1-4d63-8e3a-ad5c259b921b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:21.311499 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-cb871ff0-03a1-4d63-8e3a-ad5c259b921b None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:17:21.312744 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-cb871ff0-03a1-4d63-8e3a-ad5c259b921b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:17:21.376004 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1128/2252] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:17:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:17:21.384098 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b672b29-4d02-4629-86e0-7609e2bfa52b None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:21.384408 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b672b29-4d02-4629-86e0-7609e2bfa52b None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:21.384691 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b672b29-4d02-4629-86e0-7609e2bfa52b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:21.404464 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-5b672b29-4d02-4629-86e0-7609e2bfa52b None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:17:21.405649 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-5b672b29-4d02-4629-86e0-7609e2bfa52b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:17:21.413489 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1125/2253] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:17:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:17:21.418630 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb871ff0-03a1-4d63-8e3a-ad5c259b921b None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:17:21.432912 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb871ff0-03a1-4d63-8e3a-ad5c259b921b None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:17:21.441101 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620fab4d-e9fa-4216-948f-44917f98da0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:17:21.442128 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620fab4d-e9fa-4216-948f-44917f98da0e admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:21.442462 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620fab4d-e9fa-4216-948f-44917f98da0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:21.442738 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620fab4d-e9fa-4216-948f-44917f98da0e admin admin] PATH_INFO: `/v3/domains` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:21.443704 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620fab4d-e9fa-4216-948f-44917f98da0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:17:21.444119 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620fab4d-e9fa-4216-948f-44917f98da0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:17:21.446441 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620fab4d-e9fa-4216-948f-44917f98da0e admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:17:21.458732 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1129/2254] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Mar 30 07:17:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:17:21.465170 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b672b29-4d02-4629-86e0-7609e2bfa52b None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:17:21.479061 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b672b29-4d02-4629-86e0-7609e2bfa52b None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:17:21.486086 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1a5787-65ba-4fcc-ba6a-222a01cc1749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:17:21.486733 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1a5787-65ba-4fcc-ba6a-222a01cc1749 admin admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:21.487013 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1a5787-65ba-4fcc-ba6a-222a01cc1749 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:21.487294 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1a5787-65ba-4fcc-ba6a-222a01cc1749 admin admin] PATH_INFO: `/v3/projects` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:21.488021 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1a5787-65ba-4fcc-ba6a-222a01cc1749 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:17:21.489953 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1a5787-65ba-4fcc-ba6a-222a01cc1749 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:17:21.525600 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1126/2255] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Mar 30 07:17:21 2022] POST /identity/v3/projects => generated 375 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:17:21.530013 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620fab4d-e9fa-4216-948f-44917f98da0e admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:17:21.540261 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620fab4d-e9fa-4216-948f-44917f98da0e admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:17:21.597501 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e2008f-98bd-4de3-ade5-06bb33ef6390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:17:21.598171 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e2008f-98bd-4de3-ade5-06bb33ef6390 admin admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:21.598451 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e2008f-98bd-4de3-ade5-06bb33ef6390 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:21.598721 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e2008f-98bd-4de3-ade5-06bb33ef6390 admin admin] PATH_INFO: `/v3/users` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:21.599409 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e2008f-98bd-4de3-ade5-06bb33ef6390 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:17:21.604399 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e2008f-98bd-4de3-ade5-06bb33ef6390 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:17:21.626733 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1130/2256] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Mar 30 07:17:21 2022] POST /identity/v3/users => generated 288 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:17:21.632592 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1a5787-65ba-4fcc-ba6a-222a01cc1749 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:17:21.643190 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1a5787-65ba-4fcc-ba6a-222a01cc1749 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:17:21.648378 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8710d2a0-f090-48ac-82ee-0e485e71daf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:17:21.649020 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8710d2a0-f090-48ac-82ee-0e485e71daf9 admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:21.649299 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8710d2a0-f090-48ac-82ee-0e485e71daf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:21.649571 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8710d2a0-f090-48ac-82ee-0e485e71daf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:21.650303 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8710d2a0-f090-48ac-82ee-0e485e71daf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:17:21.652009 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8710d2a0-f090-48ac-82ee-0e485e71daf9 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:17:21.668766 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1127/2257] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:17:21 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:17:21.671965 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e2008f-98bd-4de3-ade5-06bb33ef6390 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:17:21.683033 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e2008f-98bd-4de3-ade5-06bb33ef6390 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:17:21.691152 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8a0ab0-4188-4b2f-bc47-a1a0184eb7ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:17:21.691847 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8a0ab0-4188-4b2f-bc47-a1a0184eb7ab admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:21.692139 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8a0ab0-4188-4b2f-bc47-a1a0184eb7ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:21.692396 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8a0ab0-4188-4b2f-bc47-a1a0184eb7ab admin admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:21.693158 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8a0ab0-4188-4b2f-bc47-a1a0184eb7ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:17:21.694758 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8a0ab0-4188-4b2f-bc47-a1a0184eb7ab admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:17:21.704710 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1131/2258] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:17:21 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:17:21.708958 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8710d2a0-f090-48ac-82ee-0e485e71daf9 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:17:21.719300 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8710d2a0-f090-48ac-82ee-0e485e71daf9 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:17:21.724015 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d72963b-60c5-49a6-80b6-e61e53bdbd0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:17:21.724897 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d72963b-60c5-49a6-80b6-e61e53bdbd0a admin admin] REQUEST_METHOD: `PUT` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:21.725170 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d72963b-60c5-49a6-80b6-e61e53bdbd0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:21.725440 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d72963b-60c5-49a6-80b6-e61e53bdbd0a admin admin] PATH_INFO: `/v3/projects/9cefd6307e9b418da6c39ac8db9d4035/users/a89e33240d0e475abe8354864e1592b3/roles/5d79031a64754b57ba120367465e2252` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:21.740667 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d72963b-60c5-49a6-80b6-e61e53bdbd0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cefd6307e9b418da6c39ac8db9d4035, user_id=a89e33240d0e475abe8354864e1592b3, role_id=5d79031a64754b57ba120367465e2252)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:17:21.743365 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d72963b-60c5-49a6-80b6-e61e53bdbd0a admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:17:21.761840 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1128/2259] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:17:21 2022] PUT /identity/v3/projects/9cefd6307e9b418da6c39ac8db9d4035/users/a89e33240d0e475abe8354864e1592b3/roles/5d79031a64754b57ba120367465e2252 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:17:21.776757 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97690903-d67d-4b9b-89a6-5e3066681ce0 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:21.777044 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97690903-d67d-4b9b-89a6-5e3066681ce0 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:21.777492 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97690903-d67d-4b9b-89a6-5e3066681ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:21.810488 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-97690903-d67d-4b9b-89a6-5e3066681ce0 None None] MFA Rules not processed for user `a89e33240d0e475abe8354864e1592b3`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:17:21.812040 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-97690903-d67d-4b9b-89a6-5e3066681ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:17:21.877015 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1132/2260] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:17:21 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 07:17:21.881588 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d72963b-60c5-49a6-80b6-e61e53bdbd0a admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:17:21.941876 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d72963b-60c5-49a6-80b6-e61e53bdbd0a admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:17:21.946779 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e63708-af94-486f-8c56-3eb89f97fbdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:17:21.947446 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e63708-af94-486f-8c56-3eb89f97fbdc admin admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:21.947742 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e63708-af94-486f-8c56-3eb89f97fbdc admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:21.948056 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e63708-af94-486f-8c56-3eb89f97fbdc admin admin] PATH_INFO: `/v3/projects` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:21.948760 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e63708-af94-486f-8c56-3eb89f97fbdc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:17:21.950896 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e63708-af94-486f-8c56-3eb89f97fbdc admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:17:21.978792 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1129/2261] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Mar 30 07:17:21 2022] POST /identity/v3/projects => generated 377 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:17:21.983337 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97690903-d67d-4b9b-89a6-5e3066681ce0 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:17:21.994169 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97690903-d67d-4b9b-89a6-5e3066681ce0 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:17:22.051006 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86388b7d-d4ee-44d2-83c9-d8156a73b046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:17:22.051671 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86388b7d-d4ee-44d2-83c9-d8156a73b046 admin admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:22.051988 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86388b7d-d4ee-44d2-83c9-d8156a73b046 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:22.052262 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86388b7d-d4ee-44d2-83c9-d8156a73b046 admin admin] PATH_INFO: `/v3/users` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:22.052959 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86388b7d-d4ee-44d2-83c9-d8156a73b046 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:17:22.054868 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86388b7d-d4ee-44d2-83c9-d8156a73b046 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:17:22.077771 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1133/2262] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Mar 30 07:17:21 2022] POST /identity/v3/users => generated 289 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:17:22.081800 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e63708-af94-486f-8c56-3eb89f97fbdc admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:17:22.092445 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e63708-af94-486f-8c56-3eb89f97fbdc admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:17:22.103390 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a902bd6-59a0-43c7-9d32-2afade131970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:17:22.104115 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a902bd6-59a0-43c7-9d32-2afade131970 admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:22.107877 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a902bd6-59a0-43c7-9d32-2afade131970 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:22.107877 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a902bd6-59a0-43c7-9d32-2afade131970 admin admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:22.107877 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a902bd6-59a0-43c7-9d32-2afade131970 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:17:22.107877 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a902bd6-59a0-43c7-9d32-2afade131970 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:17:22.127947 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1130/2263] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:17:22 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:17:22.132170 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86388b7d-d4ee-44d2-83c9-d8156a73b046 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:17:22.142517 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86388b7d-d4ee-44d2-83c9-d8156a73b046 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:17:22.147095 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29541460-6ce2-459b-9d0c-f957a877591f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:17:22.147751 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29541460-6ce2-459b-9d0c-f957a877591f admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:22.148058 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29541460-6ce2-459b-9d0c-f957a877591f admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:22.148331 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29541460-6ce2-459b-9d0c-f957a877591f admin admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:22.149055 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29541460-6ce2-459b-9d0c-f957a877591f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:17:22.150641 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29541460-6ce2-459b-9d0c-f957a877591f admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:17:22.161094 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1134/2264] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:17:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:17:22.165348 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a902bd6-59a0-43c7-9d32-2afade131970 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:17:22.175853 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a902bd6-59a0-43c7-9d32-2afade131970 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:17:22.181964 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74cdd02-f1b3-44fc-b3a3-beb3addbb79a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:17:22.182864 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74cdd02-f1b3-44fc-b3a3-beb3addbb79a admin admin] REQUEST_METHOD: `PUT` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:22.183140 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74cdd02-f1b3-44fc-b3a3-beb3addbb79a admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:22.183476 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74cdd02-f1b3-44fc-b3a3-beb3addbb79a admin admin] PATH_INFO: `/v3/projects/5b7009ee819b43a3943a536c72bb8c64/users/3e4645520fa0422591e9a01ec86dd6c2/roles/5d79031a64754b57ba120367465e2252` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:22.198903 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74cdd02-f1b3-44fc-b3a3-beb3addbb79a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b7009ee819b43a3943a536c72bb8c64, user_id=3e4645520fa0422591e9a01ec86dd6c2, role_id=5d79031a64754b57ba120367465e2252)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:17:22.202589 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74cdd02-f1b3-44fc-b3a3-beb3addbb79a admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:17:22.219988 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1131/2265] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:17:22 2022] PUT /identity/v3/projects/5b7009ee819b43a3943a536c72bb8c64/users/3e4645520fa0422591e9a01ec86dd6c2/roles/5d79031a64754b57ba120367465e2252 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 07:17:22.231843 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92901f1-dd5f-41bc-aee6-faa7837c2bcb None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:22.232141 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92901f1-dd5f-41bc-aee6-faa7837c2bcb None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:22.232407 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92901f1-dd5f-41bc-aee6-faa7837c2bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:22.266964 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-a92901f1-dd5f-41bc-aee6-faa7837c2bcb None None] MFA Rules not processed for user `3e4645520fa0422591e9a01ec86dd6c2`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:17:22.268254 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-a92901f1-dd5f-41bc-aee6-faa7837c2bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:17:22.331697 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1135/2266] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:17:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:17:22.336405 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74cdd02-f1b3-44fc-b3a3-beb3addbb79a admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:17:22.413185 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74cdd02-f1b3-44fc-b3a3-beb3addbb79a admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:17:22.419366 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4886523a-0111-4f02-a370-28fc1c429d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:17:22.420102 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4886523a-0111-4f02-a370-28fc1c429d99 admin admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:22.420380 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4886523a-0111-4f02-a370-28fc1c429d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:22.420661 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4886523a-0111-4f02-a370-28fc1c429d99 admin admin] PATH_INFO: `/v3/projects` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:22.421381 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4886523a-0111-4f02-a370-28fc1c429d99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:17:22.423333 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4886523a-0111-4f02-a370-28fc1c429d99 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:17:22.452803 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1132/2267] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Mar 30 07:17:22 2022] POST /identity/v3/projects => generated 375 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:17:22.456967 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92901f1-dd5f-41bc-aee6-faa7837c2bcb None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:17:22.468479 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92901f1-dd5f-41bc-aee6-faa7837c2bcb None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:17:22.528008 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3fe371-eeb9-46bd-90a1-55f7e9dbe6d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:17:22.528709 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3fe371-eeb9-46bd-90a1-55f7e9dbe6d4 admin admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:22.528982 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3fe371-eeb9-46bd-90a1-55f7e9dbe6d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:22.529250 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3fe371-eeb9-46bd-90a1-55f7e9dbe6d4 admin admin] PATH_INFO: `/v3/users` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:22.529937 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3fe371-eeb9-46bd-90a1-55f7e9dbe6d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:17:22.531895 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3fe371-eeb9-46bd-90a1-55f7e9dbe6d4 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:17:22.552225 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1136/2268] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Mar 30 07:17:22 2022] POST /identity/v3/users => generated 294 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:17:22.556625 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4886523a-0111-4f02-a370-28fc1c429d99 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:17:22.567448 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4886523a-0111-4f02-a370-28fc1c429d99 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:17:22.572218 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d727d3aa-5047-4152-af7a-71c533c213c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:17:22.572881 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d727d3aa-5047-4152-af7a-71c533c213c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:22.573147 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d727d3aa-5047-4152-af7a-71c533c213c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:22.573419 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d727d3aa-5047-4152-af7a-71c533c213c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:22.574206 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d727d3aa-5047-4152-af7a-71c533c213c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:17:22.576155 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d727d3aa-5047-4152-af7a-71c533c213c1 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:17:22.586686 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1133/2269] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:17:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:17:22.591332 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3fe371-eeb9-46bd-90a1-55f7e9dbe6d4 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:17:22.602132 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3fe371-eeb9-46bd-90a1-55f7e9dbe6d4 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:17:22.608309 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138900b8-5e0b-4c56-8ef9-24df1cc3584f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:17:22.609220 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138900b8-5e0b-4c56-8ef9-24df1cc3584f admin admin] REQUEST_METHOD: `PUT` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:22.609495 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138900b8-5e0b-4c56-8ef9-24df1cc3584f admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:22.609772 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138900b8-5e0b-4c56-8ef9-24df1cc3584f admin admin] PATH_INFO: `/v3/projects/2d859f6bf9c643108ffe3cb0677a933a/users/1c5980685381468bbe91c4f1fba5ce69/roles/1c39b9ab8cfd4c0ea71845831920a845` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:22.627040 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138900b8-5e0b-4c56-8ef9-24df1cc3584f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d859f6bf9c643108ffe3cb0677a933a, user_id=1c5980685381468bbe91c4f1fba5ce69, role_id=1c39b9ab8cfd4c0ea71845831920a845)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:17:22.629750 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138900b8-5e0b-4c56-8ef9-24df1cc3584f admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:17:22.645786 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1137/2270] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:17:22 2022] PUT /identity/v3/projects/2d859f6bf9c643108ffe3cb0677a933a/users/1c5980685381468bbe91c4f1fba5ce69/roles/1c39b9ab8cfd4c0ea71845831920a845 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:17:22.650620 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d727d3aa-5047-4152-af7a-71c533c213c1 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:17:22.661157 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d727d3aa-5047-4152-af7a-71c533c213c1 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:17:22.718389 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b447d841-43b0-41f0-8252-321534a04a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:17:22.719065 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b447d841-43b0-41f0-8252-321534a04a64 admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:22.719348 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b447d841-43b0-41f0-8252-321534a04a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:22.719898 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b447d841-43b0-41f0-8252-321534a04a64 admin admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:22.720475 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b447d841-43b0-41f0-8252-321534a04a64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:17:22.722090 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b447d841-43b0-41f0-8252-321534a04a64 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:17:22.732604 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1134/2271] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:17:22 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 30 07:17:22.736955 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138900b8-5e0b-4c56-8ef9-24df1cc3584f admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:17:22.747910 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138900b8-5e0b-4c56-8ef9-24df1cc3584f admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:17:22.752651 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d673eb65-ceeb-4fae-9626-da8bb95115ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:17:22.753575 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d673eb65-ceeb-4fae-9626-da8bb95115ea admin admin] REQUEST_METHOD: `PUT` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:22.753884 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d673eb65-ceeb-4fae-9626-da8bb95115ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:22.754163 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d673eb65-ceeb-4fae-9626-da8bb95115ea admin admin] PATH_INFO: `/v3/projects/2d859f6bf9c643108ffe3cb0677a933a/users/1c5980685381468bbe91c4f1fba5ce69/roles/1c39b9ab8cfd4c0ea71845831920a845` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:22.756212 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d673eb65-ceeb-4fae-9626-da8bb95115ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d859f6bf9c643108ffe3cb0677a933a, user_id=1c5980685381468bbe91c4f1fba5ce69, role_id=1c39b9ab8cfd4c0ea71845831920a845)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:17:22.758887 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d673eb65-ceeb-4fae-9626-da8bb95115ea admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:17:22.769859 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1138/2272] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:17:22 2022] PUT /identity/v3/projects/2d859f6bf9c643108ffe3cb0677a933a/users/1c5980685381468bbe91c4f1fba5ce69/roles/1c39b9ab8cfd4c0ea71845831920a845 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:17:22.780702 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c928236c-9585-4fb4-9805-d96162aa3f43 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:22.780989 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c928236c-9585-4fb4-9805-d96162aa3f43 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:22.781267 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c928236c-9585-4fb4-9805-d96162aa3f43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:22.819936 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-c928236c-9585-4fb4-9805-d96162aa3f43 None None] MFA Rules not processed for user `1c5980685381468bbe91c4f1fba5ce69`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:17:22.821291 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-c928236c-9585-4fb4-9805-d96162aa3f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:17:22.889707 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1135/2273] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:17:22 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:17:22.900975 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d673eb65-ceeb-4fae-9626-da8bb95115ea admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:17:22.902788 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-d673eb65-ceeb-4fae-9626-da8bb95115ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:17:22.964626 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d673eb65-ceeb-4fae-9626-da8bb95115ea admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:17:22.968905 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d6578f-ae1d-48b1-afb6-effac36b3377 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e2fda180e8d448d895c40cdad34bc4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:17:22.969553 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d6578f-ae1d-48b1-afb6-effac36b3377 service cinder] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:22.969830 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d6578f-ae1d-48b1-afb6-effac36b3377 service cinder] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:22.970105 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d6578f-ae1d-48b1-afb6-effac36b3377 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:23.027035 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d6578f-ae1d-48b1-afb6-effac36b3377 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:17:23.028585 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d6578f-ae1d-48b1-afb6-effac36b3377 service cinder] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:17:23.037446 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1139/2274] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:17:22 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:17:24.535478 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c928236c-9585-4fb4-9805-d96162aa3f43 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:17:24.537098 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-c928236c-9585-4fb4-9805-d96162aa3f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:17:24.549126 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c928236c-9585-4fb4-9805-d96162aa3f43 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:17:24.553441 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f443383-27d5-4be4-acf9-866777bcd8f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e2fda180e8d448d895c40cdad34bc4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:17:24.554210 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f443383-27d5-4be4-acf9-866777bcd8f7 service cinder] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:24.554555 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f443383-27d5-4be4-acf9-866777bcd8f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:24.554894 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f443383-27d5-4be4-acf9-866777bcd8f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:24.614950 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f443383-27d5-4be4-acf9-866777bcd8f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:17:24.616488 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f443383-27d5-4be4-acf9-866777bcd8f7 service cinder] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:17:24.626613 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1136/2275] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:17:24 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:17:25.201317 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d6578f-ae1d-48b1-afb6-effac36b3377 service cinder] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:17:25.210287 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d6578f-ae1d-48b1-afb6-effac36b3377 service cinder] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:17:25.216427 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f82cd59-85e1-4880-9641-0c573af7e295 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e2fda180e8d448d895c40cdad34bc4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:17:25.217128 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f82cd59-85e1-4880-9641-0c573af7e295 service cinder] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:25.217421 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f82cd59-85e1-4880-9641-0c573af7e295 service cinder] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:25.217670 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f82cd59-85e1-4880-9641-0c573af7e295 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:25.227010 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f82cd59-85e1-4880-9641-0c573af7e295 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:17:25.228519 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f82cd59-85e1-4880-9641-0c573af7e295 service cinder] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:17:25.239530 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1140/2276] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:17:25 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:17:29.117987 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f443383-27d5-4be4-acf9-866777bcd8f7 service cinder] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:17:29.184728 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f443383-27d5-4be4-acf9-866777bcd8f7 service cinder] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:17:29.190001 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af0682c-3947-4473-98f3-8edd00a6f36c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:17:29.190918 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af0682c-3947-4473-98f3-8edd00a6f36c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:29.191196 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af0682c-3947-4473-98f3-8edd00a6f36c admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:29.191463 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af0682c-3947-4473-98f3-8edd00a6f36c admin admin] PATH_INFO: `/v3/users/a89e33240d0e475abe8354864e1592b3` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:29.192753 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af0682c-3947-4473-98f3-8edd00a6f36c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a89e33240d0e475abe8354864e1592b3)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:17:29.194720 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af0682c-3947-4473-98f3-8edd00a6f36c admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:17:29.251341 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-5af0682c-3947-4473-98f3-8edd00a6f36c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a89e33240d0e475abe8354864e1592b3'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:29.252301 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-5af0682c-3947-4473-98f3-8edd00a6f36c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a89e33240d0e475abe8354864e1592b3'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:29.261516 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-5af0682c-3947-4473-98f3-8edd00a6f36c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a89e33240d0e475abe8354864e1592b3'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:29.274496 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-5af0682c-3947-4473-98f3-8edd00a6f36c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a89e33240d0e475abe8354864e1592b3'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:29.275252 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-5af0682c-3947-4473-98f3-8edd00a6f36c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a89e33240d0e475abe8354864e1592b3'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:29.290821 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1137/2277] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Mar 30 07:17:29 2022] DELETE /identity/v3/users/a89e33240d0e475abe8354864e1592b3 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:17:29.296204 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a211f95d-d25f-4e70-ad8e-b618b4215c54 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:29.296699 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a211f95d-d25f-4e70-ad8e-b618b4215c54 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:29.296841 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a211f95d-d25f-4e70-ad8e-b618b4215c54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:29.315295 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-a211f95d-d25f-4e70-ad8e-b618b4215c54 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:17:29.316522 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-a211f95d-d25f-4e70-ad8e-b618b4215c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:17:29.391260 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1141/2278] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:17:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 07:17:29.401406 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af0682c-3947-4473-98f3-8edd00a6f36c admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:17:29.402933 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-5af0682c-3947-4473-98f3-8edd00a6f36c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:17:29.498959 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af0682c-3947-4473-98f3-8edd00a6f36c admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:17:29.516537 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdca11f-a67f-4077-9770-551ff8a726df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3802cb341445f994b9204744060ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:17:29.518131 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdca11f-a67f-4077-9770-551ff8a726df service neutron] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:29.520202 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdca11f-a67f-4077-9770-551ff8a726df service neutron] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:29.520496 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdca11f-a67f-4077-9770-551ff8a726df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:29.535571 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdca11f-a67f-4077-9770-551ff8a726df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:17:29.537469 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdca11f-a67f-4077-9770-551ff8a726df service neutron] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:17:29.548391 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1138/2279] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:17:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:17:29.943486 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a211f95d-d25f-4e70-ad8e-b618b4215c54 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:17:29.947205 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-a211f95d-d25f-4e70-ad8e-b618b4215c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:17:29.960710 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a211f95d-d25f-4e70-ad8e-b618b4215c54 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:17:29.968014 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d96fe79-d73e-401d-9a27-5501d51286c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:17:29.969996 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d96fe79-d73e-401d-9a27-5501d51286c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:29.970490 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d96fe79-d73e-401d-9a27-5501d51286c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:29.971045 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d96fe79-d73e-401d-9a27-5501d51286c7 admin admin] PATH_INFO: `/v3/projects/9cefd6307e9b418da6c39ac8db9d4035` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:29.973037 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d96fe79-d73e-401d-9a27-5501d51286c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cefd6307e9b418da6c39ac8db9d4035)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:17:29.977926 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d96fe79-d73e-401d-9a27-5501d51286c7 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:17:30.050893 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-8d96fe79-d73e-401d-9a27-5501d51286c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cefd6307e9b418da6c39ac8db9d4035', 'request_id': 'req-8d96fe79-d73e-401d-9a27-5501d51286c7'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:30.057148 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-8d96fe79-d73e-401d-9a27-5501d51286c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cefd6307e9b418da6c39ac8db9d4035', 'request_id': 'req-8d96fe79-d73e-401d-9a27-5501d51286c7'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:30.068366 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-8d96fe79-d73e-401d-9a27-5501d51286c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cefd6307e9b418da6c39ac8db9d4035', 'request_id': 'req-8d96fe79-d73e-401d-9a27-5501d51286c7'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:30.081569 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-8d96fe79-d73e-401d-9a27-5501d51286c7 admin admin] The token cache is being invalidate because project 9cefd6307e9b418da6c39ac8db9d4035 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79961) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 07:17:30.082238 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-8d96fe79-d73e-401d-9a27-5501d51286c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:30.083043 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-8d96fe79-d73e-401d-9a27-5501d51286c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:30.084871 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1142/2280] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Mar 30 07:17:29 2022] DELETE /identity/v3/projects/9cefd6307e9b418da6c39ac8db9d4035 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:17:30.089106 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdca11f-a67f-4077-9770-551ff8a726df service neutron] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:17:30.099536 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdca11f-a67f-4077-9770-551ff8a726df service neutron] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:17:30.167550 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2c9409-0686-439a-9d69-b199ed09027b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:17:30.168424 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2c9409-0686-439a-9d69-b199ed09027b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:30.168705 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2c9409-0686-439a-9d69-b199ed09027b admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:30.168976 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2c9409-0686-439a-9d69-b199ed09027b admin admin] PATH_INFO: `/v3/users/3e4645520fa0422591e9a01ec86dd6c2` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:30.170176 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2c9409-0686-439a-9d69-b199ed09027b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e4645520fa0422591e9a01ec86dd6c2)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:17:30.172635 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2c9409-0686-439a-9d69-b199ed09027b admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:17:30.221041 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-4f2c9409-0686-439a-9d69-b199ed09027b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e4645520fa0422591e9a01ec86dd6c2'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:30.221777 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-4f2c9409-0686-439a-9d69-b199ed09027b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e4645520fa0422591e9a01ec86dd6c2'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:30.229775 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-4f2c9409-0686-439a-9d69-b199ed09027b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e4645520fa0422591e9a01ec86dd6c2'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:30.244162 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-4f2c9409-0686-439a-9d69-b199ed09027b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e4645520fa0422591e9a01ec86dd6c2'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:30.245058 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-4f2c9409-0686-439a-9d69-b199ed09027b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e4645520fa0422591e9a01ec86dd6c2'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:30.257702 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1139/2281] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Mar 30 07:17:30 2022] DELETE /identity/v3/users/3e4645520fa0422591e9a01ec86dd6c2 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:17:30.644668 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d96fe79-d73e-401d-9a27-5501d51286c7 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:17:30.646975 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-8d96fe79-d73e-401d-9a27-5501d51286c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:17:30.665168 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d96fe79-d73e-401d-9a27-5501d51286c7 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:17:30.738923 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b637fbcc-ddfc-415b-9d40-61ec980dfd94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:17:30.740145 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b637fbcc-ddfc-415b-9d40-61ec980dfd94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:30.740421 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b637fbcc-ddfc-415b-9d40-61ec980dfd94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:30.740685 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b637fbcc-ddfc-415b-9d40-61ec980dfd94 admin admin] PATH_INFO: `/v3/projects/5b7009ee819b43a3943a536c72bb8c64` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:30.741917 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b637fbcc-ddfc-415b-9d40-61ec980dfd94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b7009ee819b43a3943a536c72bb8c64)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:17:30.743844 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b637fbcc-ddfc-415b-9d40-61ec980dfd94 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:17:30.793737 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-b637fbcc-ddfc-415b-9d40-61ec980dfd94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b7009ee819b43a3943a536c72bb8c64', 'request_id': 'req-b637fbcc-ddfc-415b-9d40-61ec980dfd94'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:30.799037 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-b637fbcc-ddfc-415b-9d40-61ec980dfd94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b7009ee819b43a3943a536c72bb8c64', 'request_id': 'req-b637fbcc-ddfc-415b-9d40-61ec980dfd94'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:30.807241 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-b637fbcc-ddfc-415b-9d40-61ec980dfd94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b7009ee819b43a3943a536c72bb8c64', 'request_id': 'req-b637fbcc-ddfc-415b-9d40-61ec980dfd94'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:30.818997 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-b637fbcc-ddfc-415b-9d40-61ec980dfd94 admin admin] The token cache is being invalidate because project 5b7009ee819b43a3943a536c72bb8c64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79961) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 07:17:30.819285 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-b637fbcc-ddfc-415b-9d40-61ec980dfd94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:30.819953 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-b637fbcc-ddfc-415b-9d40-61ec980dfd94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:30.821753 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1143/2282] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Mar 30 07:17:30 2022] DELETE /identity/v3/projects/5b7009ee819b43a3943a536c72bb8c64 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:17:30.825487 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2c9409-0686-439a-9d69-b199ed09027b admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:17:30.826882 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-4f2c9409-0686-439a-9d69-b199ed09027b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:17:30.840305 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2c9409-0686-439a-9d69-b199ed09027b admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:17:30.903354 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4d14a7-7b14-455c-a38d-676a094694f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:17:30.904364 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4d14a7-7b14-455c-a38d-676a094694f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:30.904811 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4d14a7-7b14-455c-a38d-676a094694f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:30.905101 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4d14a7-7b14-455c-a38d-676a094694f4 admin admin] PATH_INFO: `/v3/users/1c5980685381468bbe91c4f1fba5ce69` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:30.906402 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4d14a7-7b14-455c-a38d-676a094694f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c5980685381468bbe91c4f1fba5ce69)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:17:30.908385 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4d14a7-7b14-455c-a38d-676a094694f4 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:17:30.954639 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-ba4d14a7-7b14-455c-a38d-676a094694f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c5980685381468bbe91c4f1fba5ce69'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:30.955226 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-ba4d14a7-7b14-455c-a38d-676a094694f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c5980685381468bbe91c4f1fba5ce69'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:30.963799 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-ba4d14a7-7b14-455c-a38d-676a094694f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c5980685381468bbe91c4f1fba5ce69'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:30.975360 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-ba4d14a7-7b14-455c-a38d-676a094694f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c5980685381468bbe91c4f1fba5ce69'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:30.976017 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-ba4d14a7-7b14-455c-a38d-676a094694f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c5980685381468bbe91c4f1fba5ce69'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:30.989803 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1140/2283] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Mar 30 07:17:30 2022] DELETE /identity/v3/users/1c5980685381468bbe91c4f1fba5ce69 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:17:31.319693 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b637fbcc-ddfc-415b-9d40-61ec980dfd94 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:17:31.321215 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-b637fbcc-ddfc-415b-9d40-61ec980dfd94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:17:31.335981 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b637fbcc-ddfc-415b-9d40-61ec980dfd94 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:17:31.394717 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf1615e-510e-451c-87d2-6ae482e6e089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:17:31.395972 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf1615e-510e-451c-87d2-6ae482e6e089 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:31.396328 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf1615e-510e-451c-87d2-6ae482e6e089 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:31.396705 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf1615e-510e-451c-87d2-6ae482e6e089 admin admin] PATH_INFO: `/v3/projects/2d859f6bf9c643108ffe3cb0677a933a` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:31.398309 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf1615e-510e-451c-87d2-6ae482e6e089 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d859f6bf9c643108ffe3cb0677a933a)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:17:31.401229 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf1615e-510e-451c-87d2-6ae482e6e089 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:17:31.450180 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-4cf1615e-510e-451c-87d2-6ae482e6e089 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d859f6bf9c643108ffe3cb0677a933a', 'request_id': 'req-4cf1615e-510e-451c-87d2-6ae482e6e089'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:31.455496 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-4cf1615e-510e-451c-87d2-6ae482e6e089 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d859f6bf9c643108ffe3cb0677a933a', 'request_id': 'req-4cf1615e-510e-451c-87d2-6ae482e6e089'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:31.463647 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-4cf1615e-510e-451c-87d2-6ae482e6e089 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d859f6bf9c643108ffe3cb0677a933a', 'request_id': 'req-4cf1615e-510e-451c-87d2-6ae482e6e089'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:31.475478 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-4cf1615e-510e-451c-87d2-6ae482e6e089 admin admin] The token cache is being invalidate because project 2d859f6bf9c643108ffe3cb0677a933a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79961) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 07:17:31.475762 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-4cf1615e-510e-451c-87d2-6ae482e6e089 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:31.476454 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-4cf1615e-510e-451c-87d2-6ae482e6e089 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:17:31.478287 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1144/2284] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Mar 30 07:17:31 2022] DELETE /identity/v3/projects/2d859f6bf9c643108ffe3cb0677a933a => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:17:31.483482 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022bdb12-6a98-4d43-8756-e8d95e5ffbee None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:31.483987 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022bdb12-6a98-4d43-8756-e8d95e5ffbee None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:31.484071 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022bdb12-6a98-4d43-8756-e8d95e5ffbee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:31.502950 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-022bdb12-6a98-4d43-8756-e8d95e5ffbee None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:17:31.504195 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-022bdb12-6a98-4d43-8756-e8d95e5ffbee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:17:31.564437 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1141/2285] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:17:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 07:17:31.573365 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda304d-c327-4419-879d-1e4e7a8bcab4 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:31.573651 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda304d-c327-4419-879d-1e4e7a8bcab4 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:31.573921 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda304d-c327-4419-879d-1e4e7a8bcab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:31.592488 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-edda304d-c327-4419-879d-1e4e7a8bcab4 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:17:31.593669 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-edda304d-c327-4419-879d-1e4e7a8bcab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:17:31.601834 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1145/2286] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:17:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:17:31.606604 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022bdb12-6a98-4d43-8756-e8d95e5ffbee None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:17:31.617744 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022bdb12-6a98-4d43-8756-e8d95e5ffbee None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:17:31.624425 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecda7c54-a4f6-4676-8921-e4163134b73f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:17:31.625100 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda7c54-a4f6-4676-8921-e4163134b73f admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:31.625368 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda7c54-a4f6-4676-8921-e4163134b73f admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:31.625630 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda7c54-a4f6-4676-8921-e4163134b73f admin admin] PATH_INFO: `/v3/domains` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:31.626459 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecda7c54-a4f6-4676-8921-e4163134b73f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:17:31.626643 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecda7c54-a4f6-4676-8921-e4163134b73f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:17:31.628282 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecda7c54-a4f6-4676-8921-e4163134b73f admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:17:31.641401 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1142/2287] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Mar 30 07:17:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:17:31.646046 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edda304d-c327-4419-879d-1e4e7a8bcab4 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:17:31.657056 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edda304d-c327-4419-879d-1e4e7a8bcab4 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:17:31.662808 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be29d09-a55a-42ab-90b8-949d6e813ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:17:31.663651 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be29d09-a55a-42ab-90b8-949d6e813ce5 admin admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:31.663977 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be29d09-a55a-42ab-90b8-949d6e813ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:31.664283 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be29d09-a55a-42ab-90b8-949d6e813ce5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:31.665539 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be29d09-a55a-42ab-90b8-949d6e813ce5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:17:31.667534 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be29d09-a55a-42ab-90b8-949d6e813ce5 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:17:31.697545 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1146/2288] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Mar 30 07:17:31 2022] POST /identity/v3/projects => generated 365 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:17:31.701849 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecda7c54-a4f6-4676-8921-e4163134b73f admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:17:31.718888 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecda7c54-a4f6-4676-8921-e4163134b73f admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:17:31.777135 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104693e3-0a47-4efd-9185-b4560cbabaa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:17:31.777804 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104693e3-0a47-4efd-9185-b4560cbabaa5 admin admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:31.778087 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104693e3-0a47-4efd-9185-b4560cbabaa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:31.778360 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104693e3-0a47-4efd-9185-b4560cbabaa5 admin admin] PATH_INFO: `/v3/users` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:31.779050 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104693e3-0a47-4efd-9185-b4560cbabaa5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:17:31.781305 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104693e3-0a47-4efd-9185-b4560cbabaa5 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:17:31.805672 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1143/2289] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Mar 30 07:17:31 2022] POST /identity/v3/users => generated 283 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 07:17:31.809814 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be29d09-a55a-42ab-90b8-949d6e813ce5 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:17:31.820325 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be29d09-a55a-42ab-90b8-949d6e813ce5 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:17:31.825195 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec44c560-0d46-48f6-a992-ac21f692d11c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:17:31.825842 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec44c560-0d46-48f6-a992-ac21f692d11c admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:31.826090 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec44c560-0d46-48f6-a992-ac21f692d11c admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:31.826392 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec44c560-0d46-48f6-a992-ac21f692d11c admin admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:31.827301 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec44c560-0d46-48f6-a992-ac21f692d11c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:17:31.829227 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec44c560-0d46-48f6-a992-ac21f692d11c admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:17:31.839556 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1147/2290] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:17:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:17:31.843689 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104693e3-0a47-4efd-9185-b4560cbabaa5 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:17:31.853905 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104693e3-0a47-4efd-9185-b4560cbabaa5 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:17:31.859971 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d25f4a-4cc8-4809-b92d-8bcc92a5f083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:17:31.860616 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d25f4a-4cc8-4809-b92d-8bcc92a5f083 admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:31.861198 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d25f4a-4cc8-4809-b92d-8bcc92a5f083 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:31.861198 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d25f4a-4cc8-4809-b92d-8bcc92a5f083 admin admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:31.861860 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d25f4a-4cc8-4809-b92d-8bcc92a5f083 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:17:31.863446 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d25f4a-4cc8-4809-b92d-8bcc92a5f083 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:17:31.874429 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1144/2291] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:17:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:17:31.878808 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec44c560-0d46-48f6-a992-ac21f692d11c admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:17:31.890395 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec44c560-0d46-48f6-a992-ac21f692d11c admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:17:31.898293 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227076b6-9b83-47cd-a901-4eb2ca304512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:17:31.899520 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227076b6-9b83-47cd-a901-4eb2ca304512 admin admin] REQUEST_METHOD: `PUT` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:31.899899 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227076b6-9b83-47cd-a901-4eb2ca304512 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:31.900223 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227076b6-9b83-47cd-a901-4eb2ca304512 admin admin] PATH_INFO: `/v3/projects/2904d7cbd7ab4fdba009036f4131a3ce/users/65042ffcb7744e9b88c7305107120e13/roles/5d79031a64754b57ba120367465e2252` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:31.916002 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227076b6-9b83-47cd-a901-4eb2ca304512 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2904d7cbd7ab4fdba009036f4131a3ce, user_id=65042ffcb7744e9b88c7305107120e13, role_id=5d79031a64754b57ba120367465e2252)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:17:31.918785 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227076b6-9b83-47cd-a901-4eb2ca304512 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:17:31.932799 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1148/2292] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:17:31 2022] PUT /identity/v3/projects/2904d7cbd7ab4fdba009036f4131a3ce/users/65042ffcb7744e9b88c7305107120e13/roles/5d79031a64754b57ba120367465e2252 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:17:31.944493 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b6873-108e-4958-ac39-2f687cec155a None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:31.944877 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b6873-108e-4958-ac39-2f687cec155a None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:31.945225 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b6873-108e-4958-ac39-2f687cec155a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:31.980204 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-d34b6873-108e-4958-ac39-2f687cec155a None None] MFA Rules not processed for user `65042ffcb7744e9b88c7305107120e13`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:17:31.981794 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-d34b6873-108e-4958-ac39-2f687cec155a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:17:32.052782 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1145/2293] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:17:31 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 07:17:32.069740 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227076b6-9b83-47cd-a901-4eb2ca304512 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:17:32.071901 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-227076b6-9b83-47cd-a901-4eb2ca304512 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:17:32.141349 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227076b6-9b83-47cd-a901-4eb2ca304512 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:17:32.145824 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401a97d8-4ffc-4091-af47-6d71f9fcb054 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e2fda180e8d448d895c40cdad34bc4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:17:32.146470 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a97d8-4ffc-4091-af47-6d71f9fcb054 service cinder] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:32.146750 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a97d8-4ffc-4091-af47-6d71f9fcb054 service cinder] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:32.147015 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a97d8-4ffc-4091-af47-6d71f9fcb054 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:32.155732 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401a97d8-4ffc-4091-af47-6d71f9fcb054 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:17:32.157221 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401a97d8-4ffc-4091-af47-6d71f9fcb054 service cinder] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:17:32.165940 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1149/2294] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:17:32 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:17:32.284468 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a86727-98a2-47af-b0ea-0a3aa8b78950 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:17:32.284468 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a86727-98a2-47af-b0ea-0a3aa8b78950 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:17:32.284468 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a86727-98a2-47af-b0ea-0a3aa8b78950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:17:32.304395 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-88a86727-98a2-47af-b0ea-0a3aa8b78950 None None] MFA Rules not processed for user `23be35231cd6493e917259e81b849c8d`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:17:32.305600 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-88a86727-98a2-47af-b0ea-0a3aa8b78950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:17:32.364466 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1146/2295] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:17:32 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:18:00.420686 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd63f83e-d649-497a-8a05-e0898b7fedf1 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:18:00.421453 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd63f83e-d649-497a-8a05-e0898b7fedf1 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:18:00.421611 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd63f83e-d649-497a-8a05-e0898b7fedf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:18:00.442397 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-bd63f83e-d649-497a-8a05-e0898b7fedf1 None None] MFA Rules not processed for user `67102c1adcf0491e9ecdef970ab2d5ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:18:00.443582 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-bd63f83e-d649-497a-8a05-e0898b7fedf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:18:00.517293 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1150/2296] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Mar 30 07:18:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:18:00.569098 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a86727-98a2-47af-b0ea-0a3aa8b78950 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:18:00.570617 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-88a86727-98a2-47af-b0ea-0a3aa8b78950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:18:00.644152 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a86727-98a2-47af-b0ea-0a3aa8b78950 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:18:00.650666 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d563c49-369f-4545-89e6-25965cc3c4fa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c452249c502d4b0688e8dd068f8c4951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:18:00.651400 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d563c49-369f-4545-89e6-25965cc3c4fa service swift] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:18:00.652009 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d563c49-369f-4545-89e6-25965cc3c4fa service swift] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:18:00.652465 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d563c49-369f-4545-89e6-25965cc3c4fa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:18:00.664895 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d563c49-369f-4545-89e6-25965cc3c4fa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:18:00.667662 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d563c49-369f-4545-89e6-25965cc3c4fa service swift] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:18:00.679423 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1147/2297] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Mar 30 07:18:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Mar 30 07:18:03.358233 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a0fa56-52fe-4d7a-aba4-e6b9e8fa9d8c None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:18:03.359374 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a0fa56-52fe-4d7a-aba4-e6b9e8fa9d8c None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:18:03.359885 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a0fa56-52fe-4d7a-aba4-e6b9e8fa9d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:18:03.413080 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-e3a0fa56-52fe-4d7a-aba4-e6b9e8fa9d8c None None] MFA Rules not processed for user `bc84d32966d34ff29620cd40d3d9cc3a`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:18:03.414589 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-e3a0fa56-52fe-4d7a-aba4-e6b9e8fa9d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:18:03.510724 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1151/2298] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:18:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:18:16.026492 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460925cb-dcea-4fbb-b131-f0f6b8715603 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:18:16.027668 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460925cb-dcea-4fbb-b131-f0f6b8715603 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:18:16.028367 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460925cb-dcea-4fbb-b131-f0f6b8715603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:18:16.068855 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-460925cb-dcea-4fbb-b131-f0f6b8715603 None None] MFA Rules not processed for user `67102c1adcf0491e9ecdef970ab2d5ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:18:16.070913 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-460925cb-dcea-4fbb-b131-f0f6b8715603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:18:16.111470 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1148/2299] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Mar 30 07:18:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:18:16.126348 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a0fa56-52fe-4d7a-aba4-e6b9e8fa9d8c None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:18:16.149515 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a0fa56-52fe-4d7a-aba4-e6b9e8fa9d8c None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:18:16.156983 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ccd3df-d43c-40b6-906e-c5d2e08a561a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c452249c502d4b0688e8dd068f8c4951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:18:16.158057 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ccd3df-d43c-40b6-906e-c5d2e08a561a service swift] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:18:16.158518 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ccd3df-d43c-40b6-906e-c5d2e08a561a service swift] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:18:16.159137 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ccd3df-d43c-40b6-906e-c5d2e08a561a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:18:16.170548 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ccd3df-d43c-40b6-906e-c5d2e08a561a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:18:16.172286 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ccd3df-d43c-40b6-906e-c5d2e08a561a service swift] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:18:16.183323 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1152/2300] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Mar 30 07:18:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 30 07:18:20.000408 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eedfe37-6ca0-4157-b1f5-f3e609d90c8e None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:18:20.000408 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eedfe37-6ca0-4157-b1f5-f3e609d90c8e None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:18:20.000408 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eedfe37-6ca0-4157-b1f5-f3e609d90c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:18:20.028874 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-3eedfe37-6ca0-4157-b1f5-f3e609d90c8e None None] MFA Rules not processed for user `b25ac073374a491899b09b5c7810eb84`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:18:20.031933 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-3eedfe37-6ca0-4157-b1f5-f3e609d90c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:18:20.103455 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1149/2301] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:18:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:18:22.114435 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e58d6-09be-4cfb-9135-bbc94bd64762 None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:18:22.115014 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e58d6-09be-4cfb-9135-bbc94bd64762 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:18:22.115014 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e58d6-09be-4cfb-9135-bbc94bd64762 None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:18:22.118292 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1153/2302] 10.222.0.20 () {54 vars in 921 bytes} [Wed Mar 30 07:18:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:18:22.130853 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c38d884-8394-4b86-9060-52f0341f9b4c None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:18:22.131769 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c38d884-8394-4b86-9060-52f0341f9b4c None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:18:22.132316 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c38d884-8394-4b86-9060-52f0341f9b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:18:22.187015 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-4c38d884-8394-4b86-9060-52f0341f9b4c None None] MFA Rules not processed for user `72b398c5ed14484d8b7a51fee900597b`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:18:22.188939 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-4c38d884-8394-4b86-9060-52f0341f9b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:18:22.293404 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1150/2303] 10.222.0.20 () {58 vars in 1018 bytes} [Wed Mar 30 07:18:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 07:18:22.310287 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4e58d6-09be-4cfb-9135-bbc94bd64762 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:18:22.312247 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-0c4e58d6-09be-4cfb-9135-bbc94bd64762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:18:22.411705 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4e58d6-09be-4cfb-9135-bbc94bd64762 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:18:22.416272 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a87199e-2c13-4935-bd3f-c178159261f5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e880ade912f3412abf44ba73939d6e50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:18:22.417326 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a87199e-2c13-4935-bd3f-c178159261f5 service glance] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:18:22.417767 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a87199e-2c13-4935-bd3f-c178159261f5 service glance] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:18:22.418282 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a87199e-2c13-4935-bd3f-c178159261f5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:18:22.434210 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a87199e-2c13-4935-bd3f-c178159261f5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:18:22.436350 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a87199e-2c13-4935-bd3f-c178159261f5 service glance] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:18:22.458906 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1154/2304] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:18:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:18:22.567914 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82ff5a0-cd90-483a-964b-564b2f173fc9 None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:18:22.568449 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82ff5a0-cd90-483a-964b-564b2f173fc9 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:18:22.568964 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82ff5a0-cd90-483a-964b-564b2f173fc9 None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:18:22.571361 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1151/2305] 10.222.0.20 () {54 vars in 921 bytes} [Wed Mar 30 07:18:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:18:22.577826 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b58565b-6065-4624-8afe-366340a7e3e9 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:18:22.578278 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b58565b-6065-4624-8afe-366340a7e3e9 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:18:22.582567 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b58565b-6065-4624-8afe-366340a7e3e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:18:22.632228 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-4b58565b-6065-4624-8afe-366340a7e3e9 None None] MFA Rules not processed for user `54f3802cb341445f994b9204744060ae`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:18:22.634723 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-4b58565b-6065-4624-8afe-366340a7e3e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:18:22.787402 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1155/2306] 10.222.0.20 () {58 vars in 1018 bytes} [Wed Mar 30 07:18:22 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:18:22.817066 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82ff5a0-cd90-483a-964b-564b2f173fc9 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:18:22.821307 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-c82ff5a0-cd90-483a-964b-564b2f173fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:18:22.844262 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82ff5a0-cd90-483a-964b-564b2f173fc9 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:18:22.849056 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d868d3eb-0303-40cf-96e2-f11da4c0485a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3802cb341445f994b9204744060ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:18:22.850175 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d868d3eb-0303-40cf-96e2-f11da4c0485a service neutron] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:18:22.850782 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d868d3eb-0303-40cf-96e2-f11da4c0485a service neutron] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:18:22.851490 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d868d3eb-0303-40cf-96e2-f11da4c0485a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:18:22.860862 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d868d3eb-0303-40cf-96e2-f11da4c0485a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:18:22.862402 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d868d3eb-0303-40cf-96e2-f11da4c0485a service neutron] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:18:22.871706 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1152/2307] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:18:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:18:23.037470 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dfc8fa-8e53-48c8-91c4-c229d81dea9b None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:18:23.037993 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dfc8fa-8e53-48c8-91c4-c229d81dea9b None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:18:23.038539 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dfc8fa-8e53-48c8-91c4-c229d81dea9b None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:18:23.043421 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1156/2308] 10.222.0.20 () {54 vars in 921 bytes} [Wed Mar 30 07:18:23 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:18:23.062378 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b2acb-d5b4-43a7-b083-2ccaf9012010 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:18:23.062890 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b2acb-d5b4-43a7-b083-2ccaf9012010 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:18:23.063500 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b2acb-d5b4-43a7-b083-2ccaf9012010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:18:23.102544 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-904b2acb-d5b4-43a7-b083-2ccaf9012010 None None] MFA Rules not processed for user `72b398c5ed14484d8b7a51fee900597b`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:18:23.104099 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-904b2acb-d5b4-43a7-b083-2ccaf9012010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:18:23.123866 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1153/2309] 10.222.0.20 () {58 vars in 1018 bytes} [Wed Mar 30 07:18:23 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:18:23.180072 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dfc8fa-8e53-48c8-91c4-c229d81dea9b None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:18:23.181914 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-36dfc8fa-8e53-48c8-91c4-c229d81dea9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:18:23.209444 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dfc8fa-8e53-48c8-91c4-c229d81dea9b None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:18:23.242671 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0db626-8c42-400d-97a9-472d07f56545 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3802cb341445f994b9204744060ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:18:23.243508 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0db626-8c42-400d-97a9-472d07f56545 service neutron] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:18:23.243801 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0db626-8c42-400d-97a9-472d07f56545 service neutron] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:18:23.244101 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0db626-8c42-400d-97a9-472d07f56545 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:18:23.286542 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0db626-8c42-400d-97a9-472d07f56545 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:18:23.292475 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0db626-8c42-400d-97a9-472d07f56545 service neutron] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:18:23.340002 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1157/2310] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:18:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:18:26.939969 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f0b615-3053-4aba-ac29-c53cebe7f438 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:18:26.940920 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f0b615-3053-4aba-ac29-c53cebe7f438 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:18:26.941358 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f0b615-3053-4aba-ac29-c53cebe7f438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:18:26.994845 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-26f0b615-3053-4aba-ac29-c53cebe7f438 None None] MFA Rules not processed for user `67102c1adcf0491e9ecdef970ab2d5ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:18:26.997300 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-26f0b615-3053-4aba-ac29-c53cebe7f438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:18:27.023506 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1154/2311] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Mar 30 07:18:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:18:27.042370 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0db626-8c42-400d-97a9-472d07f56545 service neutron] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:18:27.054010 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0db626-8c42-400d-97a9-472d07f56545 service neutron] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:18:27.060421 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722b369f-67cd-4aee-812a-14fdc9b1b4f2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c452249c502d4b0688e8dd068f8c4951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:18:27.061513 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722b369f-67cd-4aee-812a-14fdc9b1b4f2 service swift] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:18:27.061953 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722b369f-67cd-4aee-812a-14fdc9b1b4f2 service swift] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:18:27.062438 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722b369f-67cd-4aee-812a-14fdc9b1b4f2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:18:27.074171 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722b369f-67cd-4aee-812a-14fdc9b1b4f2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:18:27.077503 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722b369f-67cd-4aee-812a-14fdc9b1b4f2 service swift] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:18:27.090809 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1158/2312] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Mar 30 07:18:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 30 07:18:28.147478 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f0b615-3053-4aba-ac29-c53cebe7f438 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:18:28.326970 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f0b615-3053-4aba-ac29-c53cebe7f438 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:18:28.334636 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a6fb2b-2db8-434c-9671-35e627eb245d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:18:28.336071 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6fb2b-2db8-434c-9671-35e627eb245d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:18:28.336359 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6fb2b-2db8-434c-9671-35e627eb245d admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:18:28.336653 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6fb2b-2db8-434c-9671-35e627eb245d admin admin] PATH_INFO: `/v3/users/65042ffcb7744e9b88c7305107120e13` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:18:28.337901 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a6fb2b-2db8-434c-9671-35e627eb245d admin admin] RBAC: Authorizing `identity:delete_user(user_id=65042ffcb7744e9b88c7305107120e13)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:18:28.340062 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a6fb2b-2db8-434c-9671-35e627eb245d admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:18:28.443791 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-26a6fb2b-2db8-434c-9671-35e627eb245d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65042ffcb7744e9b88c7305107120e13'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:18:28.444791 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-26a6fb2b-2db8-434c-9671-35e627eb245d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65042ffcb7744e9b88c7305107120e13'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:18:28.458084 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-26a6fb2b-2db8-434c-9671-35e627eb245d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65042ffcb7744e9b88c7305107120e13'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:18:28.521621 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-26a6fb2b-2db8-434c-9671-35e627eb245d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65042ffcb7744e9b88c7305107120e13'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:18:28.522933 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-26a6fb2b-2db8-434c-9671-35e627eb245d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65042ffcb7744e9b88c7305107120e13'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:18:28.555788 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1155/2313] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Mar 30 07:18:28 2022] DELETE /identity/v3/users/65042ffcb7744e9b88c7305107120e13 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:18:28.557459 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae36811-4803-4333-866c-f60114eaa733 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:18:28.557974 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae36811-4803-4333-866c-f60114eaa733 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:18:28.557974 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae36811-4803-4333-866c-f60114eaa733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:18:28.690830 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-1ae36811-4803-4333-866c-f60114eaa733 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:18:28.697708 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-1ae36811-4803-4333-866c-f60114eaa733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:18:28.887865 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a6fb2b-2db8-434c-9671-35e627eb245d admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:18:28.889712 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-26a6fb2b-2db8-434c-9671-35e627eb245d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:18:28.897314 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1159/2314] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:18:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:18:29.029589 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a6fb2b-2db8-434c-9671-35e627eb245d admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:18:29.044158 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcbe97b-77ce-4025-ac2a-8c25ee3c7a72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3802cb341445f994b9204744060ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:18:29.045655 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcbe97b-77ce-4025-ac2a-8c25ee3c7a72 service neutron] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:18:29.046097 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcbe97b-77ce-4025-ac2a-8c25ee3c7a72 service neutron] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:18:29.046634 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcbe97b-77ce-4025-ac2a-8c25ee3c7a72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:18:29.069141 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcbe97b-77ce-4025-ac2a-8c25ee3c7a72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:18:29.071425 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcbe97b-77ce-4025-ac2a-8c25ee3c7a72 service neutron] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:18:29.087108 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1156/2315] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:18:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 30 07:18:29.641158 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae36811-4803-4333-866c-f60114eaa733 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:18:29.642904 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-1ae36811-4803-4333-866c-f60114eaa733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:18:29.662098 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae36811-4803-4333-866c-f60114eaa733 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:18:29.680711 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a57be1-ca11-4f49-96c8-228bc3bab345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:18:29.681628 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a57be1-ca11-4f49-96c8-228bc3bab345 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:18:29.681912 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a57be1-ca11-4f49-96c8-228bc3bab345 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:18:29.682194 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a57be1-ca11-4f49-96c8-228bc3bab345 admin admin] PATH_INFO: `/v3/projects/2904d7cbd7ab4fdba009036f4131a3ce` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:18:29.686252 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a57be1-ca11-4f49-96c8-228bc3bab345 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2904d7cbd7ab4fdba009036f4131a3ce)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:18:29.688248 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a57be1-ca11-4f49-96c8-228bc3bab345 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:18:29.794234 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-a3a57be1-ca11-4f49-96c8-228bc3bab345 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2904d7cbd7ab4fdba009036f4131a3ce', 'request_id': 'req-a3a57be1-ca11-4f49-96c8-228bc3bab345'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:18:29.802632 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-a3a57be1-ca11-4f49-96c8-228bc3bab345 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2904d7cbd7ab4fdba009036f4131a3ce', 'request_id': 'req-a3a57be1-ca11-4f49-96c8-228bc3bab345'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:18:29.816477 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-a3a57be1-ca11-4f49-96c8-228bc3bab345 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2904d7cbd7ab4fdba009036f4131a3ce', 'request_id': 'req-a3a57be1-ca11-4f49-96c8-228bc3bab345'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:18:29.852553 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-a3a57be1-ca11-4f49-96c8-228bc3bab345 admin admin] The token cache is being invalidate because project 2904d7cbd7ab4fdba009036f4131a3ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79961) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 07:18:29.853290 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-a3a57be1-ca11-4f49-96c8-228bc3bab345 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:18:29.855210 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-a3a57be1-ca11-4f49-96c8-228bc3bab345 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:18:29.859199 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1160/2316] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Mar 30 07:18:29 2022] DELETE /identity/v3/projects/2904d7cbd7ab4fdba009036f4131a3ce => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:18:29.864453 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699740e6-a547-4ec2-8e9a-3c8f2a10bf5a None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:18:29.865366 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699740e6-a547-4ec2-8e9a-3c8f2a10bf5a None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:18:29.865809 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699740e6-a547-4ec2-8e9a-3c8f2a10bf5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:18:29.920127 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-699740e6-a547-4ec2-8e9a-3c8f2a10bf5a None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:18:29.921654 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-699740e6-a547-4ec2-8e9a-3c8f2a10bf5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:18:30.005255 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66bad11-b6f9-4411-95d8-815ac88f2dc4 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:18:30.007698 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66bad11-b6f9-4411-95d8-815ac88f2dc4 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:18:30.011824 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66bad11-b6f9-4411-95d8-815ac88f2dc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:18:30.020254 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1157/2317] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:18:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:18:30.040049 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-e66bad11-b6f9-4411-95d8-815ac88f2dc4 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:18:30.041572 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-e66bad11-b6f9-4411-95d8-815ac88f2dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:18:30.050345 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1161/2318] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:18:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:18:30.055423 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699740e6-a547-4ec2-8e9a-3c8f2a10bf5a None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:18:30.067319 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699740e6-a547-4ec2-8e9a-3c8f2a10bf5a None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:18:30.072962 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0152ac-c873-4714-a99b-42c236b45cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:18:30.073750 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0152ac-c873-4714-a99b-42c236b45cda admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:18:30.075780 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0152ac-c873-4714-a99b-42c236b45cda admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:18:30.076172 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0152ac-c873-4714-a99b-42c236b45cda admin admin] PATH_INFO: `/v3/domains` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:18:30.077032 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0152ac-c873-4714-a99b-42c236b45cda admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:18:30.077372 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0152ac-c873-4714-a99b-42c236b45cda admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:18:30.079503 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0152ac-c873-4714-a99b-42c236b45cda admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:18:30.111482 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1158/2319] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Mar 30 07:18:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:18:30.111689 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66bad11-b6f9-4411-95d8-815ac88f2dc4 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:18:30.121489 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66bad11-b6f9-4411-95d8-815ac88f2dc4 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:18:30.141401 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72be14e-256d-4b1b-90fd-32af8b165c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:18:30.142015 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72be14e-256d-4b1b-90fd-32af8b165c65 admin admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:18:30.142306 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72be14e-256d-4b1b-90fd-32af8b165c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:18:30.142581 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72be14e-256d-4b1b-90fd-32af8b165c65 admin admin] PATH_INFO: `/v3/projects` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:18:30.143465 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72be14e-256d-4b1b-90fd-32af8b165c65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:18:30.145982 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72be14e-256d-4b1b-90fd-32af8b165c65 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:18:30.232884 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1162/2320] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Mar 30 07:18:30 2022] POST /identity/v3/projects => generated 375 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:18:30.233719 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0152ac-c873-4714-a99b-42c236b45cda admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:18:30.258722 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0152ac-c873-4714-a99b-42c236b45cda admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:18:30.371642 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182791c3-7c20-41b2-aa54-fdff8ecd0b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:18:30.372904 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182791c3-7c20-41b2-aa54-fdff8ecd0b16 admin admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:18:30.373416 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182791c3-7c20-41b2-aa54-fdff8ecd0b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:18:30.373934 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182791c3-7c20-41b2-aa54-fdff8ecd0b16 admin admin] PATH_INFO: `/v3/users` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:18:30.375555 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182791c3-7c20-41b2-aa54-fdff8ecd0b16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:18:30.379534 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182791c3-7c20-41b2-aa54-fdff8ecd0b16 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:18:30.413109 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1159/2321] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Mar 30 07:18:30 2022] POST /identity/v3/users => generated 288 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:18:30.415772 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72be14e-256d-4b1b-90fd-32af8b165c65 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:18:30.428444 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72be14e-256d-4b1b-90fd-32af8b165c65 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:18:30.437179 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232b0391-4ec4-4ce3-8e4d-9d303f27d2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:18:30.437897 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232b0391-4ec4-4ce3-8e4d-9d303f27d2f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:18:30.440357 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232b0391-4ec4-4ce3-8e4d-9d303f27d2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:18:30.440652 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232b0391-4ec4-4ce3-8e4d-9d303f27d2f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:18:30.441427 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232b0391-4ec4-4ce3-8e4d-9d303f27d2f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:18:30.447347 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232b0391-4ec4-4ce3-8e4d-9d303f27d2f2 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:18:30.467065 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182791c3-7c20-41b2-aa54-fdff8ecd0b16 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:18:30.474472 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1163/2322] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:18:30 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:18:30.478881 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182791c3-7c20-41b2-aa54-fdff8ecd0b16 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:18:30.485987 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8860bd7d-c988-47ca-9af9-0bd256fa6d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:18:30.486794 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8860bd7d-c988-47ca-9af9-0bd256fa6d0c admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:18:30.487073 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8860bd7d-c988-47ca-9af9-0bd256fa6d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:18:30.487332 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8860bd7d-c988-47ca-9af9-0bd256fa6d0c admin admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:18:30.488089 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8860bd7d-c988-47ca-9af9-0bd256fa6d0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:18:30.489849 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8860bd7d-c988-47ca-9af9-0bd256fa6d0c admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:18:30.506929 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232b0391-4ec4-4ce3-8e4d-9d303f27d2f2 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:18:30.513692 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1160/2323] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:18:30 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 30 07:18:30.517929 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232b0391-4ec4-4ce3-8e4d-9d303f27d2f2 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:18:30.523453 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad50b37c-b032-4ed7-9550-b40d37f1c566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:18:30.524401 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad50b37c-b032-4ed7-9550-b40d37f1c566 admin admin] REQUEST_METHOD: `PUT` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:18:30.524679 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad50b37c-b032-4ed7-9550-b40d37f1c566 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:18:30.524989 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad50b37c-b032-4ed7-9550-b40d37f1c566 admin admin] PATH_INFO: `/v3/projects/095d18729f4c481395d2c3cdfb7d14aa/users/94f75f22761f47aeaacf9b1904b72840/roles/5d79031a64754b57ba120367465e2252` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:18:30.544940 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad50b37c-b032-4ed7-9550-b40d37f1c566 admin admin] RBAC: Authorizing `identity:create_grant(project_id=095d18729f4c481395d2c3cdfb7d14aa, user_id=94f75f22761f47aeaacf9b1904b72840, role_id=5d79031a64754b57ba120367465e2252)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:18:30.546695 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad50b37c-b032-4ed7-9550-b40d37f1c566 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:18:30.572773 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1164/2324] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:18:30 2022] PUT /identity/v3/projects/095d18729f4c481395d2c3cdfb7d14aa/users/94f75f22761f47aeaacf9b1904b72840/roles/5d79031a64754b57ba120367465e2252 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:18:30.575036 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d6351e-ca14-49d4-a287-7c74faa41dd8 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:18:30.575554 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d6351e-ca14-49d4-a287-7c74faa41dd8 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:18:30.576072 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d6351e-ca14-49d4-a287-7c74faa41dd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:18:30.607312 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-85d6351e-ca14-49d4-a287-7c74faa41dd8 None None] MFA Rules not processed for user `94f75f22761f47aeaacf9b1904b72840`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:18:30.608980 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-85d6351e-ca14-49d4-a287-7c74faa41dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:18:30.745617 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1161/2325] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:18:30 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 07:18:30.755475 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad50b37c-b032-4ed7-9550-b40d37f1c566 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:18:30.763732 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-ad50b37c-b032-4ed7-9550-b40d37f1c566 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:18:30.857338 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad50b37c-b032-4ed7-9550-b40d37f1c566 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:18:30.862081 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b73075c-d39a-4fa1-9fcd-74c0655bec91 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e2fda180e8d448d895c40cdad34bc4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:18:30.863522 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b73075c-d39a-4fa1-9fcd-74c0655bec91 service cinder] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:18:30.864139 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b73075c-d39a-4fa1-9fcd-74c0655bec91 service cinder] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:18:30.864699 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b73075c-d39a-4fa1-9fcd-74c0655bec91 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:18:30.883715 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b73075c-d39a-4fa1-9fcd-74c0655bec91 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:18:30.885948 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b73075c-d39a-4fa1-9fcd-74c0655bec91 service cinder] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:18:30.909086 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1165/2326] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:18:30 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:18:36.690337 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b5a9c8-4226-4df2-82ea-96266d0716ea None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:18:36.690964 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b5a9c8-4226-4df2-82ea-96266d0716ea None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:18:36.691238 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b5a9c8-4226-4df2-82ea-96266d0716ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:18:36.731024 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-76b5a9c8-4226-4df2-82ea-96266d0716ea None None] MFA Rules not processed for user `67102c1adcf0491e9ecdef970ab2d5ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:18:36.732472 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-76b5a9c8-4226-4df2-82ea-96266d0716ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:18:36.822606 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1162/2327] 10.222.0.20 () {58 vars in 967 bytes} [Wed Mar 30 07:18:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:18:36.845896 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b73075c-d39a-4fa1-9fcd-74c0655bec91 service cinder] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:18:36.847562 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-6b73075c-d39a-4fa1-9fcd-74c0655bec91 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:18:36.990289 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b73075c-d39a-4fa1-9fcd-74c0655bec91 service cinder] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:18:37.002915 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668a289c-649c-4c9a-ab55-462ee4150ea2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c452249c502d4b0688e8dd068f8c4951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:18:37.003889 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668a289c-649c-4c9a-ab55-462ee4150ea2 service swift] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:18:37.004230 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668a289c-649c-4c9a-ab55-462ee4150ea2 service swift] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:18:37.004618 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668a289c-649c-4c9a-ab55-462ee4150ea2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:18:37.014842 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668a289c-649c-4c9a-ab55-462ee4150ea2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:18:37.016628 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668a289c-649c-4c9a-ab55-462ee4150ea2 service swift] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:18:37.028509 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1166/2328] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Mar 30 07:18:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 30 07:18:39.353822 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b5a9c8-4226-4df2-82ea-96266d0716ea None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:18:39.356697 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-76b5a9c8-4226-4df2-82ea-96266d0716ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:18:39.464797 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b5a9c8-4226-4df2-82ea-96266d0716ea None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:18:39.471975 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06160fb2-47f4-4af8-bff7-dad39a15e1cd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd634743546e8456fac2f6ab1aaee09ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:18:39.472650 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06160fb2-47f4-4af8-bff7-dad39a15e1cd service placement] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:18:39.472939 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06160fb2-47f4-4af8-bff7-dad39a15e1cd service placement] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:18:39.473398 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06160fb2-47f4-4af8-bff7-dad39a15e1cd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:18:39.476188 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-06160fb2-47f4-4af8-bff7-dad39a15e1cd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:18:39.489723 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06160fb2-47f4-4af8-bff7-dad39a15e1cd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:18:39.491595 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06160fb2-47f4-4af8-bff7-dad39a15e1cd service placement] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:18:39.507427 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1163/2329] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:18:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:18:39.976743 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668a289c-649c-4c9a-ab55-462ee4150ea2 service swift] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:18:39.978449 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-668a289c-649c-4c9a-ab55-462ee4150ea2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:18:40.043936 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668a289c-649c-4c9a-ab55-462ee4150ea2 service swift] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:18:40.048686 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235afa81-51b5-4a77-845d-01887dec80cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:18:40.049560 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235afa81-51b5-4a77-845d-01887dec80cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:18:40.049836 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235afa81-51b5-4a77-845d-01887dec80cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:18:40.050107 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235afa81-51b5-4a77-845d-01887dec80cb admin admin] PATH_INFO: `/v3/users/23be35231cd6493e917259e81b849c8d` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:18:40.051265 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235afa81-51b5-4a77-845d-01887dec80cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=23be35231cd6493e917259e81b849c8d)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:18:40.053272 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235afa81-51b5-4a77-845d-01887dec80cb admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:18:40.109546 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-235afa81-51b5-4a77-845d-01887dec80cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23be35231cd6493e917259e81b849c8d'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:18:40.110443 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-235afa81-51b5-4a77-845d-01887dec80cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23be35231cd6493e917259e81b849c8d'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:18:40.111059 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-235afa81-51b5-4a77-845d-01887dec80cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23be35231cd6493e917259e81b849c8d'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:18:40.121756 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-235afa81-51b5-4a77-845d-01887dec80cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23be35231cd6493e917259e81b849c8d'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:18:40.128742 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-235afa81-51b5-4a77-845d-01887dec80cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23be35231cd6493e917259e81b849c8d'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:18:40.145852 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1167/2330] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Mar 30 07:18:39 2022] DELETE /identity/v3/users/23be35231cd6493e917259e81b849c8d => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:18:40.321874 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06160fb2-47f4-4af8-bff7-dad39a15e1cd service placement] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:18:40.332709 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06160fb2-47f4-4af8-bff7-dad39a15e1cd service placement] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:18:40.400735 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde95087-c5fb-4758-b3b0-e5acb13f49da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:18:40.401658 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde95087-c5fb-4758-b3b0-e5acb13f49da admin admin] REQUEST_METHOD: `DELETE` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:18:40.401937 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde95087-c5fb-4758-b3b0-e5acb13f49da admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:18:40.402312 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde95087-c5fb-4758-b3b0-e5acb13f49da admin admin] PATH_INFO: `/v3/projects/c7ad5fa9994340d78e5489bc40885480` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:18:40.403363 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde95087-c5fb-4758-b3b0-e5acb13f49da admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7ad5fa9994340d78e5489bc40885480)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:18:40.405285 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde95087-c5fb-4758-b3b0-e5acb13f49da admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:18:40.453808 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-cde95087-c5fb-4758-b3b0-e5acb13f49da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7ad5fa9994340d78e5489bc40885480', 'request_id': 'req-cde95087-c5fb-4758-b3b0-e5acb13f49da'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:18:40.462680 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-cde95087-c5fb-4758-b3b0-e5acb13f49da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7ad5fa9994340d78e5489bc40885480', 'request_id': 'req-cde95087-c5fb-4758-b3b0-e5acb13f49da'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:18:40.469790 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-cde95087-c5fb-4758-b3b0-e5acb13f49da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7ad5fa9994340d78e5489bc40885480', 'request_id': 'req-cde95087-c5fb-4758-b3b0-e5acb13f49da'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:18:40.483011 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-cde95087-c5fb-4758-b3b0-e5acb13f49da admin admin] The token cache is being invalidate because project c7ad5fa9994340d78e5489bc40885480 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79960) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 07:18:40.484012 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-cde95087-c5fb-4758-b3b0-e5acb13f49da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:18:40.484674 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-cde95087-c5fb-4758-b3b0-e5acb13f49da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:18:40.486261 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1164/2331] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Mar 30 07:18:40 2022] DELETE /identity/v3/projects/c7ad5fa9994340d78e5489bc40885480 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:18:40.491652 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33463269-a541-41a5-b389-93f6b7ff98bf None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:18:40.491941 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33463269-a541-41a5-b389-93f6b7ff98bf None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:18:40.492287 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33463269-a541-41a5-b389-93f6b7ff98bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:18:40.513186 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-33463269-a541-41a5-b389-93f6b7ff98bf None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:18:40.514457 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-33463269-a541-41a5-b389-93f6b7ff98bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:18:40.585394 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1168/2332] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:18:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:18:40.593502 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecccb44f-4a54-4832-bee7-db97a1034816 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:18:40.593812 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecccb44f-4a54-4832-bee7-db97a1034816 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:18:40.594104 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecccb44f-4a54-4832-bee7-db97a1034816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:18:40.624663 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-ecccb44f-4a54-4832-bee7-db97a1034816 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:18:40.626621 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-ecccb44f-4a54-4832-bee7-db97a1034816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:18:40.638606 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1165/2333] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:18:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:18:40.642883 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33463269-a541-41a5-b389-93f6b7ff98bf None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:18:40.654913 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33463269-a541-41a5-b389-93f6b7ff98bf None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:18:40.659658 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca07b64-c00b-40e1-922f-7ed6ec68952b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:18:40.660514 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca07b64-c00b-40e1-922f-7ed6ec68952b admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:18:40.660864 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca07b64-c00b-40e1-922f-7ed6ec68952b admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:18:40.661200 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca07b64-c00b-40e1-922f-7ed6ec68952b admin admin] PATH_INFO: `/v3/domains` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:18:40.662141 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca07b64-c00b-40e1-922f-7ed6ec68952b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:18:40.662518 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca07b64-c00b-40e1-922f-7ed6ec68952b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:18:40.664663 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca07b64-c00b-40e1-922f-7ed6ec68952b admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:18:40.676987 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1169/2334] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Mar 30 07:18:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:18:40.682210 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecccb44f-4a54-4832-bee7-db97a1034816 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:18:40.692130 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecccb44f-4a54-4832-bee7-db97a1034816 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:18:40.697020 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c473cd0-d8be-46be-b7c7-2ddcc1d3cc60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:18:40.697681 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c473cd0-d8be-46be-b7c7-2ddcc1d3cc60 admin admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:18:40.697956 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c473cd0-d8be-46be-b7c7-2ddcc1d3cc60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:18:40.698243 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c473cd0-d8be-46be-b7c7-2ddcc1d3cc60 admin admin] PATH_INFO: `/v3/projects` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:18:40.698943 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c473cd0-d8be-46be-b7c7-2ddcc1d3cc60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:18:40.701027 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c473cd0-d8be-46be-b7c7-2ddcc1d3cc60 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:18:40.734821 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1166/2335] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Mar 30 07:18:40 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:18:40.736141 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca07b64-c00b-40e1-922f-7ed6ec68952b admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:18:40.746466 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca07b64-c00b-40e1-922f-7ed6ec68952b admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:18:40.810107 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093f6a8c-fb1c-4cc7-bb88-8f68040c187d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:18:40.810789 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093f6a8c-fb1c-4cc7-bb88-8f68040c187d admin admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:18:40.811101 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093f6a8c-fb1c-4cc7-bb88-8f68040c187d admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:18:40.811407 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093f6a8c-fb1c-4cc7-bb88-8f68040c187d admin admin] PATH_INFO: `/v3/users` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:18:40.812151 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093f6a8c-fb1c-4cc7-bb88-8f68040c187d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:18:40.814098 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093f6a8c-fb1c-4cc7-bb88-8f68040c187d admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:18:40.841345 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1170/2336] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Mar 30 07:18:40 2022] POST /identity/v3/users => generated 287 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:18:40.845276 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c473cd0-d8be-46be-b7c7-2ddcc1d3cc60 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:18:40.858778 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c473cd0-d8be-46be-b7c7-2ddcc1d3cc60 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:18:40.864097 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ec04a4-5718-4339-9539-fd211208ed04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:18:40.864777 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec04a4-5718-4339-9539-fd211208ed04 admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:18:40.865112 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec04a4-5718-4339-9539-fd211208ed04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:18:40.865348 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec04a4-5718-4339-9539-fd211208ed04 admin admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:18:40.866195 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ec04a4-5718-4339-9539-fd211208ed04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:18:40.867960 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ec04a4-5718-4339-9539-fd211208ed04 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:18:40.879406 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1167/2337] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:18:40 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:18:40.883558 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093f6a8c-fb1c-4cc7-bb88-8f68040c187d admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:18:40.893608 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093f6a8c-fb1c-4cc7-bb88-8f68040c187d admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:18:40.898203 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f473c13-0f30-4af6-bc01-632aa256d878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:18:40.898858 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f473c13-0f30-4af6-bc01-632aa256d878 admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:18:40.899134 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f473c13-0f30-4af6-bc01-632aa256d878 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:18:40.899403 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f473c13-0f30-4af6-bc01-632aa256d878 admin admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:18:40.900185 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f473c13-0f30-4af6-bc01-632aa256d878 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:18:40.901785 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f473c13-0f30-4af6-bc01-632aa256d878 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:18:40.913571 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1171/2338] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:18:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 30 07:18:40.917770 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ec04a4-5718-4339-9539-fd211208ed04 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:18:40.928634 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ec04a4-5718-4339-9539-fd211208ed04 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:18:40.933222 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470aa1dd-ae66-4208-8234-d74cdea1cab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:18:40.934114 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470aa1dd-ae66-4208-8234-d74cdea1cab1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:18:40.934402 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470aa1dd-ae66-4208-8234-d74cdea1cab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:18:40.934674 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470aa1dd-ae66-4208-8234-d74cdea1cab1 admin admin] PATH_INFO: `/v3/projects/0b879ef71fe5494cadf6882b4230511a/users/0034481ab42c4890a835c6876d7fcca7/roles/5d79031a64754b57ba120367465e2252` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:18:40.951254 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470aa1dd-ae66-4208-8234-d74cdea1cab1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b879ef71fe5494cadf6882b4230511a, user_id=0034481ab42c4890a835c6876d7fcca7, role_id=5d79031a64754b57ba120367465e2252)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:18:40.953853 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470aa1dd-ae66-4208-8234-d74cdea1cab1 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:18:40.967026 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1168/2339] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:18:40 2022] PUT /identity/v3/projects/0b879ef71fe5494cadf6882b4230511a/users/0034481ab42c4890a835c6876d7fcca7/roles/5d79031a64754b57ba120367465e2252 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:18:40.972363 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac3da62-d9cf-48f8-81a9-a69f4d76714c None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:18:40.972686 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac3da62-d9cf-48f8-81a9-a69f4d76714c None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:18:40.973037 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac3da62-d9cf-48f8-81a9-a69f4d76714c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:18:40.994009 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-dac3da62-d9cf-48f8-81a9-a69f4d76714c None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:18:40.995280 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-dac3da62-d9cf-48f8-81a9-a69f4d76714c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:18:41.055870 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1172/2340] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:18:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:18:41.065525 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470aa1dd-ae66-4208-8234-d74cdea1cab1 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:18:41.067572 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-470aa1dd-ae66-4208-8234-d74cdea1cab1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:18:41.127510 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470aa1dd-ae66-4208-8234-d74cdea1cab1 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:18:41.131605 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d699913f-c000-4b4b-a2f5-cdc07aa0cb33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3802cb341445f994b9204744060ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:18:41.132521 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d699913f-c000-4b4b-a2f5-cdc07aa0cb33 service neutron] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:18:41.132809 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d699913f-c000-4b4b-a2f5-cdc07aa0cb33 service neutron] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:18:41.133089 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d699913f-c000-4b4b-a2f5-cdc07aa0cb33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:18:41.142365 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d699913f-c000-4b4b-a2f5-cdc07aa0cb33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:18:41.143909 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d699913f-c000-4b4b-a2f5-cdc07aa0cb33 service neutron] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:18:41.153649 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1169/2341] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:18:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:18:42.845920 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac3da62-d9cf-48f8-81a9-a69f4d76714c None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:18:42.848219 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-dac3da62-d9cf-48f8-81a9-a69f4d76714c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:18:42.861630 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac3da62-d9cf-48f8-81a9-a69f4d76714c None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:18:42.871253 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fb1955-8b83-432b-9163-a9efce7ab72c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:18:42.873232 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb1955-8b83-432b-9163-a9efce7ab72c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:18:42.873719 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb1955-8b83-432b-9163-a9efce7ab72c admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:18:42.874183 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb1955-8b83-432b-9163-a9efce7ab72c admin admin] PATH_INFO: `/v3/users/94f75f22761f47aeaacf9b1904b72840` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:18:42.875643 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fb1955-8b83-432b-9163-a9efce7ab72c admin admin] RBAC: Authorizing `identity:delete_user(user_id=94f75f22761f47aeaacf9b1904b72840)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:18:42.878760 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fb1955-8b83-432b-9163-a9efce7ab72c admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:18:42.933339 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-a6fb1955-8b83-432b-9163-a9efce7ab72c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94f75f22761f47aeaacf9b1904b72840'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:18:42.933909 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-a6fb1955-8b83-432b-9163-a9efce7ab72c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94f75f22761f47aeaacf9b1904b72840'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:18:42.934721 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-a6fb1955-8b83-432b-9163-a9efce7ab72c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94f75f22761f47aeaacf9b1904b72840'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:18:42.943724 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-a6fb1955-8b83-432b-9163-a9efce7ab72c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94f75f22761f47aeaacf9b1904b72840'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:18:42.951057 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-a6fb1955-8b83-432b-9163-a9efce7ab72c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94f75f22761f47aeaacf9b1904b72840'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:18:42.968538 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1173/2342] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Mar 30 07:18:42 2022] DELETE /identity/v3/users/94f75f22761f47aeaacf9b1904b72840 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:18:42.973185 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0ed2e4-ea9e-47fc-afdf-db7afbd6a94f None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:18:42.973653 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0ed2e4-ea9e-47fc-afdf-db7afbd6a94f None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:18:42.973757 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0ed2e4-ea9e-47fc-afdf-db7afbd6a94f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:18:42.991560 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-8e0ed2e4-ea9e-47fc-afdf-db7afbd6a94f None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:18:42.992813 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-8e0ed2e4-ea9e-47fc-afdf-db7afbd6a94f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:18:43.054762 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1170/2343] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:18:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:18:43.064857 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fb1955-8b83-432b-9163-a9efce7ab72c admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:18:43.066275 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-a6fb1955-8b83-432b-9163-a9efce7ab72c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:18:43.126036 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fb1955-8b83-432b-9163-a9efce7ab72c admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:18:43.129879 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cee06b3-0bb0-41a7-b244-57f3f6b89854 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3802cb341445f994b9204744060ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:18:43.130534 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cee06b3-0bb0-41a7-b244-57f3f6b89854 service neutron] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:18:43.130807 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cee06b3-0bb0-41a7-b244-57f3f6b89854 service neutron] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:18:43.131103 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cee06b3-0bb0-41a7-b244-57f3f6b89854 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:18:43.141718 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cee06b3-0bb0-41a7-b244-57f3f6b89854 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:18:43.143371 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cee06b3-0bb0-41a7-b244-57f3f6b89854 service neutron] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:18:43.155534 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1174/2344] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:18:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:18:43.737271 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0ed2e4-ea9e-47fc-afdf-db7afbd6a94f None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:18:43.740453 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-8e0ed2e4-ea9e-47fc-afdf-db7afbd6a94f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:18:43.765978 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0ed2e4-ea9e-47fc-afdf-db7afbd6a94f None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:18:43.772259 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23faf721-d850-46a6-905a-02a45b48f8d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:18:43.773389 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23faf721-d850-46a6-905a-02a45b48f8d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:18:43.773858 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23faf721-d850-46a6-905a-02a45b48f8d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:18:43.774449 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23faf721-d850-46a6-905a-02a45b48f8d8 admin admin] PATH_INFO: `/v3/projects/095d18729f4c481395d2c3cdfb7d14aa` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:18:43.775970 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23faf721-d850-46a6-905a-02a45b48f8d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=095d18729f4c481395d2c3cdfb7d14aa)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:18:43.778063 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23faf721-d850-46a6-905a-02a45b48f8d8 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:18:43.840952 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-23faf721-d850-46a6-905a-02a45b48f8d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '095d18729f4c481395d2c3cdfb7d14aa', 'request_id': 'req-23faf721-d850-46a6-905a-02a45b48f8d8'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:18:43.883260 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-23faf721-d850-46a6-905a-02a45b48f8d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '095d18729f4c481395d2c3cdfb7d14aa', 'request_id': 'req-23faf721-d850-46a6-905a-02a45b48f8d8'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:18:43.894825 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-23faf721-d850-46a6-905a-02a45b48f8d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '095d18729f4c481395d2c3cdfb7d14aa', 'request_id': 'req-23faf721-d850-46a6-905a-02a45b48f8d8'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:18:43.915242 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-23faf721-d850-46a6-905a-02a45b48f8d8 admin admin] The token cache is being invalidate because project 095d18729f4c481395d2c3cdfb7d14aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79960) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 07:18:43.915534 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-23faf721-d850-46a6-905a-02a45b48f8d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:18:43.917505 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-23faf721-d850-46a6-905a-02a45b48f8d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:18:43.922635 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1171/2345] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Mar 30 07:18:43 2022] DELETE /identity/v3/projects/095d18729f4c481395d2c3cdfb7d14aa => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 07:18:45.912663 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff531e5-6040-4592-b591-7b41cafa0ff6 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:18:45.912663 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff531e5-6040-4592-b591-7b41cafa0ff6 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:18:45.913158 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff531e5-6040-4592-b591-7b41cafa0ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:18:45.944230 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-cff531e5-6040-4592-b591-7b41cafa0ff6 None None] MFA Rules not processed for user `0034481ab42c4890a835c6876d7fcca7`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:18:45.945663 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-cff531e5-6040-4592-b591-7b41cafa0ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:18:46.019730 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1175/2346] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:18:45 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:18:46.024455 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23faf721-d850-46a6-905a-02a45b48f8d8 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:18:46.026426 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-23faf721-d850-46a6-905a-02a45b48f8d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:18:46.113108 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23faf721-d850-46a6-905a-02a45b48f8d8 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:18:46.118039 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2f1642-5258-466a-8d89-ee70d45f8d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:18:46.118819 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2f1642-5258-466a-8d89-ee70d45f8d3c admin admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:18:46.119155 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2f1642-5258-466a-8d89-ee70d45f8d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:18:46.119486 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2f1642-5258-466a-8d89-ee70d45f8d3c admin admin] PATH_INFO: `/v3/projects` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:18:46.120440 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2f1642-5258-466a-8d89-ee70d45f8d3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:18:46.122402 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2f1642-5258-466a-8d89-ee70d45f8d3c admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:18:46.150333 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1172/2347] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Mar 30 07:18:46 2022] POST /identity/v3/projects => generated 373 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:18:46.154381 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff531e5-6040-4592-b591-7b41cafa0ff6 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:18:46.165641 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff531e5-6040-4592-b591-7b41cafa0ff6 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:18:46.226692 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337f823e-0cdd-45de-b60f-7dde17f7053c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:18:46.231760 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f823e-0cdd-45de-b60f-7dde17f7053c admin admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:18:46.231760 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f823e-0cdd-45de-b60f-7dde17f7053c admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:18:46.231760 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f823e-0cdd-45de-b60f-7dde17f7053c admin admin] PATH_INFO: `/v3/users` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:18:46.231760 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337f823e-0cdd-45de-b60f-7dde17f7053c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:18:46.231760 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337f823e-0cdd-45de-b60f-7dde17f7053c admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:18:46.255439 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1176/2348] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Mar 30 07:18:46 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:18:46.259924 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2f1642-5258-466a-8d89-ee70d45f8d3c admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:18:46.270209 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2f1642-5258-466a-8d89-ee70d45f8d3c admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:18:46.275340 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d40024-08dc-446d-b983-67de992dc70c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:18:46.276034 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d40024-08dc-446d-b983-67de992dc70c admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:18:46.276316 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d40024-08dc-446d-b983-67de992dc70c admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:18:46.276584 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d40024-08dc-446d-b983-67de992dc70c admin admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:18:46.277311 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d40024-08dc-446d-b983-67de992dc70c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:18:46.278907 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d40024-08dc-446d-b983-67de992dc70c admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:18:46.289514 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1173/2349] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:18:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 30 07:18:46.293692 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337f823e-0cdd-45de-b60f-7dde17f7053c admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:18:46.304133 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337f823e-0cdd-45de-b60f-7dde17f7053c admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:18:46.310111 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc94e440-8d67-469d-9423-bbae7b8d3fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:18:46.311491 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc94e440-8d67-469d-9423-bbae7b8d3fd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:18:46.311882 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc94e440-8d67-469d-9423-bbae7b8d3fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:18:46.312236 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc94e440-8d67-469d-9423-bbae7b8d3fd1 admin admin] PATH_INFO: `/v3/projects/f1f33d3365c84e3e94058b8dd744ca92/users/a76d4b293a6e4d18aecc182498e45128/roles/1c39b9ab8cfd4c0ea71845831920a845` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:18:46.328470 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc94e440-8d67-469d-9423-bbae7b8d3fd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1f33d3365c84e3e94058b8dd744ca92, user_id=a76d4b293a6e4d18aecc182498e45128, role_id=1c39b9ab8cfd4c0ea71845831920a845)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:18:46.331127 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc94e440-8d67-469d-9423-bbae7b8d3fd1 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:18:46.344877 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1177/2350] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:18:46 2022] PUT /identity/v3/projects/f1f33d3365c84e3e94058b8dd744ca92/users/a76d4b293a6e4d18aecc182498e45128/roles/1c39b9ab8cfd4c0ea71845831920a845 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:18:46.348832 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d40024-08dc-446d-b983-67de992dc70c admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:18:46.359270 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d40024-08dc-446d-b983-67de992dc70c admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:18:46.420212 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378591a3-9ccc-44dc-a77a-369d0f944935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:18:46.420890 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378591a3-9ccc-44dc-a77a-369d0f944935 admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:18:46.421171 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378591a3-9ccc-44dc-a77a-369d0f944935 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:18:46.421446 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378591a3-9ccc-44dc-a77a-369d0f944935 admin admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:18:46.422172 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378591a3-9ccc-44dc-a77a-369d0f944935 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:18:46.423779 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378591a3-9ccc-44dc-a77a-369d0f944935 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:18:46.434088 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1174/2351] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:18:46 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:18:46.438424 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc94e440-8d67-469d-9423-bbae7b8d3fd1 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:18:46.448922 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc94e440-8d67-469d-9423-bbae7b8d3fd1 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:18:46.454080 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a253d2-a779-49e2-90ee-810737ca2d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:18:46.454982 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a253d2-a779-49e2-90ee-810737ca2d1d admin admin] REQUEST_METHOD: `PUT` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:18:46.455254 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a253d2-a779-49e2-90ee-810737ca2d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:18:46.455554 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a253d2-a779-49e2-90ee-810737ca2d1d admin admin] PATH_INFO: `/v3/projects/f1f33d3365c84e3e94058b8dd744ca92/users/a76d4b293a6e4d18aecc182498e45128/roles/1c39b9ab8cfd4c0ea71845831920a845` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:18:46.457678 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a253d2-a779-49e2-90ee-810737ca2d1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1f33d3365c84e3e94058b8dd744ca92, user_id=a76d4b293a6e4d18aecc182498e45128, role_id=1c39b9ab8cfd4c0ea71845831920a845)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:18:46.460551 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a253d2-a779-49e2-90ee-810737ca2d1d admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:18:46.471824 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1178/2352] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:18:46 2022] PUT /identity/v3/projects/f1f33d3365c84e3e94058b8dd744ca92/users/a76d4b293a6e4d18aecc182498e45128/roles/1c39b9ab8cfd4c0ea71845831920a845 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:18:47.278704 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f184ff-a318-408e-9358-da55d8a8dbbc None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:18:47.280155 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f184ff-a318-408e-9358-da55d8a8dbbc None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:18:47.280594 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f184ff-a318-408e-9358-da55d8a8dbbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:18:47.315984 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-e2f184ff-a318-408e-9358-da55d8a8dbbc None None] MFA Rules not processed for user `67102c1adcf0491e9ecdef970ab2d5ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:18:47.317229 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-e2f184ff-a318-408e-9358-da55d8a8dbbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:18:47.427970 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1175/2353] 10.222.0.20 () {58 vars in 967 bytes} [Wed Mar 30 07:18:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:18:47.444844 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a253d2-a779-49e2-90ee-810737ca2d1d admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:18:47.447035 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-d2a253d2-a779-49e2-90ee-810737ca2d1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:18:47.566902 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a253d2-a779-49e2-90ee-810737ca2d1d admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:18:47.573298 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851fde8a-b574-4806-891e-767f342444a9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c452249c502d4b0688e8dd068f8c4951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:18:47.574044 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851fde8a-b574-4806-891e-767f342444a9 service swift] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:18:47.574381 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851fde8a-b574-4806-891e-767f342444a9 service swift] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:18:47.574719 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851fde8a-b574-4806-891e-767f342444a9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:18:47.583425 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851fde8a-b574-4806-891e-767f342444a9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:18:47.585137 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851fde8a-b574-4806-891e-767f342444a9 service swift] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:18:47.593444 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1179/2354] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Mar 30 07:18:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 30 07:18:51.443281 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbb0a91-005c-44f0-be97-9391fe5d4e04 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:18:51.443780 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbb0a91-005c-44f0-be97-9391fe5d4e04 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:18:51.447944 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbb0a91-005c-44f0-be97-9391fe5d4e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:18:51.482854 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-0fbb0a91-005c-44f0-be97-9391fe5d4e04 None None] MFA Rules not processed for user `a76d4b293a6e4d18aecc182498e45128`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:18:51.484227 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-0fbb0a91-005c-44f0-be97-9391fe5d4e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:18:51.585603 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1176/2355] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:18:51 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:18:51.597805 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851fde8a-b574-4806-891e-767f342444a9 service swift] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:18:51.603140 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-851fde8a-b574-4806-891e-767f342444a9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:18:51.716873 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851fde8a-b574-4806-891e-767f342444a9 service swift] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:18:51.726902 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91709ee-ae15-4777-895f-a28aa418b8a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72b398c5ed14484d8b7a51fee900597b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:18:51.728381 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91709ee-ae15-4777-895f-a28aa418b8a9 service nova] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:18:51.728665 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91709ee-ae15-4777-895f-a28aa418b8a9 service nova] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:18:51.728939 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91709ee-ae15-4777-895f-a28aa418b8a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:18:51.788740 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91709ee-ae15-4777-895f-a28aa418b8a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:18:51.791154 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91709ee-ae15-4777-895f-a28aa418b8a9 service nova] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:18:51.801693 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1180/2356] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:18:51 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:18:52.978331 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe4437-8034-4456-9f45-3df272bdf240 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:18:52.978331 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe4437-8034-4456-9f45-3df272bdf240 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:18:52.978842 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe4437-8034-4456-9f45-3df272bdf240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:18:52.997949 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-77fe4437-8034-4456-9f45-3df272bdf240 None None] MFA Rules not processed for user `0034481ab42c4890a835c6876d7fcca7`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:18:52.999143 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-77fe4437-8034-4456-9f45-3df272bdf240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:18:53.006452 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1177/2357] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:18:52 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:19:30.168007 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91709ee-ae15-4777-895f-a28aa418b8a9 service nova] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:19:30.169832 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-d91709ee-ae15-4777-895f-a28aa418b8a9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:19:30.238229 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91709ee-ae15-4777-895f-a28aa418b8a9 service nova] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:19:30.243210 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b1bdfd-84c4-4506-93f2-aabc6683f8ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:19:30.244153 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b1bdfd-84c4-4506-93f2-aabc6683f8ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:19:30.244430 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b1bdfd-84c4-4506-93f2-aabc6683f8ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:19:30.244698 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b1bdfd-84c4-4506-93f2-aabc6683f8ab admin admin] PATH_INFO: `/v3/users/b25ac073374a491899b09b5c7810eb84` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:19:30.245921 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b1bdfd-84c4-4506-93f2-aabc6683f8ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=b25ac073374a491899b09b5c7810eb84)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:19:30.247839 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b1bdfd-84c4-4506-93f2-aabc6683f8ab admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:19:30.296016 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-b2b1bdfd-84c4-4506-93f2-aabc6683f8ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b25ac073374a491899b09b5c7810eb84'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:19:30.296838 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-b2b1bdfd-84c4-4506-93f2-aabc6683f8ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b25ac073374a491899b09b5c7810eb84'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:19:30.297474 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-b2b1bdfd-84c4-4506-93f2-aabc6683f8ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b25ac073374a491899b09b5c7810eb84'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:19:30.305911 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-b2b1bdfd-84c4-4506-93f2-aabc6683f8ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b25ac073374a491899b09b5c7810eb84'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:19:30.312848 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-b2b1bdfd-84c4-4506-93f2-aabc6683f8ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b25ac073374a491899b09b5c7810eb84'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:19:30.330571 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1181/2358] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Mar 30 07:19:30 2022] DELETE /identity/v3/users/b25ac073374a491899b09b5c7810eb84 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:19:30.506137 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fe4437-8034-4456-9f45-3df272bdf240 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:19:30.517602 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fe4437-8034-4456-9f45-3df272bdf240 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:19:30.578619 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b91e700-a323-4831-8819-735c0c5ecb97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:19:30.579527 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b91e700-a323-4831-8819-735c0c5ecb97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:19:30.579843 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b91e700-a323-4831-8819-735c0c5ecb97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:19:30.580238 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b91e700-a323-4831-8819-735c0c5ecb97 admin admin] PATH_INFO: `/v3/projects/fdbabd5e38b749abb59cbf2680697a54` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:19:30.581524 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b91e700-a323-4831-8819-735c0c5ecb97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdbabd5e38b749abb59cbf2680697a54)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:19:30.583563 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b91e700-a323-4831-8819-735c0c5ecb97 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:19:30.629318 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-2b91e700-a323-4831-8819-735c0c5ecb97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdbabd5e38b749abb59cbf2680697a54', 'request_id': 'req-2b91e700-a323-4831-8819-735c0c5ecb97'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:19:30.637871 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-2b91e700-a323-4831-8819-735c0c5ecb97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdbabd5e38b749abb59cbf2680697a54', 'request_id': 'req-2b91e700-a323-4831-8819-735c0c5ecb97'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:19:30.643673 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-2b91e700-a323-4831-8819-735c0c5ecb97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdbabd5e38b749abb59cbf2680697a54', 'request_id': 'req-2b91e700-a323-4831-8819-735c0c5ecb97'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:19:30.656928 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-2b91e700-a323-4831-8819-735c0c5ecb97 admin admin] The token cache is being invalidate because project fdbabd5e38b749abb59cbf2680697a54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79960) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 07:19:30.657211 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-2b91e700-a323-4831-8819-735c0c5ecb97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:19:30.657931 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-2b91e700-a323-4831-8819-735c0c5ecb97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:19:30.663941 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1178/2359] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Mar 30 07:19:30 2022] DELETE /identity/v3/projects/fdbabd5e38b749abb59cbf2680697a54 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:19:30.665853 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0daebe-7cc5-46c9-baf2-d6eda45287d4 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:19:30.666149 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0daebe-7cc5-46c9-baf2-d6eda45287d4 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:19:30.666794 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0daebe-7cc5-46c9-baf2-d6eda45287d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:19:30.688816 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-4d0daebe-7cc5-46c9-baf2-d6eda45287d4 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:19:30.690136 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-4d0daebe-7cc5-46c9-baf2-d6eda45287d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:19:30.749995 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1182/2360] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:19:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:19:30.758591 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d9759b-d98f-45ac-8235-41814b49beff None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:19:30.758874 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d9759b-d98f-45ac-8235-41814b49beff None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:19:30.759123 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d9759b-d98f-45ac-8235-41814b49beff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:19:30.778505 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-b7d9759b-d98f-45ac-8235-41814b49beff None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:19:30.779704 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-b7d9759b-d98f-45ac-8235-41814b49beff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:19:30.789062 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1179/2361] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:19:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:19:30.793412 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0daebe-7cc5-46c9-baf2-d6eda45287d4 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:19:30.803355 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0daebe-7cc5-46c9-baf2-d6eda45287d4 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:19:30.810558 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606066b3-0882-4074-b4fb-6c7d6b34ff61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:19:30.811467 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606066b3-0882-4074-b4fb-6c7d6b34ff61 admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:19:30.811882 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606066b3-0882-4074-b4fb-6c7d6b34ff61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:19:30.812180 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606066b3-0882-4074-b4fb-6c7d6b34ff61 admin admin] PATH_INFO: `/v3/domains` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:19:30.813214 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606066b3-0882-4074-b4fb-6c7d6b34ff61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:19:30.813592 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606066b3-0882-4074-b4fb-6c7d6b34ff61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:19:30.816504 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606066b3-0882-4074-b4fb-6c7d6b34ff61 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:19:30.832432 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1183/2362] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Mar 30 07:19:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:19:30.838535 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d9759b-d98f-45ac-8235-41814b49beff None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:19:30.848128 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d9759b-d98f-45ac-8235-41814b49beff None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:19:30.853290 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd75b44-0a8f-4bbf-8fab-f4f1ab71e63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:19:30.853999 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd75b44-0a8f-4bbf-8fab-f4f1ab71e63b admin admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:19:30.854691 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd75b44-0a8f-4bbf-8fab-f4f1ab71e63b admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:19:30.854967 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd75b44-0a8f-4bbf-8fab-f4f1ab71e63b admin admin] PATH_INFO: `/v3/projects` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:19:30.855638 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd75b44-0a8f-4bbf-8fab-f4f1ab71e63b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:19:30.857787 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd75b44-0a8f-4bbf-8fab-f4f1ab71e63b admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:19:30.884866 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1180/2363] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Mar 30 07:19:30 2022] POST /identity/v3/projects => generated 379 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:19:30.890347 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606066b3-0882-4074-b4fb-6c7d6b34ff61 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:19:30.900641 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606066b3-0882-4074-b4fb-6c7d6b34ff61 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:19:30.956041 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f366f6be-7630-4182-9be8-e25ed2a1e861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:19:30.956756 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f366f6be-7630-4182-9be8-e25ed2a1e861 admin admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:19:30.957031 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f366f6be-7630-4182-9be8-e25ed2a1e861 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:19:30.957350 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f366f6be-7630-4182-9be8-e25ed2a1e861 admin admin] PATH_INFO: `/v3/users` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:19:30.958030 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f366f6be-7630-4182-9be8-e25ed2a1e861 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:19:30.960013 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f366f6be-7630-4182-9be8-e25ed2a1e861 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:19:30.986626 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1184/2364] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Mar 30 07:19:30 2022] POST /identity/v3/users => generated 290 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:19:30.992911 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd75b44-0a8f-4bbf-8fab-f4f1ab71e63b admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:19:31.003909 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd75b44-0a8f-4bbf-8fab-f4f1ab71e63b admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:19:31.009371 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa52fa02-f61c-4e6f-89b4-71877a7c1050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:19:31.010024 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa52fa02-f61c-4e6f-89b4-71877a7c1050 admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:19:31.010332 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa52fa02-f61c-4e6f-89b4-71877a7c1050 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:19:31.010598 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa52fa02-f61c-4e6f-89b4-71877a7c1050 admin admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:19:31.011320 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa52fa02-f61c-4e6f-89b4-71877a7c1050 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:19:31.012959 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa52fa02-f61c-4e6f-89b4-71877a7c1050 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:19:31.023463 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1181/2365] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:19:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:19:31.027481 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f366f6be-7630-4182-9be8-e25ed2a1e861 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:19:31.037637 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f366f6be-7630-4182-9be8-e25ed2a1e861 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:19:31.042582 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c97edc-ca87-4bfd-924e-ca08fb6693d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:19:31.043274 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c97edc-ca87-4bfd-924e-ca08fb6693d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:19:31.043539 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c97edc-ca87-4bfd-924e-ca08fb6693d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:19:31.043831 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c97edc-ca87-4bfd-924e-ca08fb6693d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:19:31.044590 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c97edc-ca87-4bfd-924e-ca08fb6693d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:19:31.046168 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c97edc-ca87-4bfd-924e-ca08fb6693d3 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:19:31.056377 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1185/2366] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:19:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:19:31.060529 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa52fa02-f61c-4e6f-89b4-71877a7c1050 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:19:31.071152 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa52fa02-f61c-4e6f-89b4-71877a7c1050 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:19:31.076868 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5485ee8-62a5-4a19-a136-cdda15139d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:19:31.077766 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5485ee8-62a5-4a19-a136-cdda15139d78 admin admin] REQUEST_METHOD: `PUT` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:19:31.078043 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5485ee8-62a5-4a19-a136-cdda15139d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:19:31.078311 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5485ee8-62a5-4a19-a136-cdda15139d78 admin admin] PATH_INFO: `/v3/projects/803772b9959c49c988cb738b94678917/users/38e427dd29ea4380b01a1c257cc3da00/roles/5d79031a64754b57ba120367465e2252` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:19:31.094627 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5485ee8-62a5-4a19-a136-cdda15139d78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=803772b9959c49c988cb738b94678917, user_id=38e427dd29ea4380b01a1c257cc3da00, role_id=5d79031a64754b57ba120367465e2252)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:19:31.097923 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5485ee8-62a5-4a19-a136-cdda15139d78 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:19:31.114593 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1182/2367] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:19:31 2022] PUT /identity/v3/projects/803772b9959c49c988cb738b94678917/users/38e427dd29ea4380b01a1c257cc3da00/roles/5d79031a64754b57ba120367465e2252 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:19:31.120184 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b732137f-3e2e-4c58-91db-3dc4fc29d980 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:19:31.120473 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b732137f-3e2e-4c58-91db-3dc4fc29d980 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:19:31.120745 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b732137f-3e2e-4c58-91db-3dc4fc29d980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:19:31.140140 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-b732137f-3e2e-4c58-91db-3dc4fc29d980 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:19:31.141462 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-b732137f-3e2e-4c58-91db-3dc4fc29d980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:19:31.201558 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1186/2368] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:19:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:19:31.217005 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5485ee8-62a5-4a19-a136-cdda15139d78 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:19:31.218869 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-f5485ee8-62a5-4a19-a136-cdda15139d78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:19:31.278115 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5485ee8-62a5-4a19-a136-cdda15139d78 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:19:31.282031 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a91e7a2-8b92-4c6c-8c88-146d28ab95a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3802cb341445f994b9204744060ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:19:31.282687 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a91e7a2-8b92-4c6c-8c88-146d28ab95a5 service neutron] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:19:31.282990 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a91e7a2-8b92-4c6c-8c88-146d28ab95a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:19:31.283394 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a91e7a2-8b92-4c6c-8c88-146d28ab95a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:19:31.292766 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a91e7a2-8b92-4c6c-8c88-146d28ab95a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:19:31.294299 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a91e7a2-8b92-4c6c-8c88-146d28ab95a5 service neutron] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:19:31.304453 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1183/2369] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:19:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:19:35.908042 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b732137f-3e2e-4c58-91db-3dc4fc29d980 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:19:35.910946 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-b732137f-3e2e-4c58-91db-3dc4fc29d980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:19:35.924427 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b732137f-3e2e-4c58-91db-3dc4fc29d980 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:19:35.928707 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63116ca4-0ea0-4fdb-be9f-7326b8c44be8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3802cb341445f994b9204744060ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:19:35.929661 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63116ca4-0ea0-4fdb-be9f-7326b8c44be8 service neutron] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:19:35.930257 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63116ca4-0ea0-4fdb-be9f-7326b8c44be8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:19:35.930824 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63116ca4-0ea0-4fdb-be9f-7326b8c44be8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:19:35.934478 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-63116ca4-0ea0-4fdb-be9f-7326b8c44be8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:19:36.019913 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63116ca4-0ea0-4fdb-be9f-7326b8c44be8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:19:36.021678 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63116ca4-0ea0-4fdb-be9f-7326b8c44be8 service neutron] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:19:36.032826 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1187/2370] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:19:35 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:19:36.379082 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeefc9e-94a9-412a-93dd-7b6f96ca521d None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:19:36.380055 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeefc9e-94a9-412a-93dd-7b6f96ca521d None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:19:36.380621 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeefc9e-94a9-412a-93dd-7b6f96ca521d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:19:36.410583 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-0aeefc9e-94a9-412a-93dd-7b6f96ca521d None None] MFA Rules not processed for user `38e427dd29ea4380b01a1c257cc3da00`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:19:36.411822 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-0aeefc9e-94a9-412a-93dd-7b6f96ca521d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:19:36.478237 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1184/2371] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:19:36 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:19:36.484046 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63116ca4-0ea0-4fdb-be9f-7326b8c44be8 service neutron] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:19:36.495335 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63116ca4-0ea0-4fdb-be9f-7326b8c44be8 service neutron] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:19:36.500122 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9dfa36-83c1-4fc3-af71-9bac29987868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:19:36.500905 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9dfa36-83c1-4fc3-af71-9bac29987868 admin admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:19:36.501379 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9dfa36-83c1-4fc3-af71-9bac29987868 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:19:36.501714 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9dfa36-83c1-4fc3-af71-9bac29987868 admin admin] PATH_INFO: `/v3/projects` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:19:36.502539 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9dfa36-83c1-4fc3-af71-9bac29987868 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:19:36.504545 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9dfa36-83c1-4fc3-af71-9bac29987868 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:19:36.541282 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1188/2372] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Mar 30 07:19:36 2022] POST /identity/v3/projects => generated 379 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:19:36.545385 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeefc9e-94a9-412a-93dd-7b6f96ca521d None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:19:36.558380 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeefc9e-94a9-412a-93dd-7b6f96ca521d None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:19:36.633869 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f3a767-67c2-454c-84f5-f545142da133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:19:36.634670 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f3a767-67c2-454c-84f5-f545142da133 admin admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:19:36.635009 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f3a767-67c2-454c-84f5-f545142da133 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:19:36.635345 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f3a767-67c2-454c-84f5-f545142da133 admin admin] PATH_INFO: `/v3/users` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:19:36.636159 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f3a767-67c2-454c-84f5-f545142da133 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:19:36.638195 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f3a767-67c2-454c-84f5-f545142da133 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:19:36.662396 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1185/2373] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Mar 30 07:19:36 2022] POST /identity/v3/users => generated 296 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 07:19:36.663649 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9dfa36-83c1-4fc3-af71-9bac29987868 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:19:36.673721 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9dfa36-83c1-4fc3-af71-9bac29987868 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:19:36.678409 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58231d1-2f7e-4516-a1ee-8f76b9d24e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:19:36.679107 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58231d1-2f7e-4516-a1ee-8f76b9d24e2d admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:19:36.679381 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58231d1-2f7e-4516-a1ee-8f76b9d24e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:19:36.679652 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58231d1-2f7e-4516-a1ee-8f76b9d24e2d admin admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:19:36.680487 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58231d1-2f7e-4516-a1ee-8f76b9d24e2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:19:36.682309 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58231d1-2f7e-4516-a1ee-8f76b9d24e2d admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:19:36.701529 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1189/2374] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:19:36 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:19:36.702753 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f3a767-67c2-454c-84f5-f545142da133 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:19:36.713545 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f3a767-67c2-454c-84f5-f545142da133 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:19:36.718487 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b327bf30-2f08-4122-8b0b-e5d2afa3dddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:19:36.719403 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b327bf30-2f08-4122-8b0b-e5d2afa3dddb admin admin] REQUEST_METHOD: `PUT` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:19:36.719680 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b327bf30-2f08-4122-8b0b-e5d2afa3dddb admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:19:36.720109 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b327bf30-2f08-4122-8b0b-e5d2afa3dddb admin admin] PATH_INFO: `/v3/projects/571848e3be7a42febae87b6a467ef6bf/users/81d05f3fa31c4752abacf9d7e697dafb/roles/1c39b9ab8cfd4c0ea71845831920a845` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:19:36.736411 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b327bf30-2f08-4122-8b0b-e5d2afa3dddb admin admin] RBAC: Authorizing `identity:create_grant(project_id=571848e3be7a42febae87b6a467ef6bf, user_id=81d05f3fa31c4752abacf9d7e697dafb, role_id=1c39b9ab8cfd4c0ea71845831920a845)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:19:36.739571 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b327bf30-2f08-4122-8b0b-e5d2afa3dddb admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:19:36.753623 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1186/2375] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:19:36 2022] PUT /identity/v3/projects/571848e3be7a42febae87b6a467ef6bf/users/81d05f3fa31c4752abacf9d7e697dafb/roles/1c39b9ab8cfd4c0ea71845831920a845 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 07:19:36.757679 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58231d1-2f7e-4516-a1ee-8f76b9d24e2d admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:19:36.767428 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58231d1-2f7e-4516-a1ee-8f76b9d24e2d admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:19:36.822298 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8ba929-772b-42cf-b73d-e3b5bd4328bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:19:36.822966 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8ba929-772b-42cf-b73d-e3b5bd4328bb admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:19:36.823360 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8ba929-772b-42cf-b73d-e3b5bd4328bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:19:36.823710 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8ba929-772b-42cf-b73d-e3b5bd4328bb admin admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:19:36.824412 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8ba929-772b-42cf-b73d-e3b5bd4328bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:19:36.826159 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8ba929-772b-42cf-b73d-e3b5bd4328bb admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:19:36.836378 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1190/2376] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:19:36 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:19:36.840780 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b327bf30-2f08-4122-8b0b-e5d2afa3dddb admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:19:36.851685 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b327bf30-2f08-4122-8b0b-e5d2afa3dddb admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:19:36.856898 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c5da79-3a6d-4749-84f6-db3067c16b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:19:36.857797 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c5da79-3a6d-4749-84f6-db3067c16b7a admin admin] REQUEST_METHOD: `PUT` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:19:36.858080 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c5da79-3a6d-4749-84f6-db3067c16b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:19:36.858357 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c5da79-3a6d-4749-84f6-db3067c16b7a admin admin] PATH_INFO: `/v3/projects/571848e3be7a42febae87b6a467ef6bf/users/81d05f3fa31c4752abacf9d7e697dafb/roles/1c39b9ab8cfd4c0ea71845831920a845` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:19:36.860452 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c5da79-3a6d-4749-84f6-db3067c16b7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=571848e3be7a42febae87b6a467ef6bf, user_id=81d05f3fa31c4752abacf9d7e697dafb, role_id=1c39b9ab8cfd4c0ea71845831920a845)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:19:36.863160 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c5da79-3a6d-4749-84f6-db3067c16b7a admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:19:36.873733 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1187/2377] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:19:36 2022] PUT /identity/v3/projects/571848e3be7a42febae87b6a467ef6bf/users/81d05f3fa31c4752abacf9d7e697dafb/roles/1c39b9ab8cfd4c0ea71845831920a845 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:19:42.976965 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2891b572-b5ff-41e1-b913-fc994d584ace None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:19:42.977447 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2891b572-b5ff-41e1-b913-fc994d584ace None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:19:42.977708 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2891b572-b5ff-41e1-b913-fc994d584ace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:19:43.007723 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-2891b572-b5ff-41e1-b913-fc994d584ace None None] MFA Rules not processed for user `81d05f3fa31c4752abacf9d7e697dafb`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:19:43.009057 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-2891b572-b5ff-41e1-b913-fc994d584ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:19:43.075462 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1191/2378] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:19:42 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:19:43.086895 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c5da79-3a6d-4749-84f6-db3067c16b7a admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:19:43.088792 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-a1c5da79-3a6d-4749-84f6-db3067c16b7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:19:43.166013 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c5da79-3a6d-4749-84f6-db3067c16b7a admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:19:43.171914 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df800cf4-27e7-410e-af75-3497f955807a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72b398c5ed14484d8b7a51fee900597b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:19:43.172560 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df800cf4-27e7-410e-af75-3497f955807a service nova] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:19:43.172837 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df800cf4-27e7-410e-af75-3497f955807a service nova] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:19:43.173104 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df800cf4-27e7-410e-af75-3497f955807a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:19:43.230516 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df800cf4-27e7-410e-af75-3497f955807a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:19:43.232161 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df800cf4-27e7-410e-af75-3497f955807a service nova] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:19:43.241546 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1188/2379] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:19:43 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:19:50.130211 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ada114-3082-46aa-ad17-290ed7e93bf3 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:19:50.130781 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ada114-3082-46aa-ad17-290ed7e93bf3 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:19:50.130781 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ada114-3082-46aa-ad17-290ed7e93bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:19:50.155854 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-19ada114-3082-46aa-ad17-290ed7e93bf3 None None] MFA Rules not processed for user `93c4c81f994a48feb4d712c6b5120996`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:19:50.157673 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-19ada114-3082-46aa-ad17-290ed7e93bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:19:50.222518 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1192/2380] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:19:50 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:20:01.012178 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb2eb2e-af7f-42b5-ae22-7e6c009b6d51 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:20:01.012733 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb2eb2e-af7f-42b5-ae22-7e6c009b6d51 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:20:01.012733 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb2eb2e-af7f-42b5-ae22-7e6c009b6d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:20:01.031138 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-2fb2eb2e-af7f-42b5-ae22-7e6c009b6d51 None None] MFA Rules not processed for user `38e427dd29ea4380b01a1c257cc3da00`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:20:01.032367 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-2fb2eb2e-af7f-42b5-ae22-7e6c009b6d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:20:01.041040 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1189/2381] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:20:01 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:20:02.581507 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c7d2a2-70f8-42bc-961f-a59e9f632730 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:20:02.582053 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c7d2a2-70f8-42bc-961f-a59e9f632730 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:20:02.582053 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c7d2a2-70f8-42bc-961f-a59e9f632730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:20:02.601614 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-63c7d2a2-70f8-42bc-961f-a59e9f632730 None None] MFA Rules not processed for user `bc84d32966d34ff29620cd40d3d9cc3a`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:20:02.602806 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-63c7d2a2-70f8-42bc-961f-a59e9f632730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:20:02.659731 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1193/2382] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:20:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:20:16.569263 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb2eb2e-af7f-42b5-ae22-7e6c009b6d51 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:20:16.627727 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb2eb2e-af7f-42b5-ae22-7e6c009b6d51 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:20:16.632263 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caa3638-ae38-47f6-9d63-42ce1ed89bb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3802cb341445f994b9204744060ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:20:16.632909 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa3638-ae38-47f6-9d63-42ce1ed89bb6 service neutron] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:20:16.633191 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa3638-ae38-47f6-9d63-42ce1ed89bb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:20:16.633519 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa3638-ae38-47f6-9d63-42ce1ed89bb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:20:16.645180 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caa3638-ae38-47f6-9d63-42ce1ed89bb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:20:16.647352 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caa3638-ae38-47f6-9d63-42ce1ed89bb6 service neutron] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:20:16.662742 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1190/2383] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:20:16 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:20:32.513511 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0bd340-64e0-453b-9c4f-91eb9ace2735 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:20:32.514048 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0bd340-64e0-453b-9c4f-91eb9ace2735 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:20:32.514048 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0bd340-64e0-453b-9c4f-91eb9ace2735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:20:32.531864 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-ec0bd340-64e0-453b-9c4f-91eb9ace2735 None None] MFA Rules not processed for user `8dd9d32c47014294a367654b57c96f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:20:32.533065 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-ec0bd340-64e0-453b-9c4f-91eb9ace2735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:20:32.594409 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1194/2384] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:20:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:20:32.631470 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caa3638-ae38-47f6-9d63-42ce1ed89bb6 service neutron] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:20:32.633178 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-2caa3638-ae38-47f6-9d63-42ce1ed89bb6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:20:32.719419 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caa3638-ae38-47f6-9d63-42ce1ed89bb6 service neutron] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:20:32.723957 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287e62a9-884f-461d-ac3a-c088275c10ba service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e880ade912f3412abf44ba73939d6e50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:20:32.724625 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287e62a9-884f-461d-ac3a-c088275c10ba service glance] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:20:32.724901 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287e62a9-884f-461d-ac3a-c088275c10ba service glance] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:20:32.725167 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287e62a9-884f-461d-ac3a-c088275c10ba service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:20:32.727275 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-287e62a9-884f-461d-ac3a-c088275c10ba service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:20:32.741331 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287e62a9-884f-461d-ac3a-c088275c10ba service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:20:32.742759 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287e62a9-884f-461d-ac3a-c088275c10ba service glance] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:20:32.755151 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1191/2385] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:20:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:20:33.391713 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0bd340-64e0-453b-9c4f-91eb9ace2735 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:20:33.402117 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0bd340-64e0-453b-9c4f-91eb9ace2735 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:20:33.406003 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a91de2b-a199-4ebf-8204-6b12644e411c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3802cb341445f994b9204744060ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:20:33.406626 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a91de2b-a199-4ebf-8204-6b12644e411c service neutron] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:20:33.406956 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a91de2b-a199-4ebf-8204-6b12644e411c service neutron] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:20:33.407202 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a91de2b-a199-4ebf-8204-6b12644e411c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:20:33.409068 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-3a91de2b-a199-4ebf-8204-6b12644e411c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:20:33.423155 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a91de2b-a199-4ebf-8204-6b12644e411c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:20:33.424824 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a91de2b-a199-4ebf-8204-6b12644e411c service neutron] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:20:33.436143 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1195/2386] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:20:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:20:42.715791 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287e62a9-884f-461d-ac3a-c088275c10ba service glance] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:20:42.727702 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287e62a9-884f-461d-ac3a-c088275c10ba service glance] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:20:42.736071 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e05de0-9bf0-4eb6-9ce4-4dc863a48569 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72b398c5ed14484d8b7a51fee900597b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:20:42.736732 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e05de0-9bf0-4eb6-9ce4-4dc863a48569 service nova] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:20:42.737006 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e05de0-9bf0-4eb6-9ce4-4dc863a48569 service nova] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:20:42.737279 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e05de0-9bf0-4eb6-9ce4-4dc863a48569 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:20:42.739423 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-17e05de0-9bf0-4eb6-9ce4-4dc863a48569 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:20:42.751117 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e05de0-9bf0-4eb6-9ce4-4dc863a48569 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:20:42.752765 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e05de0-9bf0-4eb6-9ce4-4dc863a48569 service nova] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:20:42.762070 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1192/2387] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:20:42 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:20:44.336636 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a91de2b-a199-4ebf-8204-6b12644e411c service neutron] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:20:44.345508 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a91de2b-a199-4ebf-8204-6b12644e411c service neutron] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:20:44.349739 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99139990-3a7c-430c-b2f3-be89e674f356 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3802cb341445f994b9204744060ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:20:44.350395 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99139990-3a7c-430c-b2f3-be89e674f356 service neutron] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:20:44.350667 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99139990-3a7c-430c-b2f3-be89e674f356 service neutron] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:20:44.350935 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99139990-3a7c-430c-b2f3-be89e674f356 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:20:44.352963 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-99139990-3a7c-430c-b2f3-be89e674f356 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:20:44.363977 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99139990-3a7c-430c-b2f3-be89e674f356 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:20:44.365412 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99139990-3a7c-430c-b2f3-be89e674f356 service neutron] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:20:44.373990 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1196/2388] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:20:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:20:46.020319 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e05de0-9bf0-4eb6-9ce4-4dc863a48569 service nova] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:20:46.022781 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-17e05de0-9bf0-4eb6-9ce4-4dc863a48569 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:20:46.106321 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e05de0-9bf0-4eb6-9ce4-4dc863a48569 service nova] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:20:46.110791 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff06b31-bb63-4b33-9b2b-c901e526e199 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e2fda180e8d448d895c40cdad34bc4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:20:46.111459 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff06b31-bb63-4b33-9b2b-c901e526e199 service cinder] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:20:46.111736 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff06b31-bb63-4b33-9b2b-c901e526e199 service cinder] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:20:46.112031 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff06b31-bb63-4b33-9b2b-c901e526e199 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:20:46.114781 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-7ff06b31-bb63-4b33-9b2b-c901e526e199 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:20:46.131193 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff06b31-bb63-4b33-9b2b-c901e526e199 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:20:46.132715 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff06b31-bb63-4b33-9b2b-c901e526e199 service cinder] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:20:46.142356 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1193/2389] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:20:46 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:20:46.787510 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99139990-3a7c-430c-b2f3-be89e674f356 service neutron] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:20:46.789204 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-99139990-3a7c-430c-b2f3-be89e674f356 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:20:46.809735 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99139990-3a7c-430c-b2f3-be89e674f356 service neutron] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:20:46.817003 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02900e6-8139-4954-ab78-802e4ca8e52c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72b398c5ed14484d8b7a51fee900597b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:20:46.817646 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02900e6-8139-4954-ab78-802e4ca8e52c service nova] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:20:46.817926 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02900e6-8139-4954-ab78-802e4ca8e52c service nova] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:20:46.818203 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02900e6-8139-4954-ab78-802e4ca8e52c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:20:46.820197 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-c02900e6-8139-4954-ab78-802e4ca8e52c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:20:46.830984 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02900e6-8139-4954-ab78-802e4ca8e52c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:20:46.832619 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02900e6-8139-4954-ab78-802e4ca8e52c service nova] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:20:46.841627 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1197/2390] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:20:46 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:21:00.969650 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff06b31-bb63-4b33-9b2b-c901e526e199 service cinder] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:00.984601 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff06b31-bb63-4b33-9b2b-c901e526e199 service cinder] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:00.991147 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bc47b4-8684-4a21-a41a-d7f984a34976 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72b398c5ed14484d8b7a51fee900597b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:00.991838 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bc47b4-8684-4a21-a41a-d7f984a34976 service nova] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:00.992135 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bc47b4-8684-4a21-a41a-d7f984a34976 service nova] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:00.992646 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bc47b4-8684-4a21-a41a-d7f984a34976 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:00.994488 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-e6bc47b4-8684-4a21-a41a-d7f984a34976 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:21:01.007516 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bc47b4-8684-4a21-a41a-d7f984a34976 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:01.009147 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bc47b4-8684-4a21-a41a-d7f984a34976 service nova] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:01.020567 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1194/2391] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:21:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:21:07.419557 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02900e6-8139-4954-ab78-802e4ca8e52c service nova] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:07.430474 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02900e6-8139-4954-ab78-802e4ca8e52c service nova] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:07.435619 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b629a56-1d82-4b1c-a1b2-6944acb83029 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3802cb341445f994b9204744060ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:07.436313 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b629a56-1d82-4b1c-a1b2-6944acb83029 service neutron] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:07.436959 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b629a56-1d82-4b1c-a1b2-6944acb83029 service neutron] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:07.436959 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b629a56-1d82-4b1c-a1b2-6944acb83029 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:07.438976 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-6b629a56-1d82-4b1c-a1b2-6944acb83029 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:21:07.476728 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0d37a7-2744-4100-98ae-3ce40110849b None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:07.477228 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0d37a7-2744-4100-98ae-3ce40110849b None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:07.477329 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0d37a7-2744-4100-98ae-3ce40110849b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:07.502868 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b629a56-1d82-4b1c-a1b2-6944acb83029 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:07.504342 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b629a56-1d82-4b1c-a1b2-6944acb83029 service neutron] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:07.514443 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1198/2392] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:21:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:21:07.527644 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-7e0d37a7-2744-4100-98ae-3ce40110849b None None] MFA Rules not processed for user `67102c1adcf0491e9ecdef970ab2d5ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:21:07.528936 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-7e0d37a7-2744-4100-98ae-3ce40110849b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:21:07.594348 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1195/2393] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Mar 30 07:21:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 07:21:07.642446 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b629a56-1d82-4b1c-a1b2-6944acb83029 service neutron] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:07.644072 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-6b629a56-1d82-4b1c-a1b2-6944acb83029 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:21:07.735084 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b629a56-1d82-4b1c-a1b2-6944acb83029 service neutron] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:07.741003 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6299ae-d52a-46ec-a953-8fca54265324 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c452249c502d4b0688e8dd068f8c4951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:07.741656 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6299ae-d52a-46ec-a953-8fca54265324 service swift] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:07.741937 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6299ae-d52a-46ec-a953-8fca54265324 service swift] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:07.742201 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6299ae-d52a-46ec-a953-8fca54265324 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:07.750671 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6299ae-d52a-46ec-a953-8fca54265324 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:07.752287 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6299ae-d52a-46ec-a953-8fca54265324 service swift] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:07.760572 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1199/2394] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Mar 30 07:21:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 30 07:21:08.689496 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0d37a7-2744-4100-98ae-3ce40110849b None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:08.713728 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0d37a7-2744-4100-98ae-3ce40110849b None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:08.732758 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dbfef1-34e9-4845-a1cb-615533f60ded service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72b398c5ed14484d8b7a51fee900597b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:08.735679 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dbfef1-34e9-4845-a1cb-615533f60ded service nova] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:08.737383 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dbfef1-34e9-4845-a1cb-615533f60ded service nova] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:08.738969 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dbfef1-34e9-4845-a1cb-615533f60ded service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:08.746551 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-b2dbfef1-34e9-4845-a1cb-615533f60ded service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:21:08.809436 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dbfef1-34e9-4845-a1cb-615533f60ded service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:08.812824 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dbfef1-34e9-4845-a1cb-615533f60ded service nova] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:08.829410 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1196/2395] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:21:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:21:12.173660 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6299ae-d52a-46ec-a953-8fca54265324 service swift] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:12.176788 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-dc6299ae-d52a-46ec-a953-8fca54265324 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:21:12.197832 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6299ae-d52a-46ec-a953-8fca54265324 service swift] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:12.219086 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3780170d-4dc8-426c-988d-8c1e129301a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:12.220210 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3780170d-4dc8-426c-988d-8c1e129301a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:12.220681 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3780170d-4dc8-426c-988d-8c1e129301a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:12.221115 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3780170d-4dc8-426c-988d-8c1e129301a6 admin admin] PATH_INFO: `/v3/users/bc84d32966d34ff29620cd40d3d9cc3a` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:12.222744 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3780170d-4dc8-426c-988d-8c1e129301a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc84d32966d34ff29620cd40d3d9cc3a)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:12.224880 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3780170d-4dc8-426c-988d-8c1e129301a6 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:12.296362 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-3780170d-4dc8-426c-988d-8c1e129301a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc84d32966d34ff29620cd40d3d9cc3a'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:21:12.297468 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-3780170d-4dc8-426c-988d-8c1e129301a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc84d32966d34ff29620cd40d3d9cc3a'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:21:12.298884 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-3780170d-4dc8-426c-988d-8c1e129301a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc84d32966d34ff29620cd40d3d9cc3a'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:21:12.309087 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-3780170d-4dc8-426c-988d-8c1e129301a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc84d32966d34ff29620cd40d3d9cc3a'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:21:12.317616 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-3780170d-4dc8-426c-988d-8c1e129301a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc84d32966d34ff29620cd40d3d9cc3a'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:21:12.342316 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1200/2396] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Mar 30 07:21:12 2022] DELETE /identity/v3/users/bc84d32966d34ff29620cd40d3d9cc3a => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:21:12.539198 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dbfef1-34e9-4845-a1cb-615533f60ded service nova] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:12.553799 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dbfef1-34e9-4845-a1cb-615533f60ded service nova] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:12.632375 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2819b805-26ac-438c-926d-1423d60be13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:12.633511 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2819b805-26ac-438c-926d-1423d60be13f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:12.633788 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2819b805-26ac-438c-926d-1423d60be13f admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:12.634059 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2819b805-26ac-438c-926d-1423d60be13f admin admin] PATH_INFO: `/v3/projects/b5ef95aec46649a2b057416827ea46aa` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:12.635420 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2819b805-26ac-438c-926d-1423d60be13f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5ef95aec46649a2b057416827ea46aa)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:12.637578 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2819b805-26ac-438c-926d-1423d60be13f admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:12.696096 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-2819b805-26ac-438c-926d-1423d60be13f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5ef95aec46649a2b057416827ea46aa', 'request_id': 'req-2819b805-26ac-438c-926d-1423d60be13f'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:21:12.705408 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-2819b805-26ac-438c-926d-1423d60be13f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5ef95aec46649a2b057416827ea46aa', 'request_id': 'req-2819b805-26ac-438c-926d-1423d60be13f'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:21:12.711205 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-2819b805-26ac-438c-926d-1423d60be13f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5ef95aec46649a2b057416827ea46aa', 'request_id': 'req-2819b805-26ac-438c-926d-1423d60be13f'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:21:12.724088 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-2819b805-26ac-438c-926d-1423d60be13f admin admin] The token cache is being invalidate because project b5ef95aec46649a2b057416827ea46aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79960) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 07:21:12.724088 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-2819b805-26ac-438c-926d-1423d60be13f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:21:12.724386 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-2819b805-26ac-438c-926d-1423d60be13f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:21:12.726066 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1197/2397] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Mar 30 07:21:12 2022] DELETE /identity/v3/projects/b5ef95aec46649a2b057416827ea46aa => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:21:12.732656 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d517ca-375f-43ba-b4a7-6c4e475f57ce None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:12.733193 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d517ca-375f-43ba-b4a7-6c4e475f57ce None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:12.733473 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d517ca-375f-43ba-b4a7-6c4e475f57ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:12.755731 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-03d517ca-375f-43ba-b4a7-6c4e475f57ce None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:21:12.757052 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-03d517ca-375f-43ba-b4a7-6c4e475f57ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:21:12.855418 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1201/2398] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:21:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:21:12.857616 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07afb73-3c70-4c9a-83a5-a5068aaf15c4 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:12.857907 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07afb73-3c70-4c9a-83a5-a5068aaf15c4 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:12.858184 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07afb73-3c70-4c9a-83a5-a5068aaf15c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:12.878938 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-c07afb73-3c70-4c9a-83a5-a5068aaf15c4 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:21:12.881411 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-c07afb73-3c70-4c9a-83a5-a5068aaf15c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:21:12.891000 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1198/2399] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:21:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:21:12.895564 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d517ca-375f-43ba-b4a7-6c4e475f57ce None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:12.906691 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d517ca-375f-43ba-b4a7-6c4e475f57ce None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:12.912059 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983977c5-2c94-4e94-8dbb-83be295c3645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:12.912974 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983977c5-2c94-4e94-8dbb-83be295c3645 admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:12.913327 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983977c5-2c94-4e94-8dbb-83be295c3645 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:12.913656 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983977c5-2c94-4e94-8dbb-83be295c3645 admin admin] PATH_INFO: `/v3/domains` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:12.914452 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983977c5-2c94-4e94-8dbb-83be295c3645 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:21:12.914823 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983977c5-2c94-4e94-8dbb-83be295c3645 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:12.916496 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983977c5-2c94-4e94-8dbb-83be295c3645 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:12.930163 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1202/2400] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Mar 30 07:21:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:21:12.935003 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07afb73-3c70-4c9a-83a5-a5068aaf15c4 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:12.946070 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07afb73-3c70-4c9a-83a5-a5068aaf15c4 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:12.955305 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d985643a-c191-42ce-8e74-5958b513038f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:12.956546 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d985643a-c191-42ce-8e74-5958b513038f admin admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:12.956831 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d985643a-c191-42ce-8e74-5958b513038f admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:12.957106 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d985643a-c191-42ce-8e74-5958b513038f admin admin] PATH_INFO: `/v3/projects` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:12.957811 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d985643a-c191-42ce-8e74-5958b513038f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:12.959718 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d985643a-c191-42ce-8e74-5958b513038f admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:12.989599 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1199/2401] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Mar 30 07:21:12 2022] POST /identity/v3/projects => generated 371 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:21:12.994116 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983977c5-2c94-4e94-8dbb-83be295c3645 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:13.004325 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983977c5-2c94-4e94-8dbb-83be295c3645 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:13.082086 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c0b3f1-5975-4290-bc4d-e4085ce9d5e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:13.082843 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0b3f1-5975-4290-bc4d-e4085ce9d5e5 admin admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:13.083123 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0b3f1-5975-4290-bc4d-e4085ce9d5e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:13.083418 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0b3f1-5975-4290-bc4d-e4085ce9d5e5 admin admin] PATH_INFO: `/v3/users` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:13.084139 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c0b3f1-5975-4290-bc4d-e4085ce9d5e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:13.086259 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c0b3f1-5975-4290-bc4d-e4085ce9d5e5 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:13.115057 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1203/2402] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Mar 30 07:21:12 2022] POST /identity/v3/users => generated 286 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 07:21:13.116517 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d985643a-c191-42ce-8e74-5958b513038f admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:13.129338 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d985643a-c191-42ce-8e74-5958b513038f admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:13.134372 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebff9d0a-18ae-4153-acad-222af6361f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:13.135102 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff9d0a-18ae-4153-acad-222af6361f7c admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:13.135385 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff9d0a-18ae-4153-acad-222af6361f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:13.135657 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff9d0a-18ae-4153-acad-222af6361f7c admin admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:13.136439 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebff9d0a-18ae-4153-acad-222af6361f7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:13.138081 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebff9d0a-18ae-4153-acad-222af6361f7c admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:13.150020 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1200/2403] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:21:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:21:13.154268 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c0b3f1-5975-4290-bc4d-e4085ce9d5e5 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:13.164929 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c0b3f1-5975-4290-bc4d-e4085ce9d5e5 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:13.169625 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847937bb-2a26-452a-a168-8a89613db734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:13.170306 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847937bb-2a26-452a-a168-8a89613db734 admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:13.170578 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847937bb-2a26-452a-a168-8a89613db734 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:13.170851 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847937bb-2a26-452a-a168-8a89613db734 admin admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:13.171609 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847937bb-2a26-452a-a168-8a89613db734 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:13.173251 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847937bb-2a26-452a-a168-8a89613db734 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:13.184401 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1204/2404] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:21:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:21:13.188729 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebff9d0a-18ae-4153-acad-222af6361f7c admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:13.201039 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebff9d0a-18ae-4153-acad-222af6361f7c admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:13.213403 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86255f7d-4fc3-4ec2-9a1a-dd712ae24190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:13.214318 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86255f7d-4fc3-4ec2-9a1a-dd712ae24190 admin admin] REQUEST_METHOD: `PUT` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:13.214604 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86255f7d-4fc3-4ec2-9a1a-dd712ae24190 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:13.214878 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86255f7d-4fc3-4ec2-9a1a-dd712ae24190 admin admin] PATH_INFO: `/v3/projects/022e24ed415942059c3079739406fd3e/users/e6d7d6f65cc849c29a5fa57d35f63173/roles/5d79031a64754b57ba120367465e2252` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:13.235667 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86255f7d-4fc3-4ec2-9a1a-dd712ae24190 admin admin] RBAC: Authorizing `identity:create_grant(project_id=022e24ed415942059c3079739406fd3e, user_id=e6d7d6f65cc849c29a5fa57d35f63173, role_id=5d79031a64754b57ba120367465e2252)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:13.239065 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86255f7d-4fc3-4ec2-9a1a-dd712ae24190 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:13.258400 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1201/2405] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:21:13 2022] PUT /identity/v3/projects/022e24ed415942059c3079739406fd3e/users/e6d7d6f65cc849c29a5fa57d35f63173/roles/5d79031a64754b57ba120367465e2252 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:21:13.269139 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f57aa94-40bb-4d4a-bd89-09105c652b93 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:13.269538 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f57aa94-40bb-4d4a-bd89-09105c652b93 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:13.269824 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f57aa94-40bb-4d4a-bd89-09105c652b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:13.300437 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-7f57aa94-40bb-4d4a-bd89-09105c652b93 None None] MFA Rules not processed for user `e6d7d6f65cc849c29a5fa57d35f63173`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:21:13.301936 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-7f57aa94-40bb-4d4a-bd89-09105c652b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:21:13.381864 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1205/2406] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:21:13 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:21:13.396604 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86255f7d-4fc3-4ec2-9a1a-dd712ae24190 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:13.398582 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-86255f7d-4fc3-4ec2-9a1a-dd712ae24190 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:21:13.539146 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86255f7d-4fc3-4ec2-9a1a-dd712ae24190 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:13.552214 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089623a4-a50b-46fb-8e5e-1a132829c89c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72b398c5ed14484d8b7a51fee900597b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:13.552993 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089623a4-a50b-46fb-8e5e-1a132829c89c service nova] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:13.553164 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089623a4-a50b-46fb-8e5e-1a132829c89c service nova] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:13.553442 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089623a4-a50b-46fb-8e5e-1a132829c89c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:13.568539 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089623a4-a50b-46fb-8e5e-1a132829c89c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:13.570215 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089623a4-a50b-46fb-8e5e-1a132829c89c service nova] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:13.583867 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1202/2407] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:21:13 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:21:16.324988 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f57aa94-40bb-4d4a-bd89-09105c652b93 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:16.400140 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f57aa94-40bb-4d4a-bd89-09105c652b93 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:16.404443 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce58dc66-25df-453c-805b-887e62fbc418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:16.405409 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce58dc66-25df-453c-805b-887e62fbc418 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:16.405764 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce58dc66-25df-453c-805b-887e62fbc418 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:16.406156 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce58dc66-25df-453c-805b-887e62fbc418 admin admin] PATH_INFO: `/v3/users/e6d7d6f65cc849c29a5fa57d35f63173` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:16.407471 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce58dc66-25df-453c-805b-887e62fbc418 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6d7d6f65cc849c29a5fa57d35f63173)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:16.409893 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce58dc66-25df-453c-805b-887e62fbc418 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:16.464928 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-ce58dc66-25df-453c-805b-887e62fbc418 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6d7d6f65cc849c29a5fa57d35f63173'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:21:16.465627 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-ce58dc66-25df-453c-805b-887e62fbc418 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6d7d6f65cc849c29a5fa57d35f63173'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:21:16.466311 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-ce58dc66-25df-453c-805b-887e62fbc418 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6d7d6f65cc849c29a5fa57d35f63173'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:21:16.475929 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-ce58dc66-25df-453c-805b-887e62fbc418 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6d7d6f65cc849c29a5fa57d35f63173'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:21:16.484070 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-ce58dc66-25df-453c-805b-887e62fbc418 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6d7d6f65cc849c29a5fa57d35f63173'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:21:16.501757 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1206/2408] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Mar 30 07:21:16 2022] DELETE /identity/v3/users/e6d7d6f65cc849c29a5fa57d35f63173 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:21:16.506415 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094a37a2-f07b-4962-974f-2b5164993b35 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:16.507260 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094a37a2-f07b-4962-974f-2b5164993b35 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:16.507544 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094a37a2-f07b-4962-974f-2b5164993b35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:16.525402 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-094a37a2-f07b-4962-974f-2b5164993b35 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:21:16.526719 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-094a37a2-f07b-4962-974f-2b5164993b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:21:16.594788 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1203/2409] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:21:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 07:21:16.601924 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce58dc66-25df-453c-805b-887e62fbc418 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:16.603857 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-ce58dc66-25df-453c-805b-887e62fbc418 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:21:16.664925 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce58dc66-25df-453c-805b-887e62fbc418 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:16.669490 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463028d6-7f25-4e17-affb-79cd368d40d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3802cb341445f994b9204744060ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:16.670176 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463028d6-7f25-4e17-affb-79cd368d40d9 service neutron] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:16.670459 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463028d6-7f25-4e17-affb-79cd368d40d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:16.670736 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463028d6-7f25-4e17-affb-79cd368d40d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:16.680755 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463028d6-7f25-4e17-affb-79cd368d40d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:16.682223 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463028d6-7f25-4e17-affb-79cd368d40d9 service neutron] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:16.694292 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1207/2410] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:21:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:21:17.004811 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094a37a2-f07b-4962-974f-2b5164993b35 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:17.006268 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-094a37a2-f07b-4962-974f-2b5164993b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:21:17.018702 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094a37a2-f07b-4962-974f-2b5164993b35 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:17.023979 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa8d03b-9b76-4762-8428-b588e588db2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:17.025105 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8d03b-9b76-4762-8428-b588e588db2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:17.025454 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8d03b-9b76-4762-8428-b588e588db2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:17.025816 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8d03b-9b76-4762-8428-b588e588db2b admin admin] PATH_INFO: `/v3/projects/022e24ed415942059c3079739406fd3e` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:17.027145 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa8d03b-9b76-4762-8428-b588e588db2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=022e24ed415942059c3079739406fd3e)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:17.029310 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa8d03b-9b76-4762-8428-b588e588db2b admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:17.081730 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-3aa8d03b-9b76-4762-8428-b588e588db2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '022e24ed415942059c3079739406fd3e', 'request_id': 'req-3aa8d03b-9b76-4762-8428-b588e588db2b'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:21:17.091534 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-3aa8d03b-9b76-4762-8428-b588e588db2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '022e24ed415942059c3079739406fd3e', 'request_id': 'req-3aa8d03b-9b76-4762-8428-b588e588db2b'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:21:17.098511 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-3aa8d03b-9b76-4762-8428-b588e588db2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '022e24ed415942059c3079739406fd3e', 'request_id': 'req-3aa8d03b-9b76-4762-8428-b588e588db2b'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:21:17.111968 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-3aa8d03b-9b76-4762-8428-b588e588db2b admin admin] The token cache is being invalidate because project 022e24ed415942059c3079739406fd3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79960) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 07:21:17.112329 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-3aa8d03b-9b76-4762-8428-b588e588db2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:21:17.113085 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-3aa8d03b-9b76-4762-8428-b588e588db2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:21:17.114771 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1204/2411] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Mar 30 07:21:17 2022] DELETE /identity/v3/projects/022e24ed415942059c3079739406fd3e => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:21:17.119651 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdb7e7a-f7cb-4f53-bfe9-7b737a64e396 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:17.119970 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdb7e7a-f7cb-4f53-bfe9-7b737a64e396 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:17.120245 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdb7e7a-f7cb-4f53-bfe9-7b737a64e396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:17.140243 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-9fdb7e7a-f7cb-4f53-bfe9-7b737a64e396 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:21:17.141422 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-9fdb7e7a-f7cb-4f53-bfe9-7b737a64e396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:21:17.201710 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1208/2412] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:21:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:21:17.210198 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaab26a8-c476-4e53-9a38-185ca345596b None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:17.210480 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaab26a8-c476-4e53-9a38-185ca345596b None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:17.210764 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaab26a8-c476-4e53-9a38-185ca345596b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:17.230290 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-eaab26a8-c476-4e53-9a38-185ca345596b None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:21:17.231633 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-eaab26a8-c476-4e53-9a38-185ca345596b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:21:17.239760 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1205/2413] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:21:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:21:17.244168 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdb7e7a-f7cb-4f53-bfe9-7b737a64e396 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:17.254600 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdb7e7a-f7cb-4f53-bfe9-7b737a64e396 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:17.260001 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25f3919-a29f-493a-a564-622d11e44695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:17.260665 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25f3919-a29f-493a-a564-622d11e44695 admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:17.260942 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25f3919-a29f-493a-a564-622d11e44695 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:17.261210 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25f3919-a29f-493a-a564-622d11e44695 admin admin] PATH_INFO: `/v3/domains` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:17.261931 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25f3919-a29f-493a-a564-622d11e44695 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:21:17.262238 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25f3919-a29f-493a-a564-622d11e44695 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:17.263903 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25f3919-a29f-493a-a564-622d11e44695 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:17.275769 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1209/2414] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Mar 30 07:21:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:21:17.280223 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaab26a8-c476-4e53-9a38-185ca345596b None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:17.289436 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaab26a8-c476-4e53-9a38-185ca345596b None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:17.294546 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f284d9-eb5d-4bc4-b864-7df8214d2684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:17.295186 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f284d9-eb5d-4bc4-b864-7df8214d2684 admin admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:17.295464 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f284d9-eb5d-4bc4-b864-7df8214d2684 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:17.295728 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f284d9-eb5d-4bc4-b864-7df8214d2684 admin admin] PATH_INFO: `/v3/projects` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:17.296445 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f284d9-eb5d-4bc4-b864-7df8214d2684 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:17.298333 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f284d9-eb5d-4bc4-b864-7df8214d2684 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:17.327609 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1206/2415] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Mar 30 07:21:17 2022] POST /identity/v3/projects => generated 387 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 07:21:17.332747 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25f3919-a29f-493a-a564-622d11e44695 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:17.348107 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25f3919-a29f-493a-a564-622d11e44695 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:17.405926 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c138113-220c-40c5-a1e3-9c185b2f58d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:17.406586 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c138113-220c-40c5-a1e3-9c185b2f58d7 admin admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:17.406864 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c138113-220c-40c5-a1e3-9c185b2f58d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:17.407134 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c138113-220c-40c5-a1e3-9c185b2f58d7 admin admin] PATH_INFO: `/v3/users` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:17.407795 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c138113-220c-40c5-a1e3-9c185b2f58d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:17.409879 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c138113-220c-40c5-a1e3-9c185b2f58d7 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:17.436632 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1210/2416] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Mar 30 07:21:17 2022] POST /identity/v3/users => generated 294 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:21:17.443102 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f284d9-eb5d-4bc4-b864-7df8214d2684 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:17.455829 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f284d9-eb5d-4bc4-b864-7df8214d2684 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:17.462827 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72d31b0-669a-4233-8cc9-6b6d513127ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:17.463719 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72d31b0-669a-4233-8cc9-6b6d513127ce admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:17.464114 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72d31b0-669a-4233-8cc9-6b6d513127ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:17.464505 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72d31b0-669a-4233-8cc9-6b6d513127ce admin admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:17.465559 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72d31b0-669a-4233-8cc9-6b6d513127ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:17.468143 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72d31b0-669a-4233-8cc9-6b6d513127ce admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:17.480087 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1207/2417] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:21:17 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:21:17.484132 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c138113-220c-40c5-a1e3-9c185b2f58d7 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:17.494261 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c138113-220c-40c5-a1e3-9c185b2f58d7 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:17.500061 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2456466f-a86d-4b94-ade7-cf885147e09a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:17.500718 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2456466f-a86d-4b94-ade7-cf885147e09a admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:17.500993 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2456466f-a86d-4b94-ade7-cf885147e09a admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:17.501263 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2456466f-a86d-4b94-ade7-cf885147e09a admin admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:17.502006 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2456466f-a86d-4b94-ade7-cf885147e09a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:17.503652 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2456466f-a86d-4b94-ade7-cf885147e09a admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:17.514294 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1211/2418] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:21:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:21:17.518619 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72d31b0-669a-4233-8cc9-6b6d513127ce admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:17.530791 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72d31b0-669a-4233-8cc9-6b6d513127ce admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:17.539373 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9209f571-59e2-477f-bb3d-0c13a4681877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:17.540285 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9209f571-59e2-477f-bb3d-0c13a4681877 admin admin] REQUEST_METHOD: `PUT` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:17.540536 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9209f571-59e2-477f-bb3d-0c13a4681877 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:17.540837 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9209f571-59e2-477f-bb3d-0c13a4681877 admin admin] PATH_INFO: `/v3/projects/2a6820b14238463aabc2a16c92da1acc/users/48e9f48c51c947c786fb2b9ff78e49ef/roles/5d79031a64754b57ba120367465e2252` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:17.557432 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9209f571-59e2-477f-bb3d-0c13a4681877 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a6820b14238463aabc2a16c92da1acc, user_id=48e9f48c51c947c786fb2b9ff78e49ef, role_id=5d79031a64754b57ba120367465e2252)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:17.560159 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9209f571-59e2-477f-bb3d-0c13a4681877 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:17.576160 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1208/2419] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:21:17 2022] PUT /identity/v3/projects/2a6820b14238463aabc2a16c92da1acc/users/48e9f48c51c947c786fb2b9ff78e49ef/roles/5d79031a64754b57ba120367465e2252 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:21:17.593942 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce47d1-86f3-4ff1-b6a4-dc6aa4b363fc None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:17.594228 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce47d1-86f3-4ff1-b6a4-dc6aa4b363fc None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:17.594501 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce47d1-86f3-4ff1-b6a4-dc6aa4b363fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:17.622537 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-93ce47d1-86f3-4ff1-b6a4-dc6aa4b363fc None None] MFA Rules not processed for user `48e9f48c51c947c786fb2b9ff78e49ef`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:21:17.623746 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-93ce47d1-86f3-4ff1-b6a4-dc6aa4b363fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:21:17.688772 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1212/2420] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:21:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:21:17.693920 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9209f571-59e2-477f-bb3d-0c13a4681877 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:17.768237 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9209f571-59e2-477f-bb3d-0c13a4681877 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:17.773381 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8ae663-3830-4215-bfeb-e50686eb9742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:17.774031 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8ae663-3830-4215-bfeb-e50686eb9742 admin admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:17.774307 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8ae663-3830-4215-bfeb-e50686eb9742 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:17.774561 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8ae663-3830-4215-bfeb-e50686eb9742 admin admin] PATH_INFO: `/v3/projects` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:17.775243 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8ae663-3830-4215-bfeb-e50686eb9742 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:17.777201 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8ae663-3830-4215-bfeb-e50686eb9742 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:17.803555 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1209/2421] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Mar 30 07:21:17 2022] POST /identity/v3/projects => generated 385 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:21:17.807930 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ce47d1-86f3-4ff1-b6a4-dc6aa4b363fc None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:17.818856 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ce47d1-86f3-4ff1-b6a4-dc6aa4b363fc None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:17.878259 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea9d145-fdc6-490f-8e77-f0b210561140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:17.879229 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea9d145-fdc6-490f-8e77-f0b210561140 admin admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:17.879529 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea9d145-fdc6-490f-8e77-f0b210561140 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:17.879825 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea9d145-fdc6-490f-8e77-f0b210561140 admin admin] PATH_INFO: `/v3/users` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:17.880544 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea9d145-fdc6-490f-8e77-f0b210561140 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:17.882651 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea9d145-fdc6-490f-8e77-f0b210561140 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:17.904151 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1213/2422] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Mar 30 07:21:17 2022] POST /identity/v3/users => generated 299 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:21:17.908411 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8ae663-3830-4215-bfeb-e50686eb9742 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:17.918604 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8ae663-3830-4215-bfeb-e50686eb9742 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:17.923575 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766d6509-9699-46aa-8d5c-eb37c5507954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:17.924323 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d6509-9699-46aa-8d5c-eb37c5507954 admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:17.924607 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d6509-9699-46aa-8d5c-eb37c5507954 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:17.924868 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d6509-9699-46aa-8d5c-eb37c5507954 admin admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:17.925669 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766d6509-9699-46aa-8d5c-eb37c5507954 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:17.927287 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766d6509-9699-46aa-8d5c-eb37c5507954 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:17.938625 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1210/2423] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:21:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:21:17.943186 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea9d145-fdc6-490f-8e77-f0b210561140 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:17.956725 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea9d145-fdc6-490f-8e77-f0b210561140 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:17.962266 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7222f0fb-786d-4b29-b6ec-5d6306549bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:17.963221 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7222f0fb-786d-4b29-b6ec-5d6306549bc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:17.963503 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7222f0fb-786d-4b29-b6ec-5d6306549bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:17.963770 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7222f0fb-786d-4b29-b6ec-5d6306549bc3 admin admin] PATH_INFO: `/v3/projects/1405fc7b32ac4f6eb8b342e06b46c217/users/7339ad2469da46f3bba9ada62cb14417/roles/1c39b9ab8cfd4c0ea71845831920a845` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:17.981135 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7222f0fb-786d-4b29-b6ec-5d6306549bc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1405fc7b32ac4f6eb8b342e06b46c217, user_id=7339ad2469da46f3bba9ada62cb14417, role_id=1c39b9ab8cfd4c0ea71845831920a845)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:17.983788 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7222f0fb-786d-4b29-b6ec-5d6306549bc3 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:17.997918 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1214/2424] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:21:17 2022] PUT /identity/v3/projects/1405fc7b32ac4f6eb8b342e06b46c217/users/7339ad2469da46f3bba9ada62cb14417/roles/1c39b9ab8cfd4c0ea71845831920a845 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 07:21:18.002015 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766d6509-9699-46aa-8d5c-eb37c5507954 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:18.012223 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766d6509-9699-46aa-8d5c-eb37c5507954 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:18.069655 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2372db-6a35-4db3-b5d7-ce0f4a2cb23b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:18.070335 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2372db-6a35-4db3-b5d7-ce0f4a2cb23b admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:18.070658 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2372db-6a35-4db3-b5d7-ce0f4a2cb23b admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:18.070905 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2372db-6a35-4db3-b5d7-ce0f4a2cb23b admin admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:18.071634 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2372db-6a35-4db3-b5d7-ce0f4a2cb23b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:18.073259 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2372db-6a35-4db3-b5d7-ce0f4a2cb23b admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:18.086898 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1211/2425] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:21:18 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:21:18.088121 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7222f0fb-786d-4b29-b6ec-5d6306549bc3 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:18.099111 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7222f0fb-786d-4b29-b6ec-5d6306549bc3 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:18.104767 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf8cd79-930f-47aa-b5b8-0fb970866277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:18.105693 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf8cd79-930f-47aa-b5b8-0fb970866277 admin admin] REQUEST_METHOD: `PUT` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:18.105991 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf8cd79-930f-47aa-b5b8-0fb970866277 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:18.106262 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf8cd79-930f-47aa-b5b8-0fb970866277 admin admin] PATH_INFO: `/v3/projects/1405fc7b32ac4f6eb8b342e06b46c217/users/7339ad2469da46f3bba9ada62cb14417/roles/1c39b9ab8cfd4c0ea71845831920a845` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:18.108486 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf8cd79-930f-47aa-b5b8-0fb970866277 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1405fc7b32ac4f6eb8b342e06b46c217, user_id=7339ad2469da46f3bba9ada62cb14417, role_id=1c39b9ab8cfd4c0ea71845831920a845)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:18.111153 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf8cd79-930f-47aa-b5b8-0fb970866277 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:18.122870 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1215/2426] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:21:18 2022] PUT /identity/v3/projects/1405fc7b32ac4f6eb8b342e06b46c217/users/7339ad2469da46f3bba9ada62cb14417/roles/1c39b9ab8cfd4c0ea71845831920a845 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:21:18.133484 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676258e6-c69e-43e0-bccc-46f5d7eb1134 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:18.133742 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676258e6-c69e-43e0-bccc-46f5d7eb1134 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:18.134015 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676258e6-c69e-43e0-bccc-46f5d7eb1134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:18.160821 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-676258e6-c69e-43e0-bccc-46f5d7eb1134 None None] MFA Rules not processed for user `7339ad2469da46f3bba9ada62cb14417`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:21:18.162176 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-676258e6-c69e-43e0-bccc-46f5d7eb1134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:21:18.231259 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1212/2427] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:21:18 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:21:18.242935 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf8cd79-930f-47aa-b5b8-0fb970866277 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:18.245093 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-3bf8cd79-930f-47aa-b5b8-0fb970866277 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:21:18.302809 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf8cd79-930f-47aa-b5b8-0fb970866277 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:18.306654 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71d8ed8-4257-4812-a20c-c8d76f009fe8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e2fda180e8d448d895c40cdad34bc4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:18.307332 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71d8ed8-4257-4812-a20c-c8d76f009fe8 service cinder] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:18.307611 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71d8ed8-4257-4812-a20c-c8d76f009fe8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:18.307908 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71d8ed8-4257-4812-a20c-c8d76f009fe8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:18.317248 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71d8ed8-4257-4812-a20c-c8d76f009fe8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:18.318799 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71d8ed8-4257-4812-a20c-c8d76f009fe8 service cinder] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:18.328526 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1216/2428] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:21:18 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:21:18.356144 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676258e6-c69e-43e0-bccc-46f5d7eb1134 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:18.418157 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676258e6-c69e-43e0-bccc-46f5d7eb1134 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:18.422716 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589f5e2a-1061-4e1f-a2c2-0ee8c2a5e1ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:18.423574 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f5e2a-1061-4e1f-a2c2-0ee8c2a5e1ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:18.423882 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f5e2a-1061-4e1f-a2c2-0ee8c2a5e1ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:18.424162 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f5e2a-1061-4e1f-a2c2-0ee8c2a5e1ef admin admin] PATH_INFO: `/v3/users/48e9f48c51c947c786fb2b9ff78e49ef` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:18.425469 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589f5e2a-1061-4e1f-a2c2-0ee8c2a5e1ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=48e9f48c51c947c786fb2b9ff78e49ef)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:18.427465 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589f5e2a-1061-4e1f-a2c2-0ee8c2a5e1ef admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:18.474053 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-589f5e2a-1061-4e1f-a2c2-0ee8c2a5e1ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48e9f48c51c947c786fb2b9ff78e49ef'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:21:18.474800 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-589f5e2a-1061-4e1f-a2c2-0ee8c2a5e1ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48e9f48c51c947c786fb2b9ff78e49ef'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:21:18.483223 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-589f5e2a-1061-4e1f-a2c2-0ee8c2a5e1ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48e9f48c51c947c786fb2b9ff78e49ef'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:21:18.494755 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-589f5e2a-1061-4e1f-a2c2-0ee8c2a5e1ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48e9f48c51c947c786fb2b9ff78e49ef'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:21:18.495391 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-589f5e2a-1061-4e1f-a2c2-0ee8c2a5e1ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48e9f48c51c947c786fb2b9ff78e49ef'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:21:18.507139 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1213/2429] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Mar 30 07:21:18 2022] DELETE /identity/v3/users/48e9f48c51c947c786fb2b9ff78e49ef => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:21:18.511844 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd8bd2-3349-4e67-bff8-c744e319e9ab None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:18.512370 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd8bd2-3349-4e67-bff8-c744e319e9ab None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:18.512370 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd8bd2-3349-4e67-bff8-c744e319e9ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:18.532007 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-24fd8bd2-3349-4e67-bff8-c744e319e9ab None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:21:18.533225 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-24fd8bd2-3349-4e67-bff8-c744e319e9ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:21:18.599962 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1217/2430] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:21:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:21:18.610203 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589f5e2a-1061-4e1f-a2c2-0ee8c2a5e1ef admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:18.611735 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-589f5e2a-1061-4e1f-a2c2-0ee8c2a5e1ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:21:18.670717 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589f5e2a-1061-4e1f-a2c2-0ee8c2a5e1ef admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:18.675195 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9008bf-2188-4c29-82a3-c022fdc65b07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3802cb341445f994b9204744060ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:18.675875 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9008bf-2188-4c29-82a3-c022fdc65b07 service neutron] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:18.676159 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9008bf-2188-4c29-82a3-c022fdc65b07 service neutron] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:18.676430 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9008bf-2188-4c29-82a3-c022fdc65b07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:18.685541 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9008bf-2188-4c29-82a3-c022fdc65b07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:18.686978 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9008bf-2188-4c29-82a3-c022fdc65b07 service neutron] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:18.696865 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1214/2431] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:21:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:21:18.969332 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fd8bd2-3349-4e67-bff8-c744e319e9ab None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:18.970929 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-24fd8bd2-3349-4e67-bff8-c744e319e9ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:21:18.983155 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fd8bd2-3349-4e67-bff8-c744e319e9ab None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:18.988044 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fee2d0-95f7-4bfe-ab77-91e646cd9a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:18.988913 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fee2d0-95f7-4bfe-ab77-91e646cd9a17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:18.989184 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fee2d0-95f7-4bfe-ab77-91e646cd9a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:18.989453 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fee2d0-95f7-4bfe-ab77-91e646cd9a17 admin admin] PATH_INFO: `/v3/projects/2a6820b14238463aabc2a16c92da1acc` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:18.990659 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fee2d0-95f7-4bfe-ab77-91e646cd9a17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a6820b14238463aabc2a16c92da1acc)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:18.992630 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fee2d0-95f7-4bfe-ab77-91e646cd9a17 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:19.052714 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-76fee2d0-95f7-4bfe-ab77-91e646cd9a17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a6820b14238463aabc2a16c92da1acc', 'request_id': 'req-76fee2d0-95f7-4bfe-ab77-91e646cd9a17'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:21:19.060265 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-76fee2d0-95f7-4bfe-ab77-91e646cd9a17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a6820b14238463aabc2a16c92da1acc', 'request_id': 'req-76fee2d0-95f7-4bfe-ab77-91e646cd9a17'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:21:19.069090 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-76fee2d0-95f7-4bfe-ab77-91e646cd9a17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a6820b14238463aabc2a16c92da1acc', 'request_id': 'req-76fee2d0-95f7-4bfe-ab77-91e646cd9a17'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:21:19.081575 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-76fee2d0-95f7-4bfe-ab77-91e646cd9a17 admin admin] The token cache is being invalidate because project 2a6820b14238463aabc2a16c92da1acc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79961) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 07:21:19.081862 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-76fee2d0-95f7-4bfe-ab77-91e646cd9a17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:21:19.082577 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-76fee2d0-95f7-4bfe-ab77-91e646cd9a17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:21:19.084283 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1218/2432] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Mar 30 07:21:18 2022] DELETE /identity/v3/projects/2a6820b14238463aabc2a16c92da1acc => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:21:19.088548 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9008bf-2188-4c29-82a3-c022fdc65b07 service neutron] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:19.098603 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9008bf-2188-4c29-82a3-c022fdc65b07 service neutron] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:19.161711 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300bf337-ced9-4c05-908d-b57d929d2550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:19.162518 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300bf337-ced9-4c05-908d-b57d929d2550 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:19.162795 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300bf337-ced9-4c05-908d-b57d929d2550 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:19.163094 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300bf337-ced9-4c05-908d-b57d929d2550 admin admin] PATH_INFO: `/v3/users/7339ad2469da46f3bba9ada62cb14417` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:19.164351 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300bf337-ced9-4c05-908d-b57d929d2550 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7339ad2469da46f3bba9ada62cb14417)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:19.166321 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300bf337-ced9-4c05-908d-b57d929d2550 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:19.233838 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-300bf337-ced9-4c05-908d-b57d929d2550 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7339ad2469da46f3bba9ada62cb14417'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:21:19.234725 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-300bf337-ced9-4c05-908d-b57d929d2550 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7339ad2469da46f3bba9ada62cb14417'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:21:19.245171 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-300bf337-ced9-4c05-908d-b57d929d2550 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7339ad2469da46f3bba9ada62cb14417'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:21:19.259354 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-300bf337-ced9-4c05-908d-b57d929d2550 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7339ad2469da46f3bba9ada62cb14417'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:21:19.260164 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-300bf337-ced9-4c05-908d-b57d929d2550 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7339ad2469da46f3bba9ada62cb14417'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:21:19.274243 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1215/2433] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Mar 30 07:21:19 2022] DELETE /identity/v3/users/7339ad2469da46f3bba9ada62cb14417 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:21:19.612124 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fee2d0-95f7-4bfe-ab77-91e646cd9a17 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:19.616112 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-76fee2d0-95f7-4bfe-ab77-91e646cd9a17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:21:19.628365 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fee2d0-95f7-4bfe-ab77-91e646cd9a17 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:19.692706 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0038e9f4-a8d8-48e4-8b04-a61459d830ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:19.693653 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0038e9f4-a8d8-48e4-8b04-a61459d830ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:19.693929 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0038e9f4-a8d8-48e4-8b04-a61459d830ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:19.694259 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0038e9f4-a8d8-48e4-8b04-a61459d830ef admin admin] PATH_INFO: `/v3/projects/1405fc7b32ac4f6eb8b342e06b46c217` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:19.695660 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0038e9f4-a8d8-48e4-8b04-a61459d830ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=1405fc7b32ac4f6eb8b342e06b46c217)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:19.697803 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0038e9f4-a8d8-48e4-8b04-a61459d830ef admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:19.753654 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-0038e9f4-a8d8-48e4-8b04-a61459d830ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1405fc7b32ac4f6eb8b342e06b46c217', 'request_id': 'req-0038e9f4-a8d8-48e4-8b04-a61459d830ef'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:21:19.759678 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-0038e9f4-a8d8-48e4-8b04-a61459d830ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1405fc7b32ac4f6eb8b342e06b46c217', 'request_id': 'req-0038e9f4-a8d8-48e4-8b04-a61459d830ef'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:21:19.771182 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-0038e9f4-a8d8-48e4-8b04-a61459d830ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1405fc7b32ac4f6eb8b342e06b46c217', 'request_id': 'req-0038e9f4-a8d8-48e4-8b04-a61459d830ef'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:21:19.782670 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-0038e9f4-a8d8-48e4-8b04-a61459d830ef admin admin] The token cache is being invalidate because project 1405fc7b32ac4f6eb8b342e06b46c217 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79961) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 07:21:19.782945 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-0038e9f4-a8d8-48e4-8b04-a61459d830ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:21:19.785233 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-0038e9f4-a8d8-48e4-8b04-a61459d830ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:21:19.787428 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1219/2434] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Mar 30 07:21:19 2022] DELETE /identity/v3/projects/1405fc7b32ac4f6eb8b342e06b46c217 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:21:19.793837 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b54baaa-4f85-4b4d-a959-238b5ecd9117 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:19.794413 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b54baaa-4f85-4b4d-a959-238b5ecd9117 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:19.794413 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b54baaa-4f85-4b4d-a959-238b5ecd9117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:19.816196 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-5b54baaa-4f85-4b4d-a959-238b5ecd9117 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:21:19.817698 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-5b54baaa-4f85-4b4d-a959-238b5ecd9117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:21:19.898949 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1216/2435] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:21:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:21:19.913675 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb8f2cb-c4a2-4d69-ba8d-4015072f99e3 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:19.913952 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb8f2cb-c4a2-4d69-ba8d-4015072f99e3 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:19.914288 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb8f2cb-c4a2-4d69-ba8d-4015072f99e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:19.938338 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-acb8f2cb-c4a2-4d69-ba8d-4015072f99e3 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:21:19.939650 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-acb8f2cb-c4a2-4d69-ba8d-4015072f99e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:21:19.952626 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1220/2436] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:21:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:21:19.957742 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b54baaa-4f85-4b4d-a959-238b5ecd9117 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:19.970633 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b54baaa-4f85-4b4d-a959-238b5ecd9117 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:19.976093 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b015318e-9b31-4c41-922d-0ea2d98c9ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:19.976755 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b015318e-9b31-4c41-922d-0ea2d98c9ba3 admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:19.977052 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b015318e-9b31-4c41-922d-0ea2d98c9ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:19.977282 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b015318e-9b31-4c41-922d-0ea2d98c9ba3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:19.978365 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b015318e-9b31-4c41-922d-0ea2d98c9ba3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:21:19.978663 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b015318e-9b31-4c41-922d-0ea2d98c9ba3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:19.980377 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b015318e-9b31-4c41-922d-0ea2d98c9ba3 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:19.993899 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1217/2437] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Mar 30 07:21:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:21:19.999775 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb8f2cb-c4a2-4d69-ba8d-4015072f99e3 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:20.010073 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb8f2cb-c4a2-4d69-ba8d-4015072f99e3 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:20.018459 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fd83b5-76dc-4583-af2f-127465165837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:20.019517 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fd83b5-76dc-4583-af2f-127465165837 admin admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:20.020037 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fd83b5-76dc-4583-af2f-127465165837 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:20.020471 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fd83b5-76dc-4583-af2f-127465165837 admin admin] PATH_INFO: `/v3/projects` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:20.021539 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fd83b5-76dc-4583-af2f-127465165837 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:20.023738 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fd83b5-76dc-4583-af2f-127465165837 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:20.060904 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1221/2438] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Mar 30 07:21:19 2022] POST /identity/v3/projects => generated 387 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 07:21:20.065419 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b015318e-9b31-4c41-922d-0ea2d98c9ba3 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:20.075865 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b015318e-9b31-4c41-922d-0ea2d98c9ba3 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:20.136272 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dc51bb-80c0-47a6-93f0-b6f28030088f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:20.136958 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc51bb-80c0-47a6-93f0-b6f28030088f admin admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:20.137245 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc51bb-80c0-47a6-93f0-b6f28030088f admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:20.137521 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc51bb-80c0-47a6-93f0-b6f28030088f admin admin] PATH_INFO: `/v3/users` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:20.138226 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dc51bb-80c0-47a6-93f0-b6f28030088f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:20.140222 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dc51bb-80c0-47a6-93f0-b6f28030088f admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:20.163044 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1218/2439] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Mar 30 07:21:20 2022] POST /identity/v3/users => generated 294 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 07:21:20.167618 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fd83b5-76dc-4583-af2f-127465165837 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:20.181369 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fd83b5-76dc-4583-af2f-127465165837 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:20.187773 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5888be1e-d3c4-48b4-a1ab-ff7fd5af5923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:20.188474 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5888be1e-d3c4-48b4-a1ab-ff7fd5af5923 admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:20.188749 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5888be1e-d3c4-48b4-a1ab-ff7fd5af5923 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:20.189013 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5888be1e-d3c4-48b4-a1ab-ff7fd5af5923 admin admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:20.189758 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5888be1e-d3c4-48b4-a1ab-ff7fd5af5923 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:20.191409 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5888be1e-d3c4-48b4-a1ab-ff7fd5af5923 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:20.202704 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1222/2440] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:21:20 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:21:20.206995 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dc51bb-80c0-47a6-93f0-b6f28030088f admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:20.220028 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dc51bb-80c0-47a6-93f0-b6f28030088f admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:20.228318 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4945ce6-9a7d-4bb3-b60c-8fdfa05551f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:20.229004 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4945ce6-9a7d-4bb3-b60c-8fdfa05551f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:20.229279 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4945ce6-9a7d-4bb3-b60c-8fdfa05551f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:20.229561 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4945ce6-9a7d-4bb3-b60c-8fdfa05551f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:20.230271 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4945ce6-9a7d-4bb3-b60c-8fdfa05551f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:20.231913 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4945ce6-9a7d-4bb3-b60c-8fdfa05551f9 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:20.242995 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1219/2441] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:21:20 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:21:20.247464 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5888be1e-d3c4-48b4-a1ab-ff7fd5af5923 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:20.258418 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5888be1e-d3c4-48b4-a1ab-ff7fd5af5923 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:20.263958 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f3debb-5a16-4f8a-9c2a-357940258e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:20.264881 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f3debb-5a16-4f8a-9c2a-357940258e1e admin admin] REQUEST_METHOD: `PUT` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:20.265152 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f3debb-5a16-4f8a-9c2a-357940258e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:20.265429 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f3debb-5a16-4f8a-9c2a-357940258e1e admin admin] PATH_INFO: `/v3/projects/efed6d4ec8e9423ebcc1993940ee10e7/users/b4dda01719094ef68a593644840029d1/roles/5d79031a64754b57ba120367465e2252` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:20.280685 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f3debb-5a16-4f8a-9c2a-357940258e1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=efed6d4ec8e9423ebcc1993940ee10e7, user_id=b4dda01719094ef68a593644840029d1, role_id=5d79031a64754b57ba120367465e2252)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:20.283321 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f3debb-5a16-4f8a-9c2a-357940258e1e admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:20.299301 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1223/2442] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:21:20 2022] PUT /identity/v3/projects/efed6d4ec8e9423ebcc1993940ee10e7/users/b4dda01719094ef68a593644840029d1/roles/5d79031a64754b57ba120367465e2252 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:21:20.309674 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b591291-6bf1-4bb1-8ed3-d03daf7c74dd None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:20.309966 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b591291-6bf1-4bb1-8ed3-d03daf7c74dd None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:20.310241 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b591291-6bf1-4bb1-8ed3-d03daf7c74dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:20.337387 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-6b591291-6bf1-4bb1-8ed3-d03daf7c74dd None None] MFA Rules not processed for user `b4dda01719094ef68a593644840029d1`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:21:20.338583 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-6b591291-6bf1-4bb1-8ed3-d03daf7c74dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:21:20.410217 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1220/2443] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:21:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:21:20.415038 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f3debb-5a16-4f8a-9c2a-357940258e1e admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:20.478281 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f3debb-5a16-4f8a-9c2a-357940258e1e admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:20.484113 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634c72b5-47cf-4908-b840-6df48cbcf868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:20.484765 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c72b5-47cf-4908-b840-6df48cbcf868 admin admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:20.485009 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c72b5-47cf-4908-b840-6df48cbcf868 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:20.485326 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c72b5-47cf-4908-b840-6df48cbcf868 admin admin] PATH_INFO: `/v3/projects` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:20.485950 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634c72b5-47cf-4908-b840-6df48cbcf868 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:20.487906 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634c72b5-47cf-4908-b840-6df48cbcf868 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:20.514662 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1224/2444] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Mar 30 07:21:20 2022] POST /identity/v3/projects => generated 385 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:21:20.518963 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b591291-6bf1-4bb1-8ed3-d03daf7c74dd None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:20.529899 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b591291-6bf1-4bb1-8ed3-d03daf7c74dd None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:20.588573 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db049c77-e722-45cb-9a57-0972694e36b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:20.589457 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db049c77-e722-45cb-9a57-0972694e36b0 admin admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:20.589828 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db049c77-e722-45cb-9a57-0972694e36b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:20.590170 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db049c77-e722-45cb-9a57-0972694e36b0 admin admin] PATH_INFO: `/v3/users` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:20.591107 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db049c77-e722-45cb-9a57-0972694e36b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:20.593922 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db049c77-e722-45cb-9a57-0972694e36b0 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:20.620192 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1221/2445] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Mar 30 07:21:20 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 07:21:20.624337 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634c72b5-47cf-4908-b840-6df48cbcf868 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:20.641094 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634c72b5-47cf-4908-b840-6df48cbcf868 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:20.646741 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdeb026-d4bc-4ce7-aec2-37a49b03a17b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:20.647700 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdeb026-d4bc-4ce7-aec2-37a49b03a17b admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:20.648373 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdeb026-d4bc-4ce7-aec2-37a49b03a17b admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:20.648838 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdeb026-d4bc-4ce7-aec2-37a49b03a17b admin admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:20.649680 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdeb026-d4bc-4ce7-aec2-37a49b03a17b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:20.651602 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdeb026-d4bc-4ce7-aec2-37a49b03a17b admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:20.667339 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1225/2446] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:21:20 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:21:20.671843 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db049c77-e722-45cb-9a57-0972694e36b0 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:20.688485 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db049c77-e722-45cb-9a57-0972694e36b0 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:20.699401 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccca7c5b-f103-4333-b46e-b3f09e251e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:20.700293 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca7c5b-f103-4333-b46e-b3f09e251e18 admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:20.700664 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca7c5b-f103-4333-b46e-b3f09e251e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:20.701052 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca7c5b-f103-4333-b46e-b3f09e251e18 admin admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:20.701916 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccca7c5b-f103-4333-b46e-b3f09e251e18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:20.703628 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccca7c5b-f103-4333-b46e-b3f09e251e18 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:20.719962 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1222/2447] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:21:20 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 30 07:21:20.721250 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdeb026-d4bc-4ce7-aec2-37a49b03a17b admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:20.733908 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdeb026-d4bc-4ce7-aec2-37a49b03a17b admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:20.739082 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d65377-ed8f-4ae2-a556-32d265df56f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:20.740024 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d65377-ed8f-4ae2-a556-32d265df56f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:20.740303 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d65377-ed8f-4ae2-a556-32d265df56f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:20.740572 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d65377-ed8f-4ae2-a556-32d265df56f4 admin admin] PATH_INFO: `/v3/projects/f2028bcd15464cac9d5268aecc5011a8/users/c3b2987e4cbf4730815bf6ae2a62b8b4/roles/5d79031a64754b57ba120367465e2252` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:20.761419 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d65377-ed8f-4ae2-a556-32d265df56f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2028bcd15464cac9d5268aecc5011a8, user_id=c3b2987e4cbf4730815bf6ae2a62b8b4, role_id=5d79031a64754b57ba120367465e2252)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:20.764695 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d65377-ed8f-4ae2-a556-32d265df56f4 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:20.787952 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1226/2448] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:21:20 2022] PUT /identity/v3/projects/f2028bcd15464cac9d5268aecc5011a8/users/c3b2987e4cbf4730815bf6ae2a62b8b4/roles/5d79031a64754b57ba120367465e2252 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:21:20.795363 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5c224d-013a-4281-a668-cc9eaa7d9216 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:20.796008 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5c224d-013a-4281-a668-cc9eaa7d9216 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:20.796008 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5c224d-013a-4281-a668-cc9eaa7d9216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:20.826021 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-7a5c224d-013a-4281-a668-cc9eaa7d9216 None None] MFA Rules not processed for user `c3b2987e4cbf4730815bf6ae2a62b8b4`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:21:20.827574 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-7a5c224d-013a-4281-a668-cc9eaa7d9216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:21:20.928283 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1223/2449] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:21:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:21:20.930410 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d65377-ed8f-4ae2-a556-32d265df56f4 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:21.015045 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d65377-ed8f-4ae2-a556-32d265df56f4 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:21.020040 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaaa3b6-0717-4ad5-bac2-e62251817628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:21.020705 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaaa3b6-0717-4ad5-bac2-e62251817628 admin admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:21.020983 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaaa3b6-0717-4ad5-bac2-e62251817628 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:21.021251 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaaa3b6-0717-4ad5-bac2-e62251817628 admin admin] PATH_INFO: `/v3/projects` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:21.021986 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaaa3b6-0717-4ad5-bac2-e62251817628 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:21.023914 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaaa3b6-0717-4ad5-bac2-e62251817628 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:21.048846 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1227/2450] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Mar 30 07:21:20 2022] POST /identity/v3/projects => generated 387 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:21:21.053637 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5c224d-013a-4281-a668-cc9eaa7d9216 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:21.064090 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5c224d-013a-4281-a668-cc9eaa7d9216 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:21.123437 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e730ee30-7ca3-4123-afdd-207810a88f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:21.124277 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e730ee30-7ca3-4123-afdd-207810a88f16 admin admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:21.124612 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e730ee30-7ca3-4123-afdd-207810a88f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:21.124960 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e730ee30-7ca3-4123-afdd-207810a88f16 admin admin] PATH_INFO: `/v3/users` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:21.126155 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e730ee30-7ca3-4123-afdd-207810a88f16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:21.128472 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e730ee30-7ca3-4123-afdd-207810a88f16 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:21.149587 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1224/2451] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Mar 30 07:21:21 2022] POST /identity/v3/users => generated 300 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:21:21.153659 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaaa3b6-0717-4ad5-bac2-e62251817628 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:21.165020 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaaa3b6-0717-4ad5-bac2-e62251817628 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:21.169937 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d1e2fe-9aab-4b53-8207-9a0a3726e7a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:21.170803 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d1e2fe-9aab-4b53-8207-9a0a3726e7a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:21.171081 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d1e2fe-9aab-4b53-8207-9a0a3726e7a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:21.171347 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d1e2fe-9aab-4b53-8207-9a0a3726e7a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:21.172101 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d1e2fe-9aab-4b53-8207-9a0a3726e7a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:21.173749 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d1e2fe-9aab-4b53-8207-9a0a3726e7a9 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:21.185932 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1228/2452] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:21:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:21:21.190310 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e730ee30-7ca3-4123-afdd-207810a88f16 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:21.200295 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e730ee30-7ca3-4123-afdd-207810a88f16 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:21.205771 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99bc533-c18e-45ea-beaf-7498b3ec0948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:21.208869 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99bc533-c18e-45ea-beaf-7498b3ec0948 admin admin] REQUEST_METHOD: `PUT` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:21.209146 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99bc533-c18e-45ea-beaf-7498b3ec0948 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:21.209553 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99bc533-c18e-45ea-beaf-7498b3ec0948 admin admin] PATH_INFO: `/v3/projects/e0dc4c2132434bd5bf66d04cfbc338d9/users/88e7304c665e4280bab5852a5d149347/roles/1c39b9ab8cfd4c0ea71845831920a845` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:21.225664 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99bc533-c18e-45ea-beaf-7498b3ec0948 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0dc4c2132434bd5bf66d04cfbc338d9, user_id=88e7304c665e4280bab5852a5d149347, role_id=1c39b9ab8cfd4c0ea71845831920a845)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:21.229050 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99bc533-c18e-45ea-beaf-7498b3ec0948 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:21.241654 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1225/2453] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:21:21 2022] PUT /identity/v3/projects/e0dc4c2132434bd5bf66d04cfbc338d9/users/88e7304c665e4280bab5852a5d149347/roles/1c39b9ab8cfd4c0ea71845831920a845 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:21:21.245636 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d1e2fe-9aab-4b53-8207-9a0a3726e7a9 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:21.255161 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d1e2fe-9aab-4b53-8207-9a0a3726e7a9 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:21.310339 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a3b9fa-8902-42db-a125-910a4a66b36c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:21.311014 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a3b9fa-8902-42db-a125-910a4a66b36c admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:21.311294 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a3b9fa-8902-42db-a125-910a4a66b36c admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:21.311568 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a3b9fa-8902-42db-a125-910a4a66b36c admin admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:21.312362 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a3b9fa-8902-42db-a125-910a4a66b36c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:21.313960 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a3b9fa-8902-42db-a125-910a4a66b36c admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:21.323889 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1229/2454] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:21:21 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:21:21.327955 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99bc533-c18e-45ea-beaf-7498b3ec0948 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:21.338603 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99bc533-c18e-45ea-beaf-7498b3ec0948 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:21.343619 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa34744-9ce1-475b-a46a-b2b4f53b8529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:21.344550 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa34744-9ce1-475b-a46a-b2b4f53b8529 admin admin] REQUEST_METHOD: `PUT` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:21.344833 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa34744-9ce1-475b-a46a-b2b4f53b8529 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:21.345104 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa34744-9ce1-475b-a46a-b2b4f53b8529 admin admin] PATH_INFO: `/v3/projects/e0dc4c2132434bd5bf66d04cfbc338d9/users/88e7304c665e4280bab5852a5d149347/roles/1c39b9ab8cfd4c0ea71845831920a845` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:21.347343 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa34744-9ce1-475b-a46a-b2b4f53b8529 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0dc4c2132434bd5bf66d04cfbc338d9, user_id=88e7304c665e4280bab5852a5d149347, role_id=1c39b9ab8cfd4c0ea71845831920a845)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:21.350142 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa34744-9ce1-475b-a46a-b2b4f53b8529 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:21.361521 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1226/2455] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:21:21 2022] PUT /identity/v3/projects/e0dc4c2132434bd5bf66d04cfbc338d9/users/88e7304c665e4280bab5852a5d149347/roles/1c39b9ab8cfd4c0ea71845831920a845 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:21:21.372925 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3d1f66-d642-41b6-b7c8-bf937dda3caa None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:21.373285 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3d1f66-d642-41b6-b7c8-bf937dda3caa None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:21.373566 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3d1f66-d642-41b6-b7c8-bf937dda3caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:21.401707 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-fc3d1f66-d642-41b6-b7c8-bf937dda3caa None None] MFA Rules not processed for user `88e7304c665e4280bab5852a5d149347`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:21:21.402910 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-fc3d1f66-d642-41b6-b7c8-bf937dda3caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:21:21.470727 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1230/2456] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:21:21 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:21:21.482141 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa34744-9ce1-475b-a46a-b2b4f53b8529 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:21.484232 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-8aa34744-9ce1-475b-a46a-b2b4f53b8529 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:21:21.554475 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa34744-9ce1-475b-a46a-b2b4f53b8529 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:21.558960 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10645dcf-e04c-4130-bb1c-cefffe2bea4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e2fda180e8d448d895c40cdad34bc4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:21.559608 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10645dcf-e04c-4130-bb1c-cefffe2bea4f service cinder] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:21.559919 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10645dcf-e04c-4130-bb1c-cefffe2bea4f service cinder] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:21.560191 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10645dcf-e04c-4130-bb1c-cefffe2bea4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:21.570440 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10645dcf-e04c-4130-bb1c-cefffe2bea4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:21.572171 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10645dcf-e04c-4130-bb1c-cefffe2bea4f service cinder] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:21.582376 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1227/2457] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:21:21 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:21:21.986516 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e904fa5e-4f6b-4b90-a5cd-76e2d800c870 None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:21.986516 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e904fa5e-4f6b-4b90-a5cd-76e2d800c870 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:21.986516 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e904fa5e-4f6b-4b90-a5cd-76e2d800c870 None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:21.988357 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1231/2458] 10.222.0.20 () {54 vars in 921 bytes} [Wed Mar 30 07:21:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:21:21.998853 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21331e54-990e-4c4c-ab8b-1bfbd559ec0d None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:21.999412 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21331e54-990e-4c4c-ab8b-1bfbd559ec0d None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:21.999412 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21331e54-990e-4c4c-ab8b-1bfbd559ec0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:22.043462 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-21331e54-990e-4c4c-ab8b-1bfbd559ec0d None None] MFA Rules not processed for user `72b398c5ed14484d8b7a51fee900597b`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:21:22.044825 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-21331e54-990e-4c4c-ab8b-1bfbd559ec0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:21:22.122263 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e904fa5e-4f6b-4b90-a5cd-76e2d800c870 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:22.125627 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-e904fa5e-4f6b-4b90-a5cd-76e2d800c870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:21:22.139944 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1228/2459] 10.222.0.20 () {58 vars in 1018 bytes} [Wed Mar 30 07:21:21 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:21:22.150471 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e904fa5e-4f6b-4b90-a5cd-76e2d800c870 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:22.153518 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21331e54-990e-4c4c-ab8b-1bfbd559ec0d None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:22.154887 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcec8d4-0855-4c50-a242-c045ca4a4316 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e2fda180e8d448d895c40cdad34bc4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:22.155157 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-21331e54-990e-4c4c-ab8b-1bfbd559ec0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:21:22.155560 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcec8d4-0855-4c50-a242-c045ca4a4316 service cinder] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:22.155861 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcec8d4-0855-4c50-a242-c045ca4a4316 service cinder] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:22.156127 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcec8d4-0855-4c50-a242-c045ca4a4316 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:22.231608 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21331e54-990e-4c4c-ab8b-1bfbd559ec0d None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:22.232238 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcec8d4-0855-4c50-a242-c045ca4a4316 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:22.234298 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcec8d4-0855-4c50-a242-c045ca4a4316 service cinder] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:22.236258 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5255fb-7100-4eda-9ee3-963fdaabf85f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e880ade912f3412abf44ba73939d6e50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:22.237170 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5255fb-7100-4eda-9ee3-963fdaabf85f service glance] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:22.237590 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5255fb-7100-4eda-9ee3-963fdaabf85f service glance] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:22.237983 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5255fb-7100-4eda-9ee3-963fdaabf85f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:22.251506 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5255fb-7100-4eda-9ee3-963fdaabf85f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:22.253412 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5255fb-7100-4eda-9ee3-963fdaabf85f service glance] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:22.259527 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1232/2460] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:21:22 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 30 07:21:22.268503 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1229/2461] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:21:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 30 07:21:22.375264 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8fbe0d-91e7-4a52-8aca-c71a5e2a613e None None] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:22.375689 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8fbe0d-91e7-4a52-8aca-c71a5e2a613e None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:22.375904 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8fbe0d-91e7-4a52-8aca-c71a5e2a613e None None] PATH_INFO: `/` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:22.381243 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1233/2462] 10.222.0.20 () {54 vars in 921 bytes} [Wed Mar 30 07:21:22 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:21:22.387764 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b4fed0-825b-4395-a298-fb510a999504 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:22.388085 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b4fed0-825b-4395-a298-fb510a999504 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:22.388369 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b4fed0-825b-4395-a298-fb510a999504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:22.406936 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-26b4fed0-825b-4395-a298-fb510a999504 None None] MFA Rules not processed for user `54f3802cb341445f994b9204744060ae`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:21:22.408229 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-26b4fed0-825b-4395-a298-fb510a999504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:21:22.475957 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1230/2463] 10.222.0.20 () {58 vars in 1018 bytes} [Wed Mar 30 07:21:22 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:21:22.489564 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8fbe0d-91e7-4a52-8aca-c71a5e2a613e None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:22.491376 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-5e8fbe0d-91e7-4a52-8aca-c71a5e2a613e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:21:22.507116 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8fbe0d-91e7-4a52-8aca-c71a5e2a613e None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:22.511717 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cc9ba4-9511-4ba3-8c64-ac821e07a203 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3802cb341445f994b9204744060ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:22.512417 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cc9ba4-9511-4ba3-8c64-ac821e07a203 service neutron] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:22.512692 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cc9ba4-9511-4ba3-8c64-ac821e07a203 service neutron] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:22.512961 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cc9ba4-9511-4ba3-8c64-ac821e07a203 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:22.520471 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cc9ba4-9511-4ba3-8c64-ac821e07a203 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:22.522078 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cc9ba4-9511-4ba3-8c64-ac821e07a203 service neutron] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:22.530436 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1234/2464] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:21:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:21:22.633340 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c63a02-92bc-4717-8d6c-77203bd5f272 None None] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:22.633631 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c63a02-92bc-4717-8d6c-77203bd5f272 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:22.633913 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c63a02-92bc-4717-8d6c-77203bd5f272 None None] PATH_INFO: `/` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:22.635953 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1231/2465] 10.222.0.20 () {54 vars in 921 bytes} [Wed Mar 30 07:21:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 30 07:21:22.641866 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfad387-e84f-4a6a-872c-759fa40932b7 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:22.642163 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfad387-e84f-4a6a-872c-759fa40932b7 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:22.642500 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfad387-e84f-4a6a-872c-759fa40932b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:22.661091 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-2dfad387-e84f-4a6a-872c-759fa40932b7 None None] MFA Rules not processed for user `72b398c5ed14484d8b7a51fee900597b`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:21:22.662320 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-2dfad387-e84f-4a6a-872c-759fa40932b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:21:22.671696 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1235/2466] 10.222.0.20 () {58 vars in 1018 bytes} [Wed Mar 30 07:21:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 07:21:22.684498 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c63a02-92bc-4717-8d6c-77203bd5f272 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:22.705105 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c63a02-92bc-4717-8d6c-77203bd5f272 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:22.709226 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8375b85d-bc30-4a6d-b62b-825b3bd8198f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3802cb341445f994b9204744060ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:22.709871 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8375b85d-bc30-4a6d-b62b-825b3bd8198f service neutron] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:22.710147 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8375b85d-bc30-4a6d-b62b-825b3bd8198f service neutron] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:22.710396 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8375b85d-bc30-4a6d-b62b-825b3bd8198f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:22.721359 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8375b85d-bc30-4a6d-b62b-825b3bd8198f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:22.723078 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8375b85d-bc30-4a6d-b62b-825b3bd8198f service neutron] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:22.733878 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1232/2467] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:21:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:21:22.802232 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfad387-e84f-4a6a-872c-759fa40932b7 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:22.803858 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-2dfad387-e84f-4a6a-872c-759fa40932b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:21:22.886778 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfad387-e84f-4a6a-872c-759fa40932b7 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:22.892619 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2638983b-440f-455e-bbce-7860bd0386cd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd634743546e8456fac2f6ab1aaee09ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:22.893279 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2638983b-440f-455e-bbce-7860bd0386cd service placement] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:22.893559 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2638983b-440f-455e-bbce-7860bd0386cd service placement] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:22.893958 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2638983b-440f-455e-bbce-7860bd0386cd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:22.897228 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-2638983b-440f-455e-bbce-7860bd0386cd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:21:22.909956 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2638983b-440f-455e-bbce-7860bd0386cd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:22.911585 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2638983b-440f-455e-bbce-7860bd0386cd service placement] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:22.921868 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1236/2468] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:21:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 30 07:21:24.653990 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1e73a1-f336-4f13-adcc-ec10466301cf None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:24.654490 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1e73a1-f336-4f13-adcc-ec10466301cf None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:24.654490 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1e73a1-f336-4f13-adcc-ec10466301cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:24.676522 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-1a1e73a1-f336-4f13-adcc-ec10466301cf None None] MFA Rules not processed for user `67102c1adcf0491e9ecdef970ab2d5ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:21:24.677782 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-1a1e73a1-f336-4f13-adcc-ec10466301cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:21:24.736805 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1233/2469] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Mar 30 07:21:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:21:24.749523 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2638983b-440f-455e-bbce-7860bd0386cd service placement] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:24.750994 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-2638983b-440f-455e-bbce-7860bd0386cd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:21:24.820667 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2638983b-440f-455e-bbce-7860bd0386cd service placement] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:24.825899 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d497382-0741-4143-941f-afdbb60fd36e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c452249c502d4b0688e8dd068f8c4951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:24.826550 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d497382-0741-4143-941f-afdbb60fd36e service swift] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:24.826886 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d497382-0741-4143-941f-afdbb60fd36e service swift] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:24.827091 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d497382-0741-4143-941f-afdbb60fd36e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:24.835791 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d497382-0741-4143-941f-afdbb60fd36e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:24.837408 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d497382-0741-4143-941f-afdbb60fd36e service swift] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:24.845563 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1237/2470] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Mar 30 07:21:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 30 07:21:26.480046 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1e73a1-f336-4f13-adcc-ec10466301cf None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:26.490149 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1e73a1-f336-4f13-adcc-ec10466301cf None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:26.493882 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc929cd-bbae-4a23-a161-02c4da884305 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e2fda180e8d448d895c40cdad34bc4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:26.494540 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc929cd-bbae-4a23-a161-02c4da884305 service cinder] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:26.494820 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc929cd-bbae-4a23-a161-02c4da884305 service cinder] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:26.495093 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc929cd-bbae-4a23-a161-02c4da884305 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:26.557027 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc929cd-bbae-4a23-a161-02c4da884305 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:26.558510 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc929cd-bbae-4a23-a161-02c4da884305 service cinder] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:26.568032 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1234/2471] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:21:26 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:21:28.878021 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d497382-0741-4143-941f-afdbb60fd36e service swift] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:28.950787 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d497382-0741-4143-941f-afdbb60fd36e service swift] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:28.956398 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b12e329-93a4-4ba4-8742-70f67d92a245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:28.957663 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b12e329-93a4-4ba4-8742-70f67d92a245 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:28.957947 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b12e329-93a4-4ba4-8742-70f67d92a245 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:28.958223 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b12e329-93a4-4ba4-8742-70f67d92a245 admin admin] PATH_INFO: `/v3/users/b4dda01719094ef68a593644840029d1` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:28.959605 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b12e329-93a4-4ba4-8742-70f67d92a245 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4dda01719094ef68a593644840029d1)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:28.961766 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b12e329-93a4-4ba4-8742-70f67d92a245 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:29.025833 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-7b12e329-93a4-4ba4-8742-70f67d92a245 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4dda01719094ef68a593644840029d1'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:21:29.026737 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-7b12e329-93a4-4ba4-8742-70f67d92a245 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4dda01719094ef68a593644840029d1'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:21:29.027641 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-7b12e329-93a4-4ba4-8742-70f67d92a245 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4dda01719094ef68a593644840029d1'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:21:29.036223 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-7b12e329-93a4-4ba4-8742-70f67d92a245 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4dda01719094ef68a593644840029d1'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:21:29.043696 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-7b12e329-93a4-4ba4-8742-70f67d92a245 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4dda01719094ef68a593644840029d1'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:21:29.062897 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1238/2472] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Mar 30 07:21:28 2022] DELETE /identity/v3/users/b4dda01719094ef68a593644840029d1 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:21:29.067478 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5b9eb-689a-4527-9081-b25db6f9132f None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:29.068080 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5b9eb-689a-4527-9081-b25db6f9132f None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:29.068080 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5b9eb-689a-4527-9081-b25db6f9132f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:29.088947 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-07e5b9eb-689a-4527-9081-b25db6f9132f None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:21:29.090309 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-07e5b9eb-689a-4527-9081-b25db6f9132f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:21:29.169526 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1235/2473] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:21:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:21:29.181685 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b12e329-93a4-4ba4-8742-70f67d92a245 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:29.183409 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-7b12e329-93a4-4ba4-8742-70f67d92a245 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:21:29.246952 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b12e329-93a4-4ba4-8742-70f67d92a245 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:29.250939 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81682641-7295-4b3e-b91c-8afbca0e40b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3802cb341445f994b9204744060ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:29.251624 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81682641-7295-4b3e-b91c-8afbca0e40b8 service neutron] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:29.252022 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81682641-7295-4b3e-b91c-8afbca0e40b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:29.252216 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81682641-7295-4b3e-b91c-8afbca0e40b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:29.263063 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81682641-7295-4b3e-b91c-8afbca0e40b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:29.264588 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81682641-7295-4b3e-b91c-8afbca0e40b8 service neutron] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:29.274686 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1239/2474] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:21:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:21:29.693079 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e5b9eb-689a-4527-9081-b25db6f9132f None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:29.695132 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-07e5b9eb-689a-4527-9081-b25db6f9132f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:21:29.710744 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e5b9eb-689a-4527-9081-b25db6f9132f None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:29.730191 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f2a391-05f7-42e7-ba3f-c77f6359acb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:29.731402 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f2a391-05f7-42e7-ba3f-c77f6359acb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:29.731997 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f2a391-05f7-42e7-ba3f-c77f6359acb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:29.732596 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f2a391-05f7-42e7-ba3f-c77f6359acb7 admin admin] PATH_INFO: `/v3/projects/efed6d4ec8e9423ebcc1993940ee10e7` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:29.734995 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f2a391-05f7-42e7-ba3f-c77f6359acb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=efed6d4ec8e9423ebcc1993940ee10e7)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:29.737285 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f2a391-05f7-42e7-ba3f-c77f6359acb7 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:29.790135 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-c0f2a391-05f7-42e7-ba3f-c77f6359acb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efed6d4ec8e9423ebcc1993940ee10e7', 'request_id': 'req-c0f2a391-05f7-42e7-ba3f-c77f6359acb7'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:21:29.811897 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-c0f2a391-05f7-42e7-ba3f-c77f6359acb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efed6d4ec8e9423ebcc1993940ee10e7', 'request_id': 'req-c0f2a391-05f7-42e7-ba3f-c77f6359acb7'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:21:29.818576 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-c0f2a391-05f7-42e7-ba3f-c77f6359acb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efed6d4ec8e9423ebcc1993940ee10e7', 'request_id': 'req-c0f2a391-05f7-42e7-ba3f-c77f6359acb7'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:21:29.831095 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-c0f2a391-05f7-42e7-ba3f-c77f6359acb7 admin admin] The token cache is being invalidate because project efed6d4ec8e9423ebcc1993940ee10e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79960) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 07:21:29.831374 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-c0f2a391-05f7-42e7-ba3f-c77f6359acb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:21:29.832043 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-c0f2a391-05f7-42e7-ba3f-c77f6359acb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:21:29.834187 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1236/2475] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Mar 30 07:21:29 2022] DELETE /identity/v3/projects/efed6d4ec8e9423ebcc1993940ee10e7 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:21:29.838179 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81682641-7295-4b3e-b91c-8afbca0e40b8 service neutron] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:29.848713 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81682641-7295-4b3e-b91c-8afbca0e40b8 service neutron] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:29.911690 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439c4d50-0e44-47fb-a123-9ee4e343438b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:29.912622 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439c4d50-0e44-47fb-a123-9ee4e343438b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:29.913168 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439c4d50-0e44-47fb-a123-9ee4e343438b admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:29.913594 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439c4d50-0e44-47fb-a123-9ee4e343438b admin admin] PATH_INFO: `/v3/users/c3b2987e4cbf4730815bf6ae2a62b8b4` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:29.914987 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439c4d50-0e44-47fb-a123-9ee4e343438b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3b2987e4cbf4730815bf6ae2a62b8b4)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:29.917175 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439c4d50-0e44-47fb-a123-9ee4e343438b admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:29.969724 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-439c4d50-0e44-47fb-a123-9ee4e343438b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3b2987e4cbf4730815bf6ae2a62b8b4'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:21:29.970460 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-439c4d50-0e44-47fb-a123-9ee4e343438b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3b2987e4cbf4730815bf6ae2a62b8b4'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:21:29.971049 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-439c4d50-0e44-47fb-a123-9ee4e343438b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3b2987e4cbf4730815bf6ae2a62b8b4'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:21:29.983251 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-439c4d50-0e44-47fb-a123-9ee4e343438b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3b2987e4cbf4730815bf6ae2a62b8b4'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:21:29.991097 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-439c4d50-0e44-47fb-a123-9ee4e343438b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3b2987e4cbf4730815bf6ae2a62b8b4'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:21:30.007917 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1240/2476] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Mar 30 07:21:29 2022] DELETE /identity/v3/users/c3b2987e4cbf4730815bf6ae2a62b8b4 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 07:21:30.300450 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f2a391-05f7-42e7-ba3f-c77f6359acb7 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:30.302119 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-c0f2a391-05f7-42e7-ba3f-c77f6359acb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:21:30.334734 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f2a391-05f7-42e7-ba3f-c77f6359acb7 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:30.401051 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884a8281-d4b8-43a4-895c-5c9e27813dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:30.402011 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884a8281-d4b8-43a4-895c-5c9e27813dfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:30.402364 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884a8281-d4b8-43a4-895c-5c9e27813dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:30.402706 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884a8281-d4b8-43a4-895c-5c9e27813dfa admin admin] PATH_INFO: `/v3/projects/f2028bcd15464cac9d5268aecc5011a8` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:30.404038 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884a8281-d4b8-43a4-895c-5c9e27813dfa admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2028bcd15464cac9d5268aecc5011a8)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:30.406047 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884a8281-d4b8-43a4-895c-5c9e27813dfa admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:30.462218 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-884a8281-d4b8-43a4-895c-5c9e27813dfa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2028bcd15464cac9d5268aecc5011a8', 'request_id': 'req-884a8281-d4b8-43a4-895c-5c9e27813dfa'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:21:30.471617 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-884a8281-d4b8-43a4-895c-5c9e27813dfa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2028bcd15464cac9d5268aecc5011a8', 'request_id': 'req-884a8281-d4b8-43a4-895c-5c9e27813dfa'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:21:30.478429 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-884a8281-d4b8-43a4-895c-5c9e27813dfa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2028bcd15464cac9d5268aecc5011a8', 'request_id': 'req-884a8281-d4b8-43a4-895c-5c9e27813dfa'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:21:30.492245 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-884a8281-d4b8-43a4-895c-5c9e27813dfa admin admin] The token cache is being invalidate because project f2028bcd15464cac9d5268aecc5011a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79960) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 07:21:30.492534 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-884a8281-d4b8-43a4-895c-5c9e27813dfa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:21:30.493188 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-884a8281-d4b8-43a4-895c-5c9e27813dfa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:21:30.498198 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1237/2477] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Mar 30 07:21:30 2022] DELETE /identity/v3/projects/f2028bcd15464cac9d5268aecc5011a8 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:21:30.499129 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439c4d50-0e44-47fb-a123-9ee4e343438b admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:30.500612 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-439c4d50-0e44-47fb-a123-9ee4e343438b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:21:30.515775 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439c4d50-0e44-47fb-a123-9ee4e343438b admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:30.577311 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1e3959-c8fd-4d5b-821e-d3056c306509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:30.578204 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1e3959-c8fd-4d5b-821e-d3056c306509 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:30.578481 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1e3959-c8fd-4d5b-821e-d3056c306509 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:30.578753 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1e3959-c8fd-4d5b-821e-d3056c306509 admin admin] PATH_INFO: `/v3/users/88e7304c665e4280bab5852a5d149347` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:30.579997 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1e3959-c8fd-4d5b-821e-d3056c306509 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88e7304c665e4280bab5852a5d149347)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:30.582053 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1e3959-c8fd-4d5b-821e-d3056c306509 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:30.637938 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-1f1e3959-c8fd-4d5b-821e-d3056c306509 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88e7304c665e4280bab5852a5d149347'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:21:30.638680 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-1f1e3959-c8fd-4d5b-821e-d3056c306509 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88e7304c665e4280bab5852a5d149347'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:21:30.639840 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-1f1e3959-c8fd-4d5b-821e-d3056c306509 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88e7304c665e4280bab5852a5d149347'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:21:30.649540 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-1f1e3959-c8fd-4d5b-821e-d3056c306509 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88e7304c665e4280bab5852a5d149347'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:21:30.657493 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-1f1e3959-c8fd-4d5b-821e-d3056c306509 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88e7304c665e4280bab5852a5d149347'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:21:30.680566 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1241/2478] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Mar 30 07:21:30 2022] DELETE /identity/v3/users/88e7304c665e4280bab5852a5d149347 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:21:31.089875 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884a8281-d4b8-43a4-895c-5c9e27813dfa admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:31.091549 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-884a8281-d4b8-43a4-895c-5c9e27813dfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:21:31.105996 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884a8281-d4b8-43a4-895c-5c9e27813dfa admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:31.189947 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc0fb3b-ce0b-423d-b535-9a5a31b69ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:31.190726 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc0fb3b-ce0b-423d-b535-9a5a31b69ecf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:31.191005 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc0fb3b-ce0b-423d-b535-9a5a31b69ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:31.191281 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc0fb3b-ce0b-423d-b535-9a5a31b69ecf admin admin] PATH_INFO: `/v3/projects/e0dc4c2132434bd5bf66d04cfbc338d9` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:31.192621 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc0fb3b-ce0b-423d-b535-9a5a31b69ecf admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0dc4c2132434bd5bf66d04cfbc338d9)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:31.194649 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc0fb3b-ce0b-423d-b535-9a5a31b69ecf admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:31.251251 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-4cc0fb3b-ce0b-423d-b535-9a5a31b69ecf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0dc4c2132434bd5bf66d04cfbc338d9', 'request_id': 'req-4cc0fb3b-ce0b-423d-b535-9a5a31b69ecf'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:21:31.260411 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-4cc0fb3b-ce0b-423d-b535-9a5a31b69ecf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0dc4c2132434bd5bf66d04cfbc338d9', 'request_id': 'req-4cc0fb3b-ce0b-423d-b535-9a5a31b69ecf'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:21:31.266392 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-4cc0fb3b-ce0b-423d-b535-9a5a31b69ecf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0dc4c2132434bd5bf66d04cfbc338d9', 'request_id': 'req-4cc0fb3b-ce0b-423d-b535-9a5a31b69ecf'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:21:31.278558 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-4cc0fb3b-ce0b-423d-b535-9a5a31b69ecf admin admin] The token cache is being invalidate because project e0dc4c2132434bd5bf66d04cfbc338d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79960) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 07:21:31.278915 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-4cc0fb3b-ce0b-423d-b535-9a5a31b69ecf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:21:31.279497 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-4cc0fb3b-ce0b-423d-b535-9a5a31b69ecf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:21:31.281131 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1238/2479] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Mar 30 07:21:31 2022] DELETE /identity/v3/projects/e0dc4c2132434bd5bf66d04cfbc338d9 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:21:31.287317 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eaa595-af75-49f8-a2a8-4d737eafb353 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:31.288353 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eaa595-af75-49f8-a2a8-4d737eafb353 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:31.288790 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eaa595-af75-49f8-a2a8-4d737eafb353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:31.308585 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-55eaa595-af75-49f8-a2a8-4d737eafb353 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:21:31.310082 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-55eaa595-af75-49f8-a2a8-4d737eafb353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:21:31.378794 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1242/2480] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:21:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:21:31.387302 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa492cc-6950-47e1-916c-433579b994af None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:31.387911 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa492cc-6950-47e1-916c-433579b994af None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:31.387911 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa492cc-6950-47e1-916c-433579b994af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:31.408241 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-0aa492cc-6950-47e1-916c-433579b994af None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:21:31.409477 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-0aa492cc-6950-47e1-916c-433579b994af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:21:31.418466 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1239/2481] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:21:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:21:31.422986 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eaa595-af75-49f8-a2a8-4d737eafb353 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:31.434162 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eaa595-af75-49f8-a2a8-4d737eafb353 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:31.439230 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82445988-cff4-4871-a80a-e335386bb7eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:31.440235 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82445988-cff4-4871-a80a-e335386bb7eb admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:31.440586 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82445988-cff4-4871-a80a-e335386bb7eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:31.440860 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82445988-cff4-4871-a80a-e335386bb7eb admin admin] PATH_INFO: `/v3/domains` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:31.441626 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82445988-cff4-4871-a80a-e335386bb7eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:21:31.441932 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82445988-cff4-4871-a80a-e335386bb7eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:31.443763 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82445988-cff4-4871-a80a-e335386bb7eb admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:31.456373 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1243/2482] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Mar 30 07:21:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:21:31.461109 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa492cc-6950-47e1-916c-433579b994af None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:31.470977 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa492cc-6950-47e1-916c-433579b994af None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:31.476820 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef82ec13-97f8-4b7d-bbd1-e6984a63ccb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:31.478137 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef82ec13-97f8-4b7d-bbd1-e6984a63ccb3 admin admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:31.478529 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef82ec13-97f8-4b7d-bbd1-e6984a63ccb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:31.478976 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef82ec13-97f8-4b7d-bbd1-e6984a63ccb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:31.479908 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef82ec13-97f8-4b7d-bbd1-e6984a63ccb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:31.482624 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef82ec13-97f8-4b7d-bbd1-e6984a63ccb3 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:31.510592 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1240/2483] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Mar 30 07:21:31 2022] POST /identity/v3/projects => generated 367 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:21:31.514787 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82445988-cff4-4871-a80a-e335386bb7eb admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:31.525688 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82445988-cff4-4871-a80a-e335386bb7eb admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:31.581221 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9808a9f7-584e-4c01-9073-f89c60092407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:31.581892 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9808a9f7-584e-4c01-9073-f89c60092407 admin admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:31.582198 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9808a9f7-584e-4c01-9073-f89c60092407 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:31.582471 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9808a9f7-584e-4c01-9073-f89c60092407 admin admin] PATH_INFO: `/v3/users` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:31.583300 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9808a9f7-584e-4c01-9073-f89c60092407 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:31.585236 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9808a9f7-584e-4c01-9073-f89c60092407 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:31.609298 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1244/2484] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Mar 30 07:21:31 2022] POST /identity/v3/users => generated 284 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 07:21:31.613426 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef82ec13-97f8-4b7d-bbd1-e6984a63ccb3 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:31.624008 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef82ec13-97f8-4b7d-bbd1-e6984a63ccb3 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:31.628781 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107f4cd6-6c6d-4986-9c31-e7b98d581fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:31.629572 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107f4cd6-6c6d-4986-9c31-e7b98d581fbf admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:31.629967 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107f4cd6-6c6d-4986-9c31-e7b98d581fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:31.630245 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107f4cd6-6c6d-4986-9c31-e7b98d581fbf admin admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:31.631060 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107f4cd6-6c6d-4986-9c31-e7b98d581fbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:31.632808 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107f4cd6-6c6d-4986-9c31-e7b98d581fbf admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:31.647675 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1241/2485] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:21:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:21:31.649000 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9808a9f7-584e-4c01-9073-f89c60092407 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:31.663065 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9808a9f7-584e-4c01-9073-f89c60092407 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:31.668587 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43096543-548d-4325-93f1-706310dce016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:31.669273 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43096543-548d-4325-93f1-706310dce016 admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:31.669546 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43096543-548d-4325-93f1-706310dce016 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:31.669810 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43096543-548d-4325-93f1-706310dce016 admin admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:31.670584 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43096543-548d-4325-93f1-706310dce016 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:31.672188 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43096543-548d-4325-93f1-706310dce016 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:31.683909 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1245/2486] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:21:31 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:21:31.688015 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107f4cd6-6c6d-4986-9c31-e7b98d581fbf admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:31.699876 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107f4cd6-6c6d-4986-9c31-e7b98d581fbf admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:31.704725 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6f9f17-6444-417b-8357-6da372225359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:31.705631 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6f9f17-6444-417b-8357-6da372225359 admin admin] REQUEST_METHOD: `PUT` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:31.705916 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6f9f17-6444-417b-8357-6da372225359 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:31.706191 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6f9f17-6444-417b-8357-6da372225359 admin admin] PATH_INFO: `/v3/projects/c8796f7647b74fde9a735fba61c0d3e5/users/6c16babff5a3473b852568e1ef9cff8f/roles/5d79031a64754b57ba120367465e2252` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:31.721955 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6f9f17-6444-417b-8357-6da372225359 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8796f7647b74fde9a735fba61c0d3e5, user_id=6c16babff5a3473b852568e1ef9cff8f, role_id=5d79031a64754b57ba120367465e2252)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:31.725122 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6f9f17-6444-417b-8357-6da372225359 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:31.740123 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1242/2487] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:21:31 2022] PUT /identity/v3/projects/c8796f7647b74fde9a735fba61c0d3e5/users/6c16babff5a3473b852568e1ef9cff8f/roles/5d79031a64754b57ba120367465e2252 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 07:21:31.752528 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02759bed-c008-4408-8ca5-bc9ec5ad9a4d None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:31.752817 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02759bed-c008-4408-8ca5-bc9ec5ad9a4d None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:31.753095 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02759bed-c008-4408-8ca5-bc9ec5ad9a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:31.782393 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-02759bed-c008-4408-8ca5-bc9ec5ad9a4d None None] MFA Rules not processed for user `6c16babff5a3473b852568e1ef9cff8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:21:31.783613 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-02759bed-c008-4408-8ca5-bc9ec5ad9a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:21:31.851537 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1246/2488] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:21:31 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:21:31.856585 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6f9f17-6444-417b-8357-6da372225359 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:31.933591 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6f9f17-6444-417b-8357-6da372225359 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:31.938413 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12f93ed-9ede-4729-bda0-c36c98396824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:31.939120 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f93ed-9ede-4729-bda0-c36c98396824 admin admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:31.939398 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f93ed-9ede-4729-bda0-c36c98396824 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:31.939668 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f93ed-9ede-4729-bda0-c36c98396824 admin admin] PATH_INFO: `/v3/projects` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:31.940531 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12f93ed-9ede-4729-bda0-c36c98396824 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:31.945735 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12f93ed-9ede-4729-bda0-c36c98396824 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:31.994839 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1243/2489] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Mar 30 07:21:31 2022] POST /identity/v3/projects => generated 367 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:21:31.998929 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02759bed-c008-4408-8ca5-bc9ec5ad9a4d None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:32.015467 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02759bed-c008-4408-8ca5-bc9ec5ad9a4d None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:32.085912 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df92ef4-6d80-4b07-abc8-8b4cdf4c676b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:32.085912 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df92ef4-6d80-4b07-abc8-8b4cdf4c676b admin admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:32.085912 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df92ef4-6d80-4b07-abc8-8b4cdf4c676b admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:32.085912 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df92ef4-6d80-4b07-abc8-8b4cdf4c676b admin admin] PATH_INFO: `/v3/users` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:32.086559 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df92ef4-6d80-4b07-abc8-8b4cdf4c676b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:32.088502 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df92ef4-6d80-4b07-abc8-8b4cdf4c676b admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:32.122973 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1247/2490] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Mar 30 07:21:31 2022] POST /identity/v3/users => generated 290 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:21:32.124258 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12f93ed-9ede-4729-bda0-c36c98396824 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:32.142172 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12f93ed-9ede-4729-bda0-c36c98396824 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:32.151621 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f814aa10-5235-4fb3-8fc8-c90e9934aec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:32.155196 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f814aa10-5235-4fb3-8fc8-c90e9934aec4 admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:32.155395 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f814aa10-5235-4fb3-8fc8-c90e9934aec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:32.155675 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f814aa10-5235-4fb3-8fc8-c90e9934aec4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:32.156523 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f814aa10-5235-4fb3-8fc8-c90e9934aec4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:32.158303 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f814aa10-5235-4fb3-8fc8-c90e9934aec4 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:32.182573 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1244/2491] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:21:32 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:21:32.186529 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df92ef4-6d80-4b07-abc8-8b4cdf4c676b admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:32.197058 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df92ef4-6d80-4b07-abc8-8b4cdf4c676b admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:32.201676 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2285d3-c76a-4c04-bd81-14b446d5fae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:32.202572 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2285d3-c76a-4c04-bd81-14b446d5fae1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:32.202856 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2285d3-c76a-4c04-bd81-14b446d5fae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:32.203125 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2285d3-c76a-4c04-bd81-14b446d5fae1 admin admin] PATH_INFO: `/v3/projects/4abd857eb76e494db4f63ab636dda4c7/users/47d8ee7fb8b1460096c18c9c1e1f4d98/roles/1c39b9ab8cfd4c0ea71845831920a845` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:32.222501 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2285d3-c76a-4c04-bd81-14b446d5fae1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4abd857eb76e494db4f63ab636dda4c7, user_id=47d8ee7fb8b1460096c18c9c1e1f4d98, role_id=1c39b9ab8cfd4c0ea71845831920a845)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:32.225755 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2285d3-c76a-4c04-bd81-14b446d5fae1 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:32.244523 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1248/2492] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:21:32 2022] PUT /identity/v3/projects/4abd857eb76e494db4f63ab636dda4c7/users/47d8ee7fb8b1460096c18c9c1e1f4d98/roles/1c39b9ab8cfd4c0ea71845831920a845 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:21:32.248770 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f814aa10-5235-4fb3-8fc8-c90e9934aec4 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:32.260416 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f814aa10-5235-4fb3-8fc8-c90e9934aec4 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:32.320498 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bb1e23-cbe1-464d-b172-72709d61bb52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:32.321484 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb1e23-cbe1-464d-b172-72709d61bb52 admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:32.321925 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb1e23-cbe1-464d-b172-72709d61bb52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:32.322356 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb1e23-cbe1-464d-b172-72709d61bb52 admin admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:32.323242 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bb1e23-cbe1-464d-b172-72709d61bb52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:32.325159 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bb1e23-cbe1-464d-b172-72709d61bb52 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:32.336909 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1245/2493] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:21:32 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:21:32.341403 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2285d3-c76a-4c04-bd81-14b446d5fae1 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:32.353167 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2285d3-c76a-4c04-bd81-14b446d5fae1 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:32.358742 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb405ea-4463-499e-8a83-dfff7718e27e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:32.359727 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb405ea-4463-499e-8a83-dfff7718e27e admin admin] REQUEST_METHOD: `PUT` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:32.360043 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb405ea-4463-499e-8a83-dfff7718e27e admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:32.360317 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb405ea-4463-499e-8a83-dfff7718e27e admin admin] PATH_INFO: `/v3/projects/4abd857eb76e494db4f63ab636dda4c7/users/47d8ee7fb8b1460096c18c9c1e1f4d98/roles/1c39b9ab8cfd4c0ea71845831920a845` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:32.362717 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb405ea-4463-499e-8a83-dfff7718e27e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4abd857eb76e494db4f63ab636dda4c7, user_id=47d8ee7fb8b1460096c18c9c1e1f4d98, role_id=1c39b9ab8cfd4c0ea71845831920a845)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:32.365966 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb405ea-4463-499e-8a83-dfff7718e27e admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:32.377145 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1249/2494] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:21:32 2022] PUT /identity/v3/projects/4abd857eb76e494db4f63ab636dda4c7/users/47d8ee7fb8b1460096c18c9c1e1f4d98/roles/1c39b9ab8cfd4c0ea71845831920a845 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 07:21:32.388374 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4183186-3808-4c85-82fd-9e58197a2109 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:32.388933 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4183186-3808-4c85-82fd-9e58197a2109 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:32.388933 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4183186-3808-4c85-82fd-9e58197a2109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:32.420107 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-e4183186-3808-4c85-82fd-9e58197a2109 None None] MFA Rules not processed for user `47d8ee7fb8b1460096c18c9c1e1f4d98`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:21:32.421544 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-e4183186-3808-4c85-82fd-9e58197a2109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:21:32.493155 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1246/2495] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:21:32 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:21:32.508229 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb405ea-4463-499e-8a83-dfff7718e27e admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:32.510801 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-acb405ea-4463-499e-8a83-dfff7718e27e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:21:32.575709 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb405ea-4463-499e-8a83-dfff7718e27e admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:32.580263 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ad0cc3-a1f7-44e8-a4c8-90bc92723cba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e2fda180e8d448d895c40cdad34bc4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:32.580915 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ad0cc3-a1f7-44e8-a4c8-90bc92723cba service cinder] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:32.581192 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ad0cc3-a1f7-44e8-a4c8-90bc92723cba service cinder] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:32.581462 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ad0cc3-a1f7-44e8-a4c8-90bc92723cba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:32.591277 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ad0cc3-a1f7-44e8-a4c8-90bc92723cba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:32.592761 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ad0cc3-a1f7-44e8-a4c8-90bc92723cba service cinder] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:32.603242 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1250/2496] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:21:32 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:21:32.689035 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4183186-3808-4c85-82fd-9e58197a2109 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:32.699547 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4183186-3808-4c85-82fd-9e58197a2109 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:32.703218 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feb7f76-a9a9-47d5-8481-c2d31982303c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e2fda180e8d448d895c40cdad34bc4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:32.703896 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb7f76-a9a9-47d5-8481-c2d31982303c service cinder] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:32.704181 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb7f76-a9a9-47d5-8481-c2d31982303c service cinder] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:32.704458 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb7f76-a9a9-47d5-8481-c2d31982303c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:32.761987 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feb7f76-a9a9-47d5-8481-c2d31982303c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:32.763346 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feb7f76-a9a9-47d5-8481-c2d31982303c service cinder] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:32.772810 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1247/2497] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:21:32 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:21:37.540221 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ad0cc3-a1f7-44e8-a4c8-90bc92723cba service cinder] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:37.601378 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ad0cc3-a1f7-44e8-a4c8-90bc92723cba service cinder] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:37.607487 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b83a32-6a0c-489a-b7d9-64ee2f1591a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:37.608805 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b83a32-6a0c-489a-b7d9-64ee2f1591a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:37.609183 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b83a32-6a0c-489a-b7d9-64ee2f1591a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:37.609572 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b83a32-6a0c-489a-b7d9-64ee2f1591a9 admin admin] PATH_INFO: `/v3/users/6c16babff5a3473b852568e1ef9cff8f` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:37.611323 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b83a32-6a0c-489a-b7d9-64ee2f1591a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c16babff5a3473b852568e1ef9cff8f)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:37.614551 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b83a32-6a0c-489a-b7d9-64ee2f1591a9 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:37.669673 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-46b83a32-6a0c-489a-b7d9-64ee2f1591a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c16babff5a3473b852568e1ef9cff8f'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:21:37.670342 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-46b83a32-6a0c-489a-b7d9-64ee2f1591a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c16babff5a3473b852568e1ef9cff8f'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:21:37.670991 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-46b83a32-6a0c-489a-b7d9-64ee2f1591a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c16babff5a3473b852568e1ef9cff8f'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:21:37.679473 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-46b83a32-6a0c-489a-b7d9-64ee2f1591a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c16babff5a3473b852568e1ef9cff8f'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:21:37.686544 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-46b83a32-6a0c-489a-b7d9-64ee2f1591a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c16babff5a3473b852568e1ef9cff8f'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:21:37.703714 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1251/2498] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Mar 30 07:21:37 2022] DELETE /identity/v3/users/6c16babff5a3473b852568e1ef9cff8f => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:21:37.708420 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c9c4d-c260-4b87-8e93-289713afc237 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:37.708916 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c9c4d-c260-4b87-8e93-289713afc237 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:37.709011 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c9c4d-c260-4b87-8e93-289713afc237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:37.726918 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-fc6c9c4d-c260-4b87-8e93-289713afc237 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:21:37.728554 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-fc6c9c4d-c260-4b87-8e93-289713afc237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:21:37.803833 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1248/2499] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:21:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:21:37.815057 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b83a32-6a0c-489a-b7d9-64ee2f1591a9 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:37.817422 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-46b83a32-6a0c-489a-b7d9-64ee2f1591a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:21:37.876611 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b83a32-6a0c-489a-b7d9-64ee2f1591a9 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:37.880820 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461ca834-cb62-4ec8-9122-4ff4629468da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3802cb341445f994b9204744060ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:37.881460 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461ca834-cb62-4ec8-9122-4ff4629468da service neutron] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:37.881735 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461ca834-cb62-4ec8-9122-4ff4629468da service neutron] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:37.882004 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461ca834-cb62-4ec8-9122-4ff4629468da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:37.890918 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461ca834-cb62-4ec8-9122-4ff4629468da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:37.892392 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461ca834-cb62-4ec8-9122-4ff4629468da service neutron] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:37.901715 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1252/2500] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:21:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:21:38.224511 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6c9c4d-c260-4b87-8e93-289713afc237 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:38.227190 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-fc6c9c4d-c260-4b87-8e93-289713afc237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:21:38.244202 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6c9c4d-c260-4b87-8e93-289713afc237 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:38.250692 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ebdbbc-1fd9-4eb3-8092-616cde8e240e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:38.252814 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ebdbbc-1fd9-4eb3-8092-616cde8e240e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:38.253265 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ebdbbc-1fd9-4eb3-8092-616cde8e240e admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:38.253674 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ebdbbc-1fd9-4eb3-8092-616cde8e240e admin admin] PATH_INFO: `/v3/projects/c8796f7647b74fde9a735fba61c0d3e5` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:38.256039 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ebdbbc-1fd9-4eb3-8092-616cde8e240e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8796f7647b74fde9a735fba61c0d3e5)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:38.258586 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ebdbbc-1fd9-4eb3-8092-616cde8e240e admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:38.260468 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8787f2-ccfe-4400-b47f-cfe06f09d3e1 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:38.260963 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8787f2-ccfe-4400-b47f-cfe06f09d3e1 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:38.261381 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8787f2-ccfe-4400-b47f-cfe06f09d3e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:38.283696 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-ee8787f2-ccfe-4400-b47f-cfe06f09d3e1 None None] MFA Rules not processed for user `67102c1adcf0491e9ecdef970ab2d5ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:21:38.285569 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-ee8787f2-ccfe-4400-b47f-cfe06f09d3e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:21:38.324163 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-07ebdbbc-1fd9-4eb3-8092-616cde8e240e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8796f7647b74fde9a735fba61c0d3e5', 'request_id': 'req-07ebdbbc-1fd9-4eb3-8092-616cde8e240e'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:21:38.335146 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-07ebdbbc-1fd9-4eb3-8092-616cde8e240e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8796f7647b74fde9a735fba61c0d3e5', 'request_id': 'req-07ebdbbc-1fd9-4eb3-8092-616cde8e240e'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:21:38.345712 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-07ebdbbc-1fd9-4eb3-8092-616cde8e240e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8796f7647b74fde9a735fba61c0d3e5', 'request_id': 'req-07ebdbbc-1fd9-4eb3-8092-616cde8e240e'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:21:38.356960 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1253/2501] 10.222.0.20 () {58 vars in 967 bytes} [Wed Mar 30 07:21:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 07:21:38.366024 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-07ebdbbc-1fd9-4eb3-8092-616cde8e240e admin admin] The token cache is being invalidate because project c8796f7647b74fde9a735fba61c0d3e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79960) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 07:21:38.366577 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-07ebdbbc-1fd9-4eb3-8092-616cde8e240e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:21:38.367267 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-07ebdbbc-1fd9-4eb3-8092-616cde8e240e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:21:38.369498 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1249/2502] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Mar 30 07:21:38 2022] DELETE /identity/v3/projects/c8796f7647b74fde9a735fba61c0d3e5 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:21:38.372625 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8787f2-ccfe-4400-b47f-cfe06f09d3e1 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:38.372625 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-ee8787f2-ccfe-4400-b47f-cfe06f09d3e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:21:38.374148 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ebdbbc-1fd9-4eb3-8092-616cde8e240e admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:38.376609 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-07ebdbbc-1fd9-4eb3-8092-616cde8e240e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:21:38.457776 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8787f2-ccfe-4400-b47f-cfe06f09d3e1 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:38.520752 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdf695d-2d4c-4f52-bd4d-a00059da5873 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c452249c502d4b0688e8dd068f8c4951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:38.521546 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdf695d-2d4c-4f52-bd4d-a00059da5873 service swift] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:38.521829 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdf695d-2d4c-4f52-bd4d-a00059da5873 service swift] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:38.522098 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdf695d-2d4c-4f52-bd4d-a00059da5873 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:38.524156 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-7bdf695d-2d4c-4f52-bd4d-a00059da5873 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:21:38.583667 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ebdbbc-1fd9-4eb3-8092-616cde8e240e admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:38.588173 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdf695d-2d4c-4f52-bd4d-a00059da5873 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:38.588670 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d034a6-f031-4979-b76c-14a17d224fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:38.589286 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d034a6-f031-4979-b76c-14a17d224fde admin admin] REQUEST_METHOD: `DELETE` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:38.589567 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d034a6-f031-4979-b76c-14a17d224fde admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:38.589778 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdf695d-2d4c-4f52-bd4d-a00059da5873 service swift] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:38.589880 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d034a6-f031-4979-b76c-14a17d224fde admin admin] PATH_INFO: `/v3/users/47d8ee7fb8b1460096c18c9c1e1f4d98` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:38.590995 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d034a6-f031-4979-b76c-14a17d224fde admin admin] RBAC: Authorizing `identity:delete_user(user_id=47d8ee7fb8b1460096c18c9c1e1f4d98)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:38.592992 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d034a6-f031-4979-b76c-14a17d224fde admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:38.597725 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1254/2503] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Mar 30 07:21:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Mar 30 07:21:38.641673 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-20d034a6-f031-4979-b76c-14a17d224fde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47d8ee7fb8b1460096c18c9c1e1f4d98'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:21:38.642351 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-20d034a6-f031-4979-b76c-14a17d224fde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47d8ee7fb8b1460096c18c9c1e1f4d98'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:21:38.651294 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-20d034a6-f031-4979-b76c-14a17d224fde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47d8ee7fb8b1460096c18c9c1e1f4d98'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:21:38.663766 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-20d034a6-f031-4979-b76c-14a17d224fde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47d8ee7fb8b1460096c18c9c1e1f4d98'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:21:38.664528 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-20d034a6-f031-4979-b76c-14a17d224fde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47d8ee7fb8b1460096c18c9c1e1f4d98'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:21:38.676780 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1250/2504] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Mar 30 07:21:38 2022] DELETE /identity/v3/users/47d8ee7fb8b1460096c18c9c1e1f4d98 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 07:21:38.953870 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdf695d-2d4c-4f52-bd4d-a00059da5873 service swift] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:38.973235 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdf695d-2d4c-4f52-bd4d-a00059da5873 service swift] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:39.033828 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae54581-1f7f-493a-b9ba-bdf3d1317b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:39.034622 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae54581-1f7f-493a-b9ba-bdf3d1317b21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:39.034900 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae54581-1f7f-493a-b9ba-bdf3d1317b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:39.035169 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae54581-1f7f-493a-b9ba-bdf3d1317b21 admin admin] PATH_INFO: `/v3/projects/4abd857eb76e494db4f63ab636dda4c7` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:39.036525 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae54581-1f7f-493a-b9ba-bdf3d1317b21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4abd857eb76e494db4f63ab636dda4c7)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:39.038450 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae54581-1f7f-493a-b9ba-bdf3d1317b21 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:39.087828 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-5ae54581-1f7f-493a-b9ba-bdf3d1317b21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4abd857eb76e494db4f63ab636dda4c7', 'request_id': 'req-5ae54581-1f7f-493a-b9ba-bdf3d1317b21'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:21:39.092999 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-5ae54581-1f7f-493a-b9ba-bdf3d1317b21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4abd857eb76e494db4f63ab636dda4c7', 'request_id': 'req-5ae54581-1f7f-493a-b9ba-bdf3d1317b21'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:21:39.101173 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-5ae54581-1f7f-493a-b9ba-bdf3d1317b21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4abd857eb76e494db4f63ab636dda4c7', 'request_id': 'req-5ae54581-1f7f-493a-b9ba-bdf3d1317b21'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:21:39.114282 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-5ae54581-1f7f-493a-b9ba-bdf3d1317b21 admin admin] The token cache is being invalidate because project 4abd857eb76e494db4f63ab636dda4c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79961) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 07:21:39.114569 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-5ae54581-1f7f-493a-b9ba-bdf3d1317b21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:21:39.115297 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-5ae54581-1f7f-493a-b9ba-bdf3d1317b21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:21:39.117042 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1255/2505] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Mar 30 07:21:38 2022] DELETE /identity/v3/projects/4abd857eb76e494db4f63ab636dda4c7 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:21:39.121997 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c02d9-1f70-40ea-8a59-177f12f6e445 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:39.122505 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c02d9-1f70-40ea-8a59-177f12f6e445 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:39.122622 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c02d9-1f70-40ea-8a59-177f12f6e445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:39.141665 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-213c02d9-1f70-40ea-8a59-177f12f6e445 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:21:39.142896 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-213c02d9-1f70-40ea-8a59-177f12f6e445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:21:39.203617 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1251/2506] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:21:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:21:39.211923 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85235c2e-79d6-4dcf-abce-fa5312126f97 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:39.212281 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85235c2e-79d6-4dcf-abce-fa5312126f97 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:39.212657 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85235c2e-79d6-4dcf-abce-fa5312126f97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:39.235726 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-85235c2e-79d6-4dcf-abce-fa5312126f97 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:21:39.237052 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-85235c2e-79d6-4dcf-abce-fa5312126f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:21:39.249419 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1256/2507] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:21:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 07:21:39.254049 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213c02d9-1f70-40ea-8a59-177f12f6e445 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:39.263771 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213c02d9-1f70-40ea-8a59-177f12f6e445 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:39.268343 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e009ac2-f0fa-4f92-ab2d-7c323f89aa66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:39.269012 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e009ac2-f0fa-4f92-ab2d-7c323f89aa66 admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:39.269286 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e009ac2-f0fa-4f92-ab2d-7c323f89aa66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:39.269549 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e009ac2-f0fa-4f92-ab2d-7c323f89aa66 admin admin] PATH_INFO: `/v3/domains` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:39.270333 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e009ac2-f0fa-4f92-ab2d-7c323f89aa66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:21:39.270656 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e009ac2-f0fa-4f92-ab2d-7c323f89aa66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:39.272271 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e009ac2-f0fa-4f92-ab2d-7c323f89aa66 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:39.283767 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1252/2508] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Mar 30 07:21:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:21:39.288459 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85235c2e-79d6-4dcf-abce-fa5312126f97 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:39.297519 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85235c2e-79d6-4dcf-abce-fa5312126f97 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:39.302400 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f1c170-1323-4942-944c-554db6e4fdca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:39.303154 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f1c170-1323-4942-944c-554db6e4fdca admin admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:39.303585 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f1c170-1323-4942-944c-554db6e4fdca admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:39.303950 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f1c170-1323-4942-944c-554db6e4fdca admin admin] PATH_INFO: `/v3/projects` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:39.304804 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f1c170-1323-4942-944c-554db6e4fdca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:39.306791 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f1c170-1323-4942-944c-554db6e4fdca admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:39.336682 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1257/2509] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Mar 30 07:21:39 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:21:39.341113 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e009ac2-f0fa-4f92-ab2d-7c323f89aa66 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:39.351539 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e009ac2-f0fa-4f92-ab2d-7c323f89aa66 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:39.407604 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797548c1-82b3-4aee-9b41-f81204e257ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:39.408309 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797548c1-82b3-4aee-9b41-f81204e257ce admin admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:39.408586 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797548c1-82b3-4aee-9b41-f81204e257ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:39.408857 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797548c1-82b3-4aee-9b41-f81204e257ce admin admin] PATH_INFO: `/v3/users` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:39.409556 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797548c1-82b3-4aee-9b41-f81204e257ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:39.411537 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797548c1-82b3-4aee-9b41-f81204e257ce admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:39.433386 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1253/2510] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Mar 30 07:21:39 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:21:39.438048 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f1c170-1323-4942-944c-554db6e4fdca admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:39.449659 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f1c170-1323-4942-944c-554db6e4fdca admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:39.455395 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3646a3-959b-47e3-939e-5d600f6c79e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:39.456358 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3646a3-959b-47e3-939e-5d600f6c79e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:39.456634 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3646a3-959b-47e3-939e-5d600f6c79e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:39.456904 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3646a3-959b-47e3-939e-5d600f6c79e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:39.457775 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3646a3-959b-47e3-939e-5d600f6c79e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:39.459388 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3646a3-959b-47e3-939e-5d600f6c79e5 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:39.470318 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1258/2511] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:21:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:21:39.474860 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797548c1-82b3-4aee-9b41-f81204e257ce admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:39.485983 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797548c1-82b3-4aee-9b41-f81204e257ce admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:39.492078 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fd9624-7c40-413e-a441-f19d492a5cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:39.492772 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd9624-7c40-413e-a441-f19d492a5cc8 admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:39.493074 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd9624-7c40-413e-a441-f19d492a5cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:39.493343 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd9624-7c40-413e-a441-f19d492a5cc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:39.494068 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fd9624-7c40-413e-a441-f19d492a5cc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:39.495704 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fd9624-7c40-413e-a441-f19d492a5cc8 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:39.509790 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1254/2512] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:21:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:21:39.511058 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3646a3-959b-47e3-939e-5d600f6c79e5 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:39.521338 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3646a3-959b-47e3-939e-5d600f6c79e5 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:39.526735 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5282fc8a-9a64-4f5a-bf29-1623d3c948d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:39.527635 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5282fc8a-9a64-4f5a-bf29-1623d3c948d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:39.527932 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5282fc8a-9a64-4f5a-bf29-1623d3c948d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:39.528214 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5282fc8a-9a64-4f5a-bf29-1623d3c948d7 admin admin] PATH_INFO: `/v3/projects/ccdf09410a5d489c8a4e1837956e0290/users/ea7cef9025d742ee83a435e23db79b86/roles/5d79031a64754b57ba120367465e2252` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:39.543688 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5282fc8a-9a64-4f5a-bf29-1623d3c948d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccdf09410a5d489c8a4e1837956e0290, user_id=ea7cef9025d742ee83a435e23db79b86, role_id=5d79031a64754b57ba120367465e2252)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:39.546380 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5282fc8a-9a64-4f5a-bf29-1623d3c948d7 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:39.560457 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1259/2513] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:21:39 2022] PUT /identity/v3/projects/ccdf09410a5d489c8a4e1837956e0290/users/ea7cef9025d742ee83a435e23db79b86/roles/5d79031a64754b57ba120367465e2252 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:21:39.572249 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ae8fd-c401-48c9-9d78-d97b0694cd2d None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:39.572605 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ae8fd-c401-48c9-9d78-d97b0694cd2d None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:39.572881 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ae8fd-c401-48c9-9d78-d97b0694cd2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:39.599708 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-cb0ae8fd-c401-48c9-9d78-d97b0694cd2d None None] MFA Rules not processed for user `ea7cef9025d742ee83a435e23db79b86`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:21:39.601179 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-cb0ae8fd-c401-48c9-9d78-d97b0694cd2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:21:39.673599 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1255/2514] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:21:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:21:39.678945 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5282fc8a-9a64-4f5a-bf29-1623d3c948d7 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:39.747507 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5282fc8a-9a64-4f5a-bf29-1623d3c948d7 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:39.753738 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538d83ba-c01e-4bac-92d8-7040c53fc2d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:39.754376 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d83ba-c01e-4bac-92d8-7040c53fc2d6 admin admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:39.754690 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d83ba-c01e-4bac-92d8-7040c53fc2d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:39.754964 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d83ba-c01e-4bac-92d8-7040c53fc2d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:39.755679 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538d83ba-c01e-4bac-92d8-7040c53fc2d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:39.757646 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538d83ba-c01e-4bac-92d8-7040c53fc2d6 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:39.789744 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1260/2515] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Mar 30 07:21:39 2022] POST /identity/v3/projects => generated 387 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:21:39.794333 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0ae8fd-c401-48c9-9d78-d97b0694cd2d None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:39.805249 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0ae8fd-c401-48c9-9d78-d97b0694cd2d None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:39.868796 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06e440e-c3b3-4db8-bc75-184647018fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:39.869450 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06e440e-c3b3-4db8-bc75-184647018fe4 admin admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:39.869730 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06e440e-c3b3-4db8-bc75-184647018fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:39.870001 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06e440e-c3b3-4db8-bc75-184647018fe4 admin admin] PATH_INFO: `/v3/users` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:39.870675 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06e440e-c3b3-4db8-bc75-184647018fe4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:39.872631 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06e440e-c3b3-4db8-bc75-184647018fe4 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:39.895200 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1256/2516] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Mar 30 07:21:39 2022] POST /identity/v3/users => generated 300 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 07:21:39.899844 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538d83ba-c01e-4bac-92d8-7040c53fc2d6 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:39.914227 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538d83ba-c01e-4bac-92d8-7040c53fc2d6 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:39.919530 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f6e596-c85f-44c3-ba08-dc6cea3766c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:39.920219 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f6e596-c85f-44c3-ba08-dc6cea3766c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:39.920494 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f6e596-c85f-44c3-ba08-dc6cea3766c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:39.920761 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f6e596-c85f-44c3-ba08-dc6cea3766c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:39.921486 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f6e596-c85f-44c3-ba08-dc6cea3766c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:39.923082 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f6e596-c85f-44c3-ba08-dc6cea3766c1 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:39.932957 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1261/2517] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:21:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:21:39.937351 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06e440e-c3b3-4db8-bc75-184647018fe4 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:39.948177 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06e440e-c3b3-4db8-bc75-184647018fe4 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:39.955195 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa971004-90ff-471c-b238-328f6038ca6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:39.956139 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa971004-90ff-471c-b238-328f6038ca6c admin admin] REQUEST_METHOD: `PUT` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:39.956411 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa971004-90ff-471c-b238-328f6038ca6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:39.956676 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa971004-90ff-471c-b238-328f6038ca6c admin admin] PATH_INFO: `/v3/projects/e29e0088f9da4975ab9b9cc678fb7b88/users/903726a1817d4308983c5616a73c9e1b/roles/1c39b9ab8cfd4c0ea71845831920a845` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:39.974727 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa971004-90ff-471c-b238-328f6038ca6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e29e0088f9da4975ab9b9cc678fb7b88, user_id=903726a1817d4308983c5616a73c9e1b, role_id=1c39b9ab8cfd4c0ea71845831920a845)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:39.977423 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa971004-90ff-471c-b238-328f6038ca6c admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:39.994105 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1257/2518] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:21:39 2022] PUT /identity/v3/projects/e29e0088f9da4975ab9b9cc678fb7b88/users/903726a1817d4308983c5616a73c9e1b/roles/1c39b9ab8cfd4c0ea71845831920a845 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:21:39.999715 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f6e596-c85f-44c3-ba08-dc6cea3766c1 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:40.009780 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f6e596-c85f-44c3-ba08-dc6cea3766c1 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:40.065099 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7288d7-7968-468e-9e0c-c4920e61df7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:40.065764 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7288d7-7968-468e-9e0c-c4920e61df7e admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:40.066039 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7288d7-7968-468e-9e0c-c4920e61df7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:40.066305 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7288d7-7968-468e-9e0c-c4920e61df7e admin admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:40.067129 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7288d7-7968-468e-9e0c-c4920e61df7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:40.068872 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7288d7-7968-468e-9e0c-c4920e61df7e admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:40.078956 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1262/2519] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:21:39 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 30 07:21:40.083967 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa971004-90ff-471c-b238-328f6038ca6c admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:40.100343 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa971004-90ff-471c-b238-328f6038ca6c admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:40.106782 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153200c4-9690-4e75-a3d4-8678422e731a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:40.107678 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153200c4-9690-4e75-a3d4-8678422e731a admin admin] REQUEST_METHOD: `PUT` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:40.107992 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153200c4-9690-4e75-a3d4-8678422e731a admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:40.108262 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153200c4-9690-4e75-a3d4-8678422e731a admin admin] PATH_INFO: `/v3/projects/e29e0088f9da4975ab9b9cc678fb7b88/users/903726a1817d4308983c5616a73c9e1b/roles/1c39b9ab8cfd4c0ea71845831920a845` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:40.110601 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153200c4-9690-4e75-a3d4-8678422e731a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e29e0088f9da4975ab9b9cc678fb7b88, user_id=903726a1817d4308983c5616a73c9e1b, role_id=1c39b9ab8cfd4c0ea71845831920a845)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:40.113275 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153200c4-9690-4e75-a3d4-8678422e731a admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:40.125282 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1258/2520] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:21:40 2022] PUT /identity/v3/projects/e29e0088f9da4975ab9b9cc678fb7b88/users/903726a1817d4308983c5616a73c9e1b/roles/1c39b9ab8cfd4c0ea71845831920a845 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:21:40.140234 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b276c7d6-0977-4476-a997-d8f93bbfcecf None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:40.140545 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b276c7d6-0977-4476-a997-d8f93bbfcecf None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:40.140912 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b276c7d6-0977-4476-a997-d8f93bbfcecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:40.169219 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-b276c7d6-0977-4476-a997-d8f93bbfcecf None None] MFA Rules not processed for user `903726a1817d4308983c5616a73c9e1b`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:21:40.170423 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-b276c7d6-0977-4476-a997-d8f93bbfcecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:21:40.237805 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1263/2521] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:21:40 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:21:40.248832 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153200c4-9690-4e75-a3d4-8678422e731a admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:40.251277 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-153200c4-9690-4e75-a3d4-8678422e731a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:21:40.308935 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153200c4-9690-4e75-a3d4-8678422e731a admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:40.313261 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddaa03b-123e-4e5c-adf5-18b83fb2eef3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e2fda180e8d448d895c40cdad34bc4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:40.313904 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddaa03b-123e-4e5c-adf5-18b83fb2eef3 service cinder] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:40.314180 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddaa03b-123e-4e5c-adf5-18b83fb2eef3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:40.314452 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddaa03b-123e-4e5c-adf5-18b83fb2eef3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:40.323541 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddaa03b-123e-4e5c-adf5-18b83fb2eef3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:40.324930 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddaa03b-123e-4e5c-adf5-18b83fb2eef3 service cinder] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:40.334033 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1259/2522] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:21:40 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:21:40.934993 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b276c7d6-0977-4476-a997-d8f93bbfcecf None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:40.996810 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b276c7d6-0977-4476-a997-d8f93bbfcecf None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:41.002172 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558ec44e-6c7b-4b94-b202-074bdc00d9cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:41.003046 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558ec44e-6c7b-4b94-b202-074bdc00d9cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:41.003317 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558ec44e-6c7b-4b94-b202-074bdc00d9cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:41.003598 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558ec44e-6c7b-4b94-b202-074bdc00d9cb admin admin] PATH_INFO: `/v3/users/ea7cef9025d742ee83a435e23db79b86` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:41.005141 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558ec44e-6c7b-4b94-b202-074bdc00d9cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea7cef9025d742ee83a435e23db79b86)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:41.007118 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558ec44e-6c7b-4b94-b202-074bdc00d9cb admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:41.063950 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-558ec44e-6c7b-4b94-b202-074bdc00d9cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea7cef9025d742ee83a435e23db79b86'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:21:41.064557 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-558ec44e-6c7b-4b94-b202-074bdc00d9cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea7cef9025d742ee83a435e23db79b86'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:21:41.065149 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-558ec44e-6c7b-4b94-b202-074bdc00d9cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea7cef9025d742ee83a435e23db79b86'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:21:41.074898 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-558ec44e-6c7b-4b94-b202-074bdc00d9cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea7cef9025d742ee83a435e23db79b86'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:21:41.081802 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-558ec44e-6c7b-4b94-b202-074bdc00d9cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea7cef9025d742ee83a435e23db79b86'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:21:41.098044 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1264/2523] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Mar 30 07:21:40 2022] DELETE /identity/v3/users/ea7cef9025d742ee83a435e23db79b86 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:21:41.103147 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d53a64-6683-4c2e-8401-a3c60951a95f None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:41.103645 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d53a64-6683-4c2e-8401-a3c60951a95f None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:41.103926 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d53a64-6683-4c2e-8401-a3c60951a95f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:41.121545 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-b5d53a64-6683-4c2e-8401-a3c60951a95f None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:21:41.122739 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-b5d53a64-6683-4c2e-8401-a3c60951a95f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:21:41.180827 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1260/2524] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:21:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:21:41.190681 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558ec44e-6c7b-4b94-b202-074bdc00d9cb admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:41.192543 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-558ec44e-6c7b-4b94-b202-074bdc00d9cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:21:41.257225 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558ec44e-6c7b-4b94-b202-074bdc00d9cb admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:41.261377 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e2a8e4-f975-4ef5-a12a-27d8101cc16f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3802cb341445f994b9204744060ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:41.262036 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e2a8e4-f975-4ef5-a12a-27d8101cc16f service neutron] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:41.262334 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e2a8e4-f975-4ef5-a12a-27d8101cc16f service neutron] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:41.262598 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e2a8e4-f975-4ef5-a12a-27d8101cc16f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:41.272089 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e2a8e4-f975-4ef5-a12a-27d8101cc16f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:41.273531 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e2a8e4-f975-4ef5-a12a-27d8101cc16f service neutron] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:41.283016 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1265/2525] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:21:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 30 07:21:41.550240 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d53a64-6683-4c2e-8401-a3c60951a95f None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:41.552029 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-b5d53a64-6683-4c2e-8401-a3c60951a95f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:21:41.563632 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d53a64-6683-4c2e-8401-a3c60951a95f None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:41.568238 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c23da0-adf0-404e-99b7-c2feb4009576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:41.569094 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c23da0-adf0-404e-99b7-c2feb4009576 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:41.569365 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c23da0-adf0-404e-99b7-c2feb4009576 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:41.569619 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c23da0-adf0-404e-99b7-c2feb4009576 admin admin] PATH_INFO: `/v3/projects/ccdf09410a5d489c8a4e1837956e0290` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:41.570767 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c23da0-adf0-404e-99b7-c2feb4009576 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccdf09410a5d489c8a4e1837956e0290)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:41.572696 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c23da0-adf0-404e-99b7-c2feb4009576 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:41.620941 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-b3c23da0-adf0-404e-99b7-c2feb4009576 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccdf09410a5d489c8a4e1837956e0290', 'request_id': 'req-b3c23da0-adf0-404e-99b7-c2feb4009576'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:21:41.628612 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-b3c23da0-adf0-404e-99b7-c2feb4009576 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccdf09410a5d489c8a4e1837956e0290', 'request_id': 'req-b3c23da0-adf0-404e-99b7-c2feb4009576'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:21:41.634223 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-b3c23da0-adf0-404e-99b7-c2feb4009576 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccdf09410a5d489c8a4e1837956e0290', 'request_id': 'req-b3c23da0-adf0-404e-99b7-c2feb4009576'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:21:41.644945 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-b3c23da0-adf0-404e-99b7-c2feb4009576 admin admin] The token cache is being invalidate because project ccdf09410a5d489c8a4e1837956e0290 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79960) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 07:21:41.645269 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-b3c23da0-adf0-404e-99b7-c2feb4009576 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:21:41.645914 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-b3c23da0-adf0-404e-99b7-c2feb4009576 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:21:41.647462 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1261/2526] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Mar 30 07:21:41 2022] DELETE /identity/v3/projects/ccdf09410a5d489c8a4e1837956e0290 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:21:41.651719 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e2a8e4-f975-4ef5-a12a-27d8101cc16f service neutron] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:41.661446 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e2a8e4-f975-4ef5-a12a-27d8101cc16f service neutron] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:41.716691 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78028f6d-2cae-4a15-903b-d0d704aea63c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:41.717560 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78028f6d-2cae-4a15-903b-d0d704aea63c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:41.717835 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78028f6d-2cae-4a15-903b-d0d704aea63c admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:41.718114 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78028f6d-2cae-4a15-903b-d0d704aea63c admin admin] PATH_INFO: `/v3/users/903726a1817d4308983c5616a73c9e1b` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:41.719283 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78028f6d-2cae-4a15-903b-d0d704aea63c admin admin] RBAC: Authorizing `identity:delete_user(user_id=903726a1817d4308983c5616a73c9e1b)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:41.721230 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78028f6d-2cae-4a15-903b-d0d704aea63c admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:41.767315 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-78028f6d-2cae-4a15-903b-d0d704aea63c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '903726a1817d4308983c5616a73c9e1b'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:21:41.767978 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-78028f6d-2cae-4a15-903b-d0d704aea63c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '903726a1817d4308983c5616a73c9e1b'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:21:41.768563 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-78028f6d-2cae-4a15-903b-d0d704aea63c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '903726a1817d4308983c5616a73c9e1b'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:21:41.777588 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-78028f6d-2cae-4a15-903b-d0d704aea63c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '903726a1817d4308983c5616a73c9e1b'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:21:41.784191 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-78028f6d-2cae-4a15-903b-d0d704aea63c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '903726a1817d4308983c5616a73c9e1b'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:21:41.800817 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1266/2527] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Mar 30 07:21:41 2022] DELETE /identity/v3/users/903726a1817d4308983c5616a73c9e1b => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 07:21:42.162794 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c23da0-adf0-404e-99b7-c2feb4009576 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:42.166063 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-b3c23da0-adf0-404e-99b7-c2feb4009576 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:21:42.181975 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c23da0-adf0-404e-99b7-c2feb4009576 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:42.242970 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0763b41e-0cc6-43c1-ae3f-accd78c2a656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:42.243869 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0763b41e-0cc6-43c1-ae3f-accd78c2a656 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:42.244135 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0763b41e-0cc6-43c1-ae3f-accd78c2a656 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:42.244404 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0763b41e-0cc6-43c1-ae3f-accd78c2a656 admin admin] PATH_INFO: `/v3/projects/e29e0088f9da4975ab9b9cc678fb7b88` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:42.245578 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0763b41e-0cc6-43c1-ae3f-accd78c2a656 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e29e0088f9da4975ab9b9cc678fb7b88)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:42.247464 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0763b41e-0cc6-43c1-ae3f-accd78c2a656 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:42.293139 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-0763b41e-0cc6-43c1-ae3f-accd78c2a656 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e29e0088f9da4975ab9b9cc678fb7b88', 'request_id': 'req-0763b41e-0cc6-43c1-ae3f-accd78c2a656'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:21:42.301714 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-0763b41e-0cc6-43c1-ae3f-accd78c2a656 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e29e0088f9da4975ab9b9cc678fb7b88', 'request_id': 'req-0763b41e-0cc6-43c1-ae3f-accd78c2a656'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:21:42.306905 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-0763b41e-0cc6-43c1-ae3f-accd78c2a656 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e29e0088f9da4975ab9b9cc678fb7b88', 'request_id': 'req-0763b41e-0cc6-43c1-ae3f-accd78c2a656'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:21:42.317401 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-0763b41e-0cc6-43c1-ae3f-accd78c2a656 admin admin] The token cache is being invalidate because project e29e0088f9da4975ab9b9cc678fb7b88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79960) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 07:21:42.317685 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-0763b41e-0cc6-43c1-ae3f-accd78c2a656 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:21:42.318342 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-0763b41e-0cc6-43c1-ae3f-accd78c2a656 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:21:42.319912 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1262/2528] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Mar 30 07:21:42 2022] DELETE /identity/v3/projects/e29e0088f9da4975ab9b9cc678fb7b88 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:21:42.325130 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a097cab-1782-44a3-8cc6-80abab9490b9 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:42.325610 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a097cab-1782-44a3-8cc6-80abab9490b9 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:42.325727 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a097cab-1782-44a3-8cc6-80abab9490b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:42.344118 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-8a097cab-1782-44a3-8cc6-80abab9490b9 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:21:42.345326 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-8a097cab-1782-44a3-8cc6-80abab9490b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:21:42.415749 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1267/2529] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:21:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:21:42.424444 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92293186-a457-4aff-bc77-b9971e901da2 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:42.424797 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92293186-a457-4aff-bc77-b9971e901da2 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:42.425154 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92293186-a457-4aff-bc77-b9971e901da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:42.444011 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-92293186-a457-4aff-bc77-b9971e901da2 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:21:42.445224 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-92293186-a457-4aff-bc77-b9971e901da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:21:42.453467 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1263/2530] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:21:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:21:42.457874 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a097cab-1782-44a3-8cc6-80abab9490b9 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:42.467502 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a097cab-1782-44a3-8cc6-80abab9490b9 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:42.472085 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfae2951-063f-4988-96a4-60ba61c8143e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:42.472741 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfae2951-063f-4988-96a4-60ba61c8143e admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:42.473018 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfae2951-063f-4988-96a4-60ba61c8143e admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:42.473322 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfae2951-063f-4988-96a4-60ba61c8143e admin admin] PATH_INFO: `/v3/domains` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:42.474036 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfae2951-063f-4988-96a4-60ba61c8143e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:21:42.474340 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfae2951-063f-4988-96a4-60ba61c8143e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:42.475943 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfae2951-063f-4988-96a4-60ba61c8143e admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:42.487442 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1268/2531] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Mar 30 07:21:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:21:42.492195 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92293186-a457-4aff-bc77-b9971e901da2 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:42.501676 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92293186-a457-4aff-bc77-b9971e901da2 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:42.506979 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5d9dcb-0b1d-48a0-9ca1-1d718fbfccfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:42.507617 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5d9dcb-0b1d-48a0-9ca1-1d718fbfccfd admin admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:42.507934 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5d9dcb-0b1d-48a0-9ca1-1d718fbfccfd admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:42.508208 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5d9dcb-0b1d-48a0-9ca1-1d718fbfccfd admin admin] PATH_INFO: `/v3/projects` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:42.508914 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5d9dcb-0b1d-48a0-9ca1-1d718fbfccfd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:42.510888 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5d9dcb-0b1d-48a0-9ca1-1d718fbfccfd admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:42.538802 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1264/2532] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Mar 30 07:21:42 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:21:42.545486 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfae2951-063f-4988-96a4-60ba61c8143e admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:42.556722 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfae2951-063f-4988-96a4-60ba61c8143e admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:42.620767 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38454243-436d-4ae9-9edf-b229929f7ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:42.621439 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38454243-436d-4ae9-9edf-b229929f7ead admin admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:42.621725 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38454243-436d-4ae9-9edf-b229929f7ead admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:42.622002 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38454243-436d-4ae9-9edf-b229929f7ead admin admin] PATH_INFO: `/v3/users` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:42.622708 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38454243-436d-4ae9-9edf-b229929f7ead admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:42.624680 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38454243-436d-4ae9-9edf-b229929f7ead admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:42.645983 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1269/2533] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Mar 30 07:21:42 2022] POST /identity/v3/users => generated 286 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:21:42.650478 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5d9dcb-0b1d-48a0-9ca1-1d718fbfccfd admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:42.661164 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5d9dcb-0b1d-48a0-9ca1-1d718fbfccfd admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:42.666094 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5bfdd8-d84a-4687-a37c-96a20190cfaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:42.666754 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5bfdd8-d84a-4687-a37c-96a20190cfaa admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:42.667037 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5bfdd8-d84a-4687-a37c-96a20190cfaa admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:42.667312 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5bfdd8-d84a-4687-a37c-96a20190cfaa admin admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:42.668075 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5bfdd8-d84a-4687-a37c-96a20190cfaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:42.669654 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5bfdd8-d84a-4687-a37c-96a20190cfaa admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:42.681039 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1265/2534] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:21:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:21:42.686027 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38454243-436d-4ae9-9edf-b229929f7ead admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:42.699399 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38454243-436d-4ae9-9edf-b229929f7ead admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:42.705597 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f1a4c8-9cbf-4ccc-89f4-f39b6c36af08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:42.706273 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f1a4c8-9cbf-4ccc-89f4-f39b6c36af08 admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:42.706548 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f1a4c8-9cbf-4ccc-89f4-f39b6c36af08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:42.706823 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f1a4c8-9cbf-4ccc-89f4-f39b6c36af08 admin admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:42.707667 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f1a4c8-9cbf-4ccc-89f4-f39b6c36af08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:42.709327 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f1a4c8-9cbf-4ccc-89f4-f39b6c36af08 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:42.720072 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1270/2535] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:21:42 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:21:42.724574 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5bfdd8-d84a-4687-a37c-96a20190cfaa admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:42.735199 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5bfdd8-d84a-4687-a37c-96a20190cfaa admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:42.741044 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e3045c-6d92-4161-a4e0-2d9828f77684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:42.741919 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e3045c-6d92-4161-a4e0-2d9828f77684 admin admin] REQUEST_METHOD: `PUT` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:42.742196 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e3045c-6d92-4161-a4e0-2d9828f77684 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:42.742488 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e3045c-6d92-4161-a4e0-2d9828f77684 admin admin] PATH_INFO: `/v3/projects/02d063de803e4291a15e100679d943b8/users/285aadd9fb344fc792430f71d34ac03b/roles/5d79031a64754b57ba120367465e2252` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:42.756808 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e3045c-6d92-4161-a4e0-2d9828f77684 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02d063de803e4291a15e100679d943b8, user_id=285aadd9fb344fc792430f71d34ac03b, role_id=5d79031a64754b57ba120367465e2252)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:42.759407 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e3045c-6d92-4161-a4e0-2d9828f77684 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:42.774155 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1266/2536] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:21:42 2022] PUT /identity/v3/projects/02d063de803e4291a15e100679d943b8/users/285aadd9fb344fc792430f71d34ac03b/roles/5d79031a64754b57ba120367465e2252 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:21:42.779310 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e75e32a-7fdc-4bf8-8b28-fa26cf8f5347 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:42.779618 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e75e32a-7fdc-4bf8-8b28-fa26cf8f5347 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:42.779938 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e75e32a-7fdc-4bf8-8b28-fa26cf8f5347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:42.800804 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-6e75e32a-7fdc-4bf8-8b28-fa26cf8f5347 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:21:42.802320 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-6e75e32a-7fdc-4bf8-8b28-fa26cf8f5347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:21:42.871440 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1271/2537] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:21:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:21:42.883625 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e3045c-6d92-4161-a4e0-2d9828f77684 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:42.886840 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-a5e3045c-6d92-4161-a4e0-2d9828f77684 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:21:42.958661 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e3045c-6d92-4161-a4e0-2d9828f77684 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:42.963199 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd606fd-6ace-4863-bbcf-e87522160129 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3802cb341445f994b9204744060ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:42.963904 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd606fd-6ace-4863-bbcf-e87522160129 service neutron] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:42.964192 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd606fd-6ace-4863-bbcf-e87522160129 service neutron] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:42.964454 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd606fd-6ace-4863-bbcf-e87522160129 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:42.974969 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd606fd-6ace-4863-bbcf-e87522160129 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:42.976461 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd606fd-6ace-4863-bbcf-e87522160129 service neutron] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:42.986625 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1267/2538] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:21:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:21:43.633752 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76844456-9e3b-4495-b66d-2fa6aa4b52a2 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:43.634601 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76844456-9e3b-4495-b66d-2fa6aa4b52a2 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:43.634878 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76844456-9e3b-4495-b66d-2fa6aa4b52a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:43.661153 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-76844456-9e3b-4495-b66d-2fa6aa4b52a2 None None] MFA Rules not processed for user `285aadd9fb344fc792430f71d34ac03b`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:21:43.662707 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-76844456-9e3b-4495-b66d-2fa6aa4b52a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:21:43.734629 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1272/2539] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:21:43 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:21:43.739586 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd606fd-6ace-4863-bbcf-e87522160129 service neutron] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:43.751346 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd606fd-6ace-4863-bbcf-e87522160129 service neutron] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:43.756225 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e75e394-f809-4a23-b7ad-f469874f808f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:43.756878 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e75e394-f809-4a23-b7ad-f469874f808f admin admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:43.757337 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e75e394-f809-4a23-b7ad-f469874f808f admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:43.757605 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e75e394-f809-4a23-b7ad-f469874f808f admin admin] PATH_INFO: `/v3/projects` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:43.758315 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e75e394-f809-4a23-b7ad-f469874f808f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:43.760243 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e75e394-f809-4a23-b7ad-f469874f808f admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:43.804796 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1268/2540] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Mar 30 07:21:43 2022] POST /identity/v3/projects => generated 373 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 07:21:43.809140 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76844456-9e3b-4495-b66d-2fa6aa4b52a2 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:43.823183 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76844456-9e3b-4495-b66d-2fa6aa4b52a2 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:43.878443 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ab6e49-806c-4834-a1bf-88d9fe642b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:43.879118 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab6e49-806c-4834-a1bf-88d9fe642b8d admin admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:43.879397 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab6e49-806c-4834-a1bf-88d9fe642b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:43.879666 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab6e49-806c-4834-a1bf-88d9fe642b8d admin admin] PATH_INFO: `/v3/users` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:43.880412 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ab6e49-806c-4834-a1bf-88d9fe642b8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:43.882684 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ab6e49-806c-4834-a1bf-88d9fe642b8d admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:43.903613 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1273/2541] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Mar 30 07:21:43 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 07:21:43.907757 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e75e394-f809-4a23-b7ad-f469874f808f admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:43.918433 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e75e394-f809-4a23-b7ad-f469874f808f admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:43.922956 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec68c79-8121-430f-afa9-6c93ac0741c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:43.923645 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec68c79-8121-430f-afa9-6c93ac0741c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:43.923976 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec68c79-8121-430f-afa9-6c93ac0741c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:43.924256 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec68c79-8121-430f-afa9-6c93ac0741c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:43.924982 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec68c79-8121-430f-afa9-6c93ac0741c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:43.926576 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec68c79-8121-430f-afa9-6c93ac0741c9 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:43.937610 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1269/2542] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:21:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 30 07:21:43.941562 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ab6e49-806c-4834-a1bf-88d9fe642b8d admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:43.952577 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ab6e49-806c-4834-a1bf-88d9fe642b8d admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:43.958660 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302495b7-85d8-46e9-98ef-ec5c4765f5d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:43.959756 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302495b7-85d8-46e9-98ef-ec5c4765f5d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:43.960191 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302495b7-85d8-46e9-98ef-ec5c4765f5d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:43.960555 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302495b7-85d8-46e9-98ef-ec5c4765f5d5 admin admin] PATH_INFO: `/v3/projects/c5e7b4bea04b4adfb33e8627ee209d4a/users/076d16c77e704aa98d441b10d2abbde5/roles/1c39b9ab8cfd4c0ea71845831920a845` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:43.977034 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302495b7-85d8-46e9-98ef-ec5c4765f5d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5e7b4bea04b4adfb33e8627ee209d4a, user_id=076d16c77e704aa98d441b10d2abbde5, role_id=1c39b9ab8cfd4c0ea71845831920a845)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:43.980232 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302495b7-85d8-46e9-98ef-ec5c4765f5d5 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:43.996442 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1274/2543] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:21:43 2022] PUT /identity/v3/projects/c5e7b4bea04b4adfb33e8627ee209d4a/users/076d16c77e704aa98d441b10d2abbde5/roles/1c39b9ab8cfd4c0ea71845831920a845 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:21:44.000264 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec68c79-8121-430f-afa9-6c93ac0741c9 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:44.011243 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec68c79-8121-430f-afa9-6c93ac0741c9 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:44.065883 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ace98d-81bd-4af7-bfa8-4afbd3fd156d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:44.066554 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ace98d-81bd-4af7-bfa8-4afbd3fd156d admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:44.066831 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ace98d-81bd-4af7-bfa8-4afbd3fd156d admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:44.067104 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ace98d-81bd-4af7-bfa8-4afbd3fd156d admin admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:44.067829 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ace98d-81bd-4af7-bfa8-4afbd3fd156d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:44.069571 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ace98d-81bd-4af7-bfa8-4afbd3fd156d admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:44.079327 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1270/2544] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:21:43 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:21:44.083718 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302495b7-85d8-46e9-98ef-ec5c4765f5d5 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:44.094775 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302495b7-85d8-46e9-98ef-ec5c4765f5d5 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:44.100128 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6422db22-16d1-4223-b519-ef5e23756f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:44.101039 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6422db22-16d1-4223-b519-ef5e23756f2c admin admin] REQUEST_METHOD: `PUT` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:44.101312 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6422db22-16d1-4223-b519-ef5e23756f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:44.101582 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6422db22-16d1-4223-b519-ef5e23756f2c admin admin] PATH_INFO: `/v3/projects/c5e7b4bea04b4adfb33e8627ee209d4a/users/076d16c77e704aa98d441b10d2abbde5/roles/1c39b9ab8cfd4c0ea71845831920a845` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:44.103942 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6422db22-16d1-4223-b519-ef5e23756f2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5e7b4bea04b4adfb33e8627ee209d4a, user_id=076d16c77e704aa98d441b10d2abbde5, role_id=1c39b9ab8cfd4c0ea71845831920a845)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:44.106595 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6422db22-16d1-4223-b519-ef5e23756f2c admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:44.119890 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1275/2545] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:21:44 2022] PUT /identity/v3/projects/c5e7b4bea04b4adfb33e8627ee209d4a/users/076d16c77e704aa98d441b10d2abbde5/roles/1c39b9ab8cfd4c0ea71845831920a845 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:21:44.818969 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd51436-5eab-4e08-8493-c58b6428efe5 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:44.819523 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd51436-5eab-4e08-8493-c58b6428efe5 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:44.819523 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd51436-5eab-4e08-8493-c58b6428efe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:44.850213 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-9bd51436-5eab-4e08-8493-c58b6428efe5 None None] MFA Rules not processed for user `076d16c77e704aa98d441b10d2abbde5`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:21:44.851743 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-9bd51436-5eab-4e08-8493-c58b6428efe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:21:44.931490 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1271/2546] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:21:44 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:21:44.943238 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6422db22-16d1-4223-b519-ef5e23756f2c admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:44.944930 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-6422db22-16d1-4223-b519-ef5e23756f2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:21:45.005047 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6422db22-16d1-4223-b519-ef5e23756f2c admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:45.009835 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c408342-4a94-4b17-8456-e04805a8ce6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e2fda180e8d448d895c40cdad34bc4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:45.010438 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c408342-4a94-4b17-8456-e04805a8ce6e service cinder] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:45.010707 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c408342-4a94-4b17-8456-e04805a8ce6e service cinder] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:45.010974 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c408342-4a94-4b17-8456-e04805a8ce6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:45.077382 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c408342-4a94-4b17-8456-e04805a8ce6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:45.078893 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c408342-4a94-4b17-8456-e04805a8ce6e service cinder] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:45.088892 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1276/2547] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:21:44 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:21:46.471982 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd51436-5eab-4e08-8493-c58b6428efe5 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:46.473441 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-9bd51436-5eab-4e08-8493-c58b6428efe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:21:46.487178 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd51436-5eab-4e08-8493-c58b6428efe5 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:46.491893 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a517b4-c0dd-4a00-bcb5-3528f386b31a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e2fda180e8d448d895c40cdad34bc4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:46.492731 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a517b4-c0dd-4a00-bcb5-3528f386b31a service cinder] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:46.493155 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a517b4-c0dd-4a00-bcb5-3528f386b31a service cinder] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:46.493461 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a517b4-c0dd-4a00-bcb5-3528f386b31a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:46.503263 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a517b4-c0dd-4a00-bcb5-3528f386b31a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:46.504766 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a517b4-c0dd-4a00-bcb5-3528f386b31a service cinder] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:46.515368 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1272/2548] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:21:46 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:21:50.497496 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c408342-4a94-4b17-8456-e04805a8ce6e service cinder] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:50.499757 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-6c408342-4a94-4b17-8456-e04805a8ce6e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:21:50.586314 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c408342-4a94-4b17-8456-e04805a8ce6e service cinder] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:50.593503 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1613ad0-974f-4b1b-9daa-1921b75f9cf9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72b398c5ed14484d8b7a51fee900597b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:50.594509 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1613ad0-974f-4b1b-9daa-1921b75f9cf9 service nova] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:50.594958 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1613ad0-974f-4b1b-9daa-1921b75f9cf9 service nova] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:50.595322 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1613ad0-974f-4b1b-9daa-1921b75f9cf9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:50.597763 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-c1613ad0-974f-4b1b-9daa-1921b75f9cf9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:21:50.618973 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1613ad0-974f-4b1b-9daa-1921b75f9cf9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:50.621101 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1613ad0-974f-4b1b-9daa-1921b75f9cf9 service nova] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:50.639912 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1277/2549] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:21:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:21:51.963349 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a517b4-c0dd-4a00-bcb5-3528f386b31a service cinder] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:51.964851 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-b9a517b4-c0dd-4a00-bcb5-3528f386b31a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:21:52.027095 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a517b4-c0dd-4a00-bcb5-3528f386b31a service cinder] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:52.033127 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c2c2fb-0940-4548-ab14-dc609bdc4a60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3802cb341445f994b9204744060ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:52.033791 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c2c2fb-0940-4548-ab14-dc609bdc4a60 service neutron] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:52.034084 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c2c2fb-0940-4548-ab14-dc609bdc4a60 service neutron] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:52.034343 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c2c2fb-0940-4548-ab14-dc609bdc4a60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:52.036171 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-f3c2c2fb-0940-4548-ab14-dc609bdc4a60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:21:52.046954 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c2c2fb-0940-4548-ab14-dc609bdc4a60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:52.048423 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c2c2fb-0940-4548-ab14-dc609bdc4a60 service neutron] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:52.056895 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1273/2550] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:21:51 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 30 07:21:56.191759 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1613ad0-974f-4b1b-9daa-1921b75f9cf9 service nova] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:21:56.201712 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1613ad0-974f-4b1b-9daa-1921b75f9cf9 service nova] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:21:56.205716 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e24ff5-817c-47af-8124-82789ceb55d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3802cb341445f994b9204744060ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:21:56.206359 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e24ff5-817c-47af-8124-82789ceb55d7 service neutron] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:21:56.206640 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e24ff5-817c-47af-8124-82789ceb55d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:21:56.206915 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e24ff5-817c-47af-8124-82789ceb55d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:21:56.209442 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-10e24ff5-817c-47af-8124-82789ceb55d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:21:56.289006 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e24ff5-817c-47af-8124-82789ceb55d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:21:56.290461 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e24ff5-817c-47af-8124-82789ceb55d7 service neutron] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:21:56.300802 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1278/2551] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:21:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:22:00.101569 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c2c2fb-0940-4548-ab14-dc609bdc4a60 service neutron] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:22:00.114776 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c2c2fb-0940-4548-ab14-dc609bdc4a60 service neutron] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:22:00.120737 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422732d4-d7f6-4b02-b85b-0b70230a8060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:22:00.121613 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422732d4-d7f6-4b02-b85b-0b70230a8060 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:00.121891 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422732d4-d7f6-4b02-b85b-0b70230a8060 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:00.122160 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422732d4-d7f6-4b02-b85b-0b70230a8060 admin admin] PATH_INFO: `/v3/users/285aadd9fb344fc792430f71d34ac03b` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:00.123353 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422732d4-d7f6-4b02-b85b-0b70230a8060 admin admin] RBAC: Authorizing `identity:delete_user(user_id=285aadd9fb344fc792430f71d34ac03b)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:22:00.125290 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422732d4-d7f6-4b02-b85b-0b70230a8060 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:22:00.175433 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-422732d4-d7f6-4b02-b85b-0b70230a8060 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '285aadd9fb344fc792430f71d34ac03b'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:22:00.176107 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-422732d4-d7f6-4b02-b85b-0b70230a8060 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '285aadd9fb344fc792430f71d34ac03b'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:22:00.194546 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-422732d4-d7f6-4b02-b85b-0b70230a8060 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '285aadd9fb344fc792430f71d34ac03b'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:22:00.204564 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-422732d4-d7f6-4b02-b85b-0b70230a8060 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '285aadd9fb344fc792430f71d34ac03b'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:22:00.205352 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-422732d4-d7f6-4b02-b85b-0b70230a8060 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '285aadd9fb344fc792430f71d34ac03b'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:22:00.218497 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1274/2552] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Mar 30 07:22:00 2022] DELETE /identity/v3/users/285aadd9fb344fc792430f71d34ac03b => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:22:00.397281 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e24ff5-817c-47af-8124-82789ceb55d7 service neutron] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:22:00.401542 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422732d4-d7f6-4b02-b85b-0b70230a8060 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:22:00.403035 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-422732d4-d7f6-4b02-b85b-0b70230a8060 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:22:00.408970 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e24ff5-817c-47af-8124-82789ceb55d7 service neutron] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:22:00.471332 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b634b7-899f-437e-93e7-ccf71fe4e859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:22:00.472244 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b634b7-899f-437e-93e7-ccf71fe4e859 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:00.472524 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b634b7-899f-437e-93e7-ccf71fe4e859 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:00.472797 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b634b7-899f-437e-93e7-ccf71fe4e859 admin admin] PATH_INFO: `/v3/projects/02d063de803e4291a15e100679d943b8` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:00.473975 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b634b7-899f-437e-93e7-ccf71fe4e859 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02d063de803e4291a15e100679d943b8)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:22:00.475781 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422732d4-d7f6-4b02-b85b-0b70230a8060 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:22:00.475992 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b634b7-899f-437e-93e7-ccf71fe4e859 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:22:00.481102 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6aff4f-d5a0-4100-bb2a-e8add128854a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:22:00.481959 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6aff4f-d5a0-4100-bb2a-e8add128854a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:00.482247 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6aff4f-d5a0-4100-bb2a-e8add128854a admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:00.482502 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6aff4f-d5a0-4100-bb2a-e8add128854a admin admin] PATH_INFO: `/v3/users/8dd9d32c47014294a367654b57c96f3f` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:00.483698 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6aff4f-d5a0-4100-bb2a-e8add128854a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8dd9d32c47014294a367654b57c96f3f)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:22:00.485597 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6aff4f-d5a0-4100-bb2a-e8add128854a admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:22:00.526946 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-56b634b7-899f-437e-93e7-ccf71fe4e859 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02d063de803e4291a15e100679d943b8', 'request_id': 'req-56b634b7-899f-437e-93e7-ccf71fe4e859'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:22:00.532671 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-56b634b7-899f-437e-93e7-ccf71fe4e859 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02d063de803e4291a15e100679d943b8', 'request_id': 'req-56b634b7-899f-437e-93e7-ccf71fe4e859'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:22:00.533499 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-6e6aff4f-d5a0-4100-bb2a-e8add128854a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8dd9d32c47014294a367654b57c96f3f'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:22:00.534215 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-6e6aff4f-d5a0-4100-bb2a-e8add128854a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8dd9d32c47014294a367654b57c96f3f'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:22:00.541099 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-56b634b7-899f-437e-93e7-ccf71fe4e859 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02d063de803e4291a15e100679d943b8', 'request_id': 'req-56b634b7-899f-437e-93e7-ccf71fe4e859'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:22:00.544200 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-6e6aff4f-d5a0-4100-bb2a-e8add128854a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8dd9d32c47014294a367654b57c96f3f'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:22:00.552641 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-56b634b7-899f-437e-93e7-ccf71fe4e859 admin admin] The token cache is being invalidate because project 02d063de803e4291a15e100679d943b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79961) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 07:22:00.552910 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-56b634b7-899f-437e-93e7-ccf71fe4e859 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:22:00.553601 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-56b634b7-899f-437e-93e7-ccf71fe4e859 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:22:00.555428 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1279/2553] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Mar 30 07:22:00 2022] DELETE /identity/v3/projects/02d063de803e4291a15e100679d943b8 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:22:00.556281 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-6e6aff4f-d5a0-4100-bb2a-e8add128854a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8dd9d32c47014294a367654b57c96f3f'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:22:00.556889 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-6e6aff4f-d5a0-4100-bb2a-e8add128854a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8dd9d32c47014294a367654b57c96f3f'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:22:00.559507 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b634b7-899f-437e-93e7-ccf71fe4e859 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:22:00.560940 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-56b634b7-899f-437e-93e7-ccf71fe4e859 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:22:00.568613 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1275/2554] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Mar 30 07:22:00 2022] DELETE /identity/v3/users/8dd9d32c47014294a367654b57c96f3f => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 07:22:00.633392 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b634b7-899f-437e-93e7-ccf71fe4e859 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:22:00.697057 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b4016c-9568-4f5e-ba74-1b7e6ea66fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:22:00.698024 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b4016c-9568-4f5e-ba74-1b7e6ea66fe0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:00.698363 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b4016c-9568-4f5e-ba74-1b7e6ea66fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:00.698626 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b4016c-9568-4f5e-ba74-1b7e6ea66fe0 admin admin] PATH_INFO: `/v3/users/076d16c77e704aa98d441b10d2abbde5` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:00.700267 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b4016c-9568-4f5e-ba74-1b7e6ea66fe0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=076d16c77e704aa98d441b10d2abbde5)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:22:00.702230 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b4016c-9568-4f5e-ba74-1b7e6ea66fe0 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:22:00.748400 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-d6b4016c-9568-4f5e-ba74-1b7e6ea66fe0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '076d16c77e704aa98d441b10d2abbde5'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:22:00.749137 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-d6b4016c-9568-4f5e-ba74-1b7e6ea66fe0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '076d16c77e704aa98d441b10d2abbde5'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:22:00.749807 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-d6b4016c-9568-4f5e-ba74-1b7e6ea66fe0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '076d16c77e704aa98d441b10d2abbde5'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:22:00.750202 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6aff4f-d5a0-4100-bb2a-e8add128854a admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:22:00.752306 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-6e6aff4f-d5a0-4100-bb2a-e8add128854a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:22:00.759479 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-d6b4016c-9568-4f5e-ba74-1b7e6ea66fe0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '076d16c77e704aa98d441b10d2abbde5'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:22:00.766724 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6aff4f-d5a0-4100-bb2a-e8add128854a admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:22:00.768152 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-d6b4016c-9568-4f5e-ba74-1b7e6ea66fe0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '076d16c77e704aa98d441b10d2abbde5'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:22:00.782691 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58a534e-e890-498f-954f-b7db8fbfb79f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:22:00.784207 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58a534e-e890-498f-954f-b7db8fbfb79f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:00.784522 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58a534e-e890-498f-954f-b7db8fbfb79f admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:00.784984 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58a534e-e890-498f-954f-b7db8fbfb79f admin admin] PATH_INFO: `/v3/projects/cc9ab7163ff443ff849d017d40115708` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:00.786851 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58a534e-e890-498f-954f-b7db8fbfb79f admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc9ab7163ff443ff849d017d40115708)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:22:00.791078 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1280/2555] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Mar 30 07:22:00 2022] DELETE /identity/v3/users/076d16c77e704aa98d441b10d2abbde5 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:22:00.791204 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58a534e-e890-498f-954f-b7db8fbfb79f admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:22:00.845711 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-c58a534e-e890-498f-954f-b7db8fbfb79f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc9ab7163ff443ff849d017d40115708', 'request_id': 'req-c58a534e-e890-498f-954f-b7db8fbfb79f'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:22:00.854990 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-c58a534e-e890-498f-954f-b7db8fbfb79f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc9ab7163ff443ff849d017d40115708', 'request_id': 'req-c58a534e-e890-498f-954f-b7db8fbfb79f'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:22:00.860671 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-c58a534e-e890-498f-954f-b7db8fbfb79f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc9ab7163ff443ff849d017d40115708', 'request_id': 'req-c58a534e-e890-498f-954f-b7db8fbfb79f'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:22:00.872149 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-c58a534e-e890-498f-954f-b7db8fbfb79f admin admin] The token cache is being invalidate because project cc9ab7163ff443ff849d017d40115708 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79960) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 07:22:00.872351 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-c58a534e-e890-498f-954f-b7db8fbfb79f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:22:00.873024 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-c58a534e-e890-498f-954f-b7db8fbfb79f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:22:00.875188 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1276/2556] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Mar 30 07:22:00 2022] DELETE /identity/v3/projects/cc9ab7163ff443ff849d017d40115708 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 07:22:00.879785 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9786de22-7473-4ecd-9d5e-469ae73fa60c None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:00.880100 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9786de22-7473-4ecd-9d5e-469ae73fa60c None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:00.880373 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9786de22-7473-4ecd-9d5e-469ae73fa60c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:00.898515 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-9786de22-7473-4ecd-9d5e-469ae73fa60c None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:22:00.899708 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-9786de22-7473-4ecd-9d5e-469ae73fa60c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:22:00.961305 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1281/2557] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:22:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 07:22:00.969614 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa20b81d-05c7-40ab-8993-2681e4e6a5ac None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:00.969899 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa20b81d-05c7-40ab-8993-2681e4e6a5ac None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:00.970230 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa20b81d-05c7-40ab-8993-2681e4e6a5ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:00.989583 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-fa20b81d-05c7-40ab-8993-2681e4e6a5ac None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:22:00.990758 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-fa20b81d-05c7-40ab-8993-2681e4e6a5ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:22:00.999022 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1277/2558] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:22:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 07:22:01.003335 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9786de22-7473-4ecd-9d5e-469ae73fa60c None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:22:01.015673 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9786de22-7473-4ecd-9d5e-469ae73fa60c None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:22:01.022159 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e949c4-0fdd-45d1-8ccb-f3cbc6ff28c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:22:01.023210 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e949c4-0fdd-45d1-8ccb-f3cbc6ff28c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:01.023565 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e949c4-0fdd-45d1-8ccb-f3cbc6ff28c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:01.024028 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e949c4-0fdd-45d1-8ccb-f3cbc6ff28c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:01.024996 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e949c4-0fdd-45d1-8ccb-f3cbc6ff28c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:22:01.025503 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e949c4-0fdd-45d1-8ccb-f3cbc6ff28c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:22:01.027640 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e949c4-0fdd-45d1-8ccb-f3cbc6ff28c1 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:22:01.034280 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa20b81d-05c7-40ab-8993-2681e4e6a5ac None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:22:01.037080 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-fa20b81d-05c7-40ab-8993-2681e4e6a5ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:22:01.049714 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1282/2559] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Mar 30 07:22:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:22:01.051080 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e949c4-0fdd-45d1-8ccb-f3cbc6ff28c1 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:22:01.056548 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa20b81d-05c7-40ab-8993-2681e4e6a5ac None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:22:01.062131 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e949c4-0fdd-45d1-8ccb-f3cbc6ff28c1 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:22:01.064797 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4e9c3c-1ada-4f1b-b2fc-de4c2ad0980e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:22:01.066171 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e9c3c-1ada-4f1b-b2fc-de4c2ad0980e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:01.066688 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e9c3c-1ada-4f1b-b2fc-de4c2ad0980e admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:01.066932 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68244af-b8b1-4bb6-a146-80c05de003e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:22:01.067140 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e9c3c-1ada-4f1b-b2fc-de4c2ad0980e admin admin] PATH_INFO: `/v3/projects/c5e7b4bea04b4adfb33e8627ee209d4a` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:01.067576 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68244af-b8b1-4bb6-a146-80c05de003e4 admin admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:01.068833 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68244af-b8b1-4bb6-a146-80c05de003e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:01.069148 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68244af-b8b1-4bb6-a146-80c05de003e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:01.069249 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4e9c3c-1ada-4f1b-b2fc-de4c2ad0980e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5e7b4bea04b4adfb33e8627ee209d4a)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:22:01.070220 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68244af-b8b1-4bb6-a146-80c05de003e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:22:01.071622 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4e9c3c-1ada-4f1b-b2fc-de4c2ad0980e admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:22:01.072891 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68244af-b8b1-4bb6-a146-80c05de003e4 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:22:01.111800 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1283/2560] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Mar 30 07:22:01 2022] POST /identity/v3/projects => generated 383 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 07:22:01.115748 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68244af-b8b1-4bb6-a146-80c05de003e4 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:22:01.128183 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-8d4e9c3c-1ada-4f1b-b2fc-de4c2ad0980e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5e7b4bea04b4adfb33e8627ee209d4a', 'request_id': 'req-8d4e9c3c-1ada-4f1b-b2fc-de4c2ad0980e'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:22:01.136555 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-8d4e9c3c-1ada-4f1b-b2fc-de4c2ad0980e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5e7b4bea04b4adfb33e8627ee209d4a', 'request_id': 'req-8d4e9c3c-1ada-4f1b-b2fc-de4c2ad0980e'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:22:01.142323 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-8d4e9c3c-1ada-4f1b-b2fc-de4c2ad0980e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5e7b4bea04b4adfb33e8627ee209d4a', 'request_id': 'req-8d4e9c3c-1ada-4f1b-b2fc-de4c2ad0980e'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:22:01.153783 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-8d4e9c3c-1ada-4f1b-b2fc-de4c2ad0980e admin admin] The token cache is being invalidate because project c5e7b4bea04b4adfb33e8627ee209d4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79960) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 07:22:01.154069 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-8d4e9c3c-1ada-4f1b-b2fc-de4c2ad0980e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:22:01.154793 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-8d4e9c3c-1ada-4f1b-b2fc-de4c2ad0980e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:22:01.156527 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1278/2561] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Mar 30 07:22:01 2022] DELETE /identity/v3/projects/c5e7b4bea04b4adfb33e8627ee209d4a => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:22:01.163225 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a53d7a7-e5ea-426d-b002-ed8703ad624f None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:01.163716 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a53d7a7-e5ea-426d-b002-ed8703ad624f None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:01.164112 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a53d7a7-e5ea-426d-b002-ed8703ad624f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:01.177129 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68244af-b8b1-4bb6-a146-80c05de003e4 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:22:01.182028 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-2a53d7a7-e5ea-426d-b002-ed8703ad624f None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:22:01.183213 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-2a53d7a7-e5ea-426d-b002-ed8703ad624f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:22:01.233140 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbf47cf-5333-48b2-b1a9-04fd14445abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:22:01.233821 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbf47cf-5333-48b2-b1a9-04fd14445abf admin admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:01.234102 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbf47cf-5333-48b2-b1a9-04fd14445abf admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:01.234376 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbf47cf-5333-48b2-b1a9-04fd14445abf admin admin] PATH_INFO: `/v3/users` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:01.235084 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbf47cf-5333-48b2-b1a9-04fd14445abf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:22:01.237788 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbf47cf-5333-48b2-b1a9-04fd14445abf admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:22:01.242239 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1279/2562] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:22:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 07:22:01.265619 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1284/2563] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Mar 30 07:22:01 2022] POST /identity/v3/users => generated 292 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 07:22:01.270050 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a53d7a7-e5ea-426d-b002-ed8703ad624f None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:22:01.271492 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-2a53d7a7-e5ea-426d-b002-ed8703ad624f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:22:01.284783 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a53d7a7-e5ea-426d-b002-ed8703ad624f None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:22:01.290084 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ca57db-51b0-4b9d-bec8-dfb56b7b9f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:22:01.290913 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ca57db-51b0-4b9d-bec8-dfb56b7b9f82 admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:01.291193 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ca57db-51b0-4b9d-bec8-dfb56b7b9f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:01.291465 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ca57db-51b0-4b9d-bec8-dfb56b7b9f82 admin admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:01.292277 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ca57db-51b0-4b9d-bec8-dfb56b7b9f82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:22:01.293924 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ca57db-51b0-4b9d-bec8-dfb56b7b9f82 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:22:01.305278 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1280/2564] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:22:01 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:22:01.308936 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d819f0-b69d-4bf1-9dbf-6ab0557a7613 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:01.309224 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d819f0-b69d-4bf1-9dbf-6ab0557a7613 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:01.309363 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ca57db-51b0-4b9d-bec8-dfb56b7b9f82 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:22:01.309460 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d819f0-b69d-4bf1-9dbf-6ab0557a7613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:01.319566 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ca57db-51b0-4b9d-bec8-dfb56b7b9f82 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:22:01.324537 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b1b2a6-ab81-4ced-bee4-09c35dd0dcb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:22:01.325204 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b1b2a6-ab81-4ced-bee4-09c35dd0dcb2 admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:01.325484 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b1b2a6-ab81-4ced-bee4-09c35dd0dcb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:01.325758 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b1b2a6-ab81-4ced-bee4-09c35dd0dcb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:01.326520 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b1b2a6-ab81-4ced-bee4-09c35dd0dcb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:22:01.327442 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-06d819f0-b69d-4bf1-9dbf-6ab0557a7613 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:22:01.328147 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b1b2a6-ab81-4ced-bee4-09c35dd0dcb2 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:22:01.328670 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-06d819f0-b69d-4bf1-9dbf-6ab0557a7613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:22:01.337315 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1285/2565] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:22:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:22:01.343397 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1281/2566] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:22:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 30 07:22:01.343550 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d819f0-b69d-4bf1-9dbf-6ab0557a7613 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:22:01.344495 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b1b2a6-ab81-4ced-bee4-09c35dd0dcb2 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:22:01.351362 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d819f0-b69d-4bf1-9dbf-6ab0557a7613 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:22:01.355161 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b1b2a6-ab81-4ced-bee4-09c35dd0dcb2 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:22:01.356678 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1724975f-e06c-4337-9f41-2397ccdb5fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:22:01.357390 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1724975f-e06c-4337-9f41-2397ccdb5fd3 admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:01.357604 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1724975f-e06c-4337-9f41-2397ccdb5fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:01.358002 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1724975f-e06c-4337-9f41-2397ccdb5fd3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:01.358690 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1724975f-e06c-4337-9f41-2397ccdb5fd3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:22:01.358874 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1724975f-e06c-4337-9f41-2397ccdb5fd3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:22:01.360526 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1724975f-e06c-4337-9f41-2397ccdb5fd3 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:22:01.360906 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea376b7-c559-4fe8-a93e-043fab4e37da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:22:01.361994 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea376b7-c559-4fe8-a93e-043fab4e37da admin admin] REQUEST_METHOD: `PUT` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:01.362239 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea376b7-c559-4fe8-a93e-043fab4e37da admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:01.362512 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea376b7-c559-4fe8-a93e-043fab4e37da admin admin] PATH_INFO: `/v3/projects/2482f983870c40ad8fe2e8a9ae69169c/users/b0a49ff45f0e43958ceeffd704999f00/roles/5d79031a64754b57ba120367465e2252` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:01.372944 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1286/2567] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Mar 30 07:22:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:22:01.378961 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea376b7-c559-4fe8-a93e-043fab4e37da admin admin] RBAC: Authorizing `identity:create_grant(project_id=2482f983870c40ad8fe2e8a9ae69169c, user_id=b0a49ff45f0e43958ceeffd704999f00, role_id=5d79031a64754b57ba120367465e2252)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:22:01.380324 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1724975f-e06c-4337-9f41-2397ccdb5fd3 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:22:01.381605 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea376b7-c559-4fe8-a93e-043fab4e37da admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:22:01.390662 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1724975f-e06c-4337-9f41-2397ccdb5fd3 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:22:01.397087 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1282/2568] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:22:01 2022] PUT /identity/v3/projects/2482f983870c40ad8fe2e8a9ae69169c/users/b0a49ff45f0e43958ceeffd704999f00/roles/5d79031a64754b57ba120367465e2252 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 07:22:01.402027 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2c1ed6-6c5b-48dc-9f77-0bbe6b924206 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:01.402558 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2c1ed6-6c5b-48dc-9f77-0bbe6b924206 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:01.402987 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2c1ed6-6c5b-48dc-9f77-0bbe6b924206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:01.422829 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-ae2c1ed6-6c5b-48dc-9f77-0bbe6b924206 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:22:01.424230 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-ae2c1ed6-6c5b-48dc-9f77-0bbe6b924206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:22:01.455783 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53e4c05-6044-488b-bdf9-f9bf6cfe5f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:22:01.456482 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53e4c05-6044-488b-bdf9-f9bf6cfe5f7f admin admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:01.456760 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53e4c05-6044-488b-bdf9-f9bf6cfe5f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:01.457049 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53e4c05-6044-488b-bdf9-f9bf6cfe5f7f admin admin] PATH_INFO: `/v3/projects` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:01.457724 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53e4c05-6044-488b-bdf9-f9bf6cfe5f7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:22:01.459637 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53e4c05-6044-488b-bdf9-f9bf6cfe5f7f admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:22:01.484798 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1283/2569] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:22:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:22:01.486078 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1287/2570] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Mar 30 07:22:01 2022] POST /identity/v3/projects => generated 385 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 07:22:01.492952 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2c1ed6-6c5b-48dc-9f77-0bbe6b924206 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:22:01.494914 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53e4c05-6044-488b-bdf9-f9bf6cfe5f7f admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:22:01.496663 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-a53e4c05-6044-488b-bdf9-f9bf6cfe5f7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:22:01.503109 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2c1ed6-6c5b-48dc-9f77-0bbe6b924206 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:22:01.551483 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53e4c05-6044-488b-bdf9-f9bf6cfe5f7f admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:22:01.555258 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1ffd6f-fb49-468a-a21e-21d70b81360e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3802cb341445f994b9204744060ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:22:01.555942 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ffd6f-fb49-468a-a21e-21d70b81360e service neutron] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:01.556224 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ffd6f-fb49-468a-a21e-21d70b81360e service neutron] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:01.556500 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ffd6f-fb49-468a-a21e-21d70b81360e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:01.557310 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7597b38f-44fe-4e59-b07d-62ca751065a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:22:01.557994 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7597b38f-44fe-4e59-b07d-62ca751065a9 admin admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:01.558271 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7597b38f-44fe-4e59-b07d-62ca751065a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:01.558547 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7597b38f-44fe-4e59-b07d-62ca751065a9 admin admin] PATH_INFO: `/v3/users` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:01.559237 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7597b38f-44fe-4e59-b07d-62ca751065a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:22:01.561267 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7597b38f-44fe-4e59-b07d-62ca751065a9 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:22:01.565722 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1ffd6f-fb49-468a-a21e-21d70b81360e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:22:01.567145 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1ffd6f-fb49-468a-a21e-21d70b81360e service neutron] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:22:01.576989 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1288/2571] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:22:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 30 07:22:01.582546 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1284/2572] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Mar 30 07:22:01 2022] POST /identity/v3/users => generated 293 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:22:01.586673 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1ffd6f-fb49-468a-a21e-21d70b81360e service neutron] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:22:01.596201 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1ffd6f-fb49-468a-a21e-21d70b81360e service neutron] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:22:01.601462 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bacf8a-0545-42fb-8f27-462e3935adf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:22:01.602141 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bacf8a-0545-42fb-8f27-462e3935adf4 admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:01.602384 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bacf8a-0545-42fb-8f27-462e3935adf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:01.603018 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bacf8a-0545-42fb-8f27-462e3935adf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:01.603736 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bacf8a-0545-42fb-8f27-462e3935adf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:22:01.605363 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bacf8a-0545-42fb-8f27-462e3935adf4 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:22:01.615802 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1289/2573] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:22:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:22:01.620082 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7597b38f-44fe-4e59-b07d-62ca751065a9 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:22:01.630132 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7597b38f-44fe-4e59-b07d-62ca751065a9 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:22:01.635444 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdbac78-b7fb-4781-96ce-be4e2b5625f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:22:01.636090 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdbac78-b7fb-4781-96ce-be4e2b5625f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:01.636370 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdbac78-b7fb-4781-96ce-be4e2b5625f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:01.636641 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdbac78-b7fb-4781-96ce-be4e2b5625f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:01.637363 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdbac78-b7fb-4781-96ce-be4e2b5625f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:22:01.638963 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdbac78-b7fb-4781-96ce-be4e2b5625f5 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:22:01.649443 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1285/2574] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:22:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 30 07:22:01.653824 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bacf8a-0545-42fb-8f27-462e3935adf4 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:22:01.664633 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bacf8a-0545-42fb-8f27-462e3935adf4 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:22:01.669756 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade71898-c73e-416b-9132-6d75893b2268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:22:01.670671 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade71898-c73e-416b-9132-6d75893b2268 admin admin] REQUEST_METHOD: `PUT` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:01.670951 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade71898-c73e-416b-9132-6d75893b2268 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:01.671223 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade71898-c73e-416b-9132-6d75893b2268 admin admin] PATH_INFO: `/v3/projects/f93c1f92c8c14564bdb5b78a2d2b8b45/users/f52cc2951a1c4a11a369acd769c78db1/roles/5d79031a64754b57ba120367465e2252` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:01.686770 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade71898-c73e-416b-9132-6d75893b2268 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f93c1f92c8c14564bdb5b78a2d2b8b45, user_id=f52cc2951a1c4a11a369acd769c78db1, role_id=5d79031a64754b57ba120367465e2252)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:22:01.689439 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade71898-c73e-416b-9132-6d75893b2268 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:22:01.707703 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1290/2575] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:22:01 2022] PUT /identity/v3/projects/f93c1f92c8c14564bdb5b78a2d2b8b45/users/f52cc2951a1c4a11a369acd769c78db1/roles/5d79031a64754b57ba120367465e2252 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 07:22:01.710029 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0febc10d-a316-41f6-a3f8-b99a26ccc37e None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:01.710468 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0febc10d-a316-41f6-a3f8-b99a26ccc37e None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:01.710852 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0febc10d-a316-41f6-a3f8-b99a26ccc37e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:01.730119 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-0febc10d-a316-41f6-a3f8-b99a26ccc37e None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:22:01.731485 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-0febc10d-a316-41f6-a3f8-b99a26ccc37e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:22:01.797694 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1286/2576] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:22:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:22:01.807712 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade71898-c73e-416b-9132-6d75893b2268 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:22:01.810476 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-ade71898-c73e-416b-9132-6d75893b2268 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:22:01.870123 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade71898-c73e-416b-9132-6d75893b2268 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:22:01.873870 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e58a46e-b812-4a0d-807d-b68ba70938ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3802cb341445f994b9204744060ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:22:01.875026 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e58a46e-b812-4a0d-807d-b68ba70938ea service neutron] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:01.875318 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e58a46e-b812-4a0d-807d-b68ba70938ea service neutron] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:01.875798 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e58a46e-b812-4a0d-807d-b68ba70938ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:01.886059 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e58a46e-b812-4a0d-807d-b68ba70938ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:22:01.887483 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e58a46e-b812-4a0d-807d-b68ba70938ea service neutron] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:22:01.899566 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1291/2577] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:22:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:22:07.752537 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72673315-ca53-4394-8f49-677f90a4bb1f None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:07.753046 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72673315-ca53-4394-8f49-677f90a4bb1f None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:07.753046 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72673315-ca53-4394-8f49-677f90a4bb1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:07.789882 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-72673315-ca53-4394-8f49-677f90a4bb1f None None] MFA Rules not processed for user `b0a49ff45f0e43958ceeffd704999f00`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:22:07.791404 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-72673315-ca53-4394-8f49-677f90a4bb1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:22:07.874421 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1287/2578] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:22:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:22:07.891474 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e58a46e-b812-4a0d-807d-b68ba70938ea service neutron] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:22:07.895672 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-7e58a46e-b812-4a0d-807d-b68ba70938ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:22:07.982439 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e58a46e-b812-4a0d-807d-b68ba70938ea service neutron] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:22:07.988658 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1ea469-446d-4d3a-9ffd-3f5892d287b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72b398c5ed14484d8b7a51fee900597b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:22:07.989644 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1ea469-446d-4d3a-9ffd-3f5892d287b6 service nova] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:07.989786 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1ea469-446d-4d3a-9ffd-3f5892d287b6 service nova] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:07.990053 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1ea469-446d-4d3a-9ffd-3f5892d287b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:07.999477 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1ea469-446d-4d3a-9ffd-3f5892d287b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:22:08.001201 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1ea469-446d-4d3a-9ffd-3f5892d287b6 service nova] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:22:08.013529 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1292/2579] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:22:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:22:08.344478 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec3a4f7-1dba-4082-bd87-66aa796135c3 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:08.344776 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec3a4f7-1dba-4082-bd87-66aa796135c3 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:08.345034 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec3a4f7-1dba-4082-bd87-66aa796135c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:08.382404 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-0ec3a4f7-1dba-4082-bd87-66aa796135c3 None None] MFA Rules not processed for user `f52cc2951a1c4a11a369acd769c78db1`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:22:08.383630 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-0ec3a4f7-1dba-4082-bd87-66aa796135c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:22:08.469516 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1288/2580] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:22:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:22:08.473790 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1ea469-446d-4d3a-9ffd-3f5892d287b6 service nova] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:22:08.487238 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1ea469-446d-4d3a-9ffd-3f5892d287b6 service nova] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:22:08.493711 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b553d555-4f01-4231-b210-50195e363dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:22:08.494707 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b553d555-4f01-4231-b210-50195e363dc8 admin admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:08.494996 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b553d555-4f01-4231-b210-50195e363dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:08.495584 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b553d555-4f01-4231-b210-50195e363dc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:08.497950 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b553d555-4f01-4231-b210-50195e363dc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:22:08.500251 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b553d555-4f01-4231-b210-50195e363dc8 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:22:08.557255 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1293/2581] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Mar 30 07:22:08 2022] POST /identity/v3/projects => generated 383 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:22:08.561260 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec3a4f7-1dba-4082-bd87-66aa796135c3 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:22:08.579793 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec3a4f7-1dba-4082-bd87-66aa796135c3 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:22:08.682020 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1690dbfc-a202-4edb-9a5f-79202c040a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:22:08.682764 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1690dbfc-a202-4edb-9a5f-79202c040a5c admin admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:08.683065 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1690dbfc-a202-4edb-9a5f-79202c040a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:08.683485 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1690dbfc-a202-4edb-9a5f-79202c040a5c admin admin] PATH_INFO: `/v3/users` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:08.684341 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1690dbfc-a202-4edb-9a5f-79202c040a5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:22:08.686363 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1690dbfc-a202-4edb-9a5f-79202c040a5c admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:22:08.735795 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1289/2582] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Mar 30 07:22:08 2022] POST /identity/v3/users => generated 298 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:22:08.739796 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b553d555-4f01-4231-b210-50195e363dc8 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:22:08.757930 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b553d555-4f01-4231-b210-50195e363dc8 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:22:08.763159 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e926fb94-c574-4d30-b8ea-a5a0b08c6730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:22:08.763706 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e926fb94-c574-4d30-b8ea-a5a0b08c6730 admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:08.764099 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e926fb94-c574-4d30-b8ea-a5a0b08c6730 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:08.764441 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e926fb94-c574-4d30-b8ea-a5a0b08c6730 admin admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:08.765267 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e926fb94-c574-4d30-b8ea-a5a0b08c6730 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:22:08.767257 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e926fb94-c574-4d30-b8ea-a5a0b08c6730 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:22:08.779749 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1294/2583] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:22:08 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 30 07:22:08.784038 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1690dbfc-a202-4edb-9a5f-79202c040a5c admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:22:08.795367 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1690dbfc-a202-4edb-9a5f-79202c040a5c admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:22:08.800409 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9def69-17bd-443d-9a20-1f8297f45333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:22:08.802352 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9def69-17bd-443d-9a20-1f8297f45333 admin admin] REQUEST_METHOD: `PUT` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:08.802352 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9def69-17bd-443d-9a20-1f8297f45333 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:08.802352 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9def69-17bd-443d-9a20-1f8297f45333 admin admin] PATH_INFO: `/v3/projects/7e5218a5dc224bf8a0ff1a0500764999/users/1ad480000ab14eb9bbb5c0dd0447bc97/roles/1c39b9ab8cfd4c0ea71845831920a845` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:08.833653 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9def69-17bd-443d-9a20-1f8297f45333 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e5218a5dc224bf8a0ff1a0500764999, user_id=1ad480000ab14eb9bbb5c0dd0447bc97, role_id=1c39b9ab8cfd4c0ea71845831920a845)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:22:08.845432 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9def69-17bd-443d-9a20-1f8297f45333 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:22:08.871333 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1290/2584] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:22:08 2022] PUT /identity/v3/projects/7e5218a5dc224bf8a0ff1a0500764999/users/1ad480000ab14eb9bbb5c0dd0447bc97/roles/1c39b9ab8cfd4c0ea71845831920a845 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:22:08.875384 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e926fb94-c574-4d30-b8ea-a5a0b08c6730 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:22:08.885942 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e926fb94-c574-4d30-b8ea-a5a0b08c6730 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:22:08.953554 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e626a6-8d1d-4d16-852a-b1c66b15178f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:22:08.955509 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e626a6-8d1d-4d16-852a-b1c66b15178f admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:08.955893 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e626a6-8d1d-4d16-852a-b1c66b15178f admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:08.956129 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e626a6-8d1d-4d16-852a-b1c66b15178f admin admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:08.956970 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e626a6-8d1d-4d16-852a-b1c66b15178f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:22:08.958608 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e626a6-8d1d-4d16-852a-b1c66b15178f admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:22:08.979533 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1295/2585] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:22:08 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:22:08.982336 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9def69-17bd-443d-9a20-1f8297f45333 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:22:08.995094 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9def69-17bd-443d-9a20-1f8297f45333 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:22:09.001742 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08479929-ebeb-4247-afa4-7da8dceecf7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:22:09.003680 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08479929-ebeb-4247-afa4-7da8dceecf7e admin admin] REQUEST_METHOD: `PUT` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:09.004189 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08479929-ebeb-4247-afa4-7da8dceecf7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:09.004544 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08479929-ebeb-4247-afa4-7da8dceecf7e admin admin] PATH_INFO: `/v3/projects/7e5218a5dc224bf8a0ff1a0500764999/users/1ad480000ab14eb9bbb5c0dd0447bc97/roles/1c39b9ab8cfd4c0ea71845831920a845` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:09.007297 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08479929-ebeb-4247-afa4-7da8dceecf7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e5218a5dc224bf8a0ff1a0500764999, user_id=1ad480000ab14eb9bbb5c0dd0447bc97, role_id=1c39b9ab8cfd4c0ea71845831920a845)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:22:09.010143 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08479929-ebeb-4247-afa4-7da8dceecf7e admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:22:09.022935 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1291/2586] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:22:08 2022] PUT /identity/v3/projects/7e5218a5dc224bf8a0ff1a0500764999/users/1ad480000ab14eb9bbb5c0dd0447bc97/roles/1c39b9ab8cfd4c0ea71845831920a845 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:22:10.478580 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f24b3-8681-4a4f-866b-057e7c242652 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:10.479038 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f24b3-8681-4a4f-866b-057e7c242652 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:10.479134 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f24b3-8681-4a4f-866b-057e7c242652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:10.502176 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-5d6f24b3-8681-4a4f-866b-057e7c242652 None None] MFA Rules not processed for user `b0a49ff45f0e43958ceeffd704999f00`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:22:10.503567 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-5d6f24b3-8681-4a4f-866b-057e7c242652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:22:10.563196 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1296/2587] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:22:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:22:10.966813 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08479929-ebeb-4247-afa4-7da8dceecf7e admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:22:11.027495 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08479929-ebeb-4247-afa4-7da8dceecf7e admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:22:11.031348 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168f7e92-5bed-4482-b221-cc5f16b68d87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3802cb341445f994b9204744060ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:22:11.032048 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f7e92-5bed-4482-b221-cc5f16b68d87 service neutron] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:11.032377 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f7e92-5bed-4482-b221-cc5f16b68d87 service neutron] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:11.032830 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f7e92-5bed-4482-b221-cc5f16b68d87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:11.036629 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-168f7e92-5bed-4482-b221-cc5f16b68d87 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:22:11.051627 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168f7e92-5bed-4482-b221-cc5f16b68d87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:22:11.054654 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168f7e92-5bed-4482-b221-cc5f16b68d87 service neutron] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:22:11.063652 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1292/2588] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:22:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:22:17.172203 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b6a2c8-d6f7-4248-b6c5-92e6b72aa3f8 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:17.173115 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b6a2c8-d6f7-4248-b6c5-92e6b72aa3f8 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:17.173595 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b6a2c8-d6f7-4248-b6c5-92e6b72aa3f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:17.207399 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-f8b6a2c8-d6f7-4248-b6c5-92e6b72aa3f8 None None] MFA Rules not processed for user `1ad480000ab14eb9bbb5c0dd0447bc97`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:22:17.209168 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-f8b6a2c8-d6f7-4248-b6c5-92e6b72aa3f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:22:17.313177 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1297/2589] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:22:17 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:22:17.328686 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168f7e92-5bed-4482-b221-cc5f16b68d87 service neutron] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:22:17.330917 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-168f7e92-5bed-4482-b221-cc5f16b68d87 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:22:17.452194 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168f7e92-5bed-4482-b221-cc5f16b68d87 service neutron] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:22:17.457482 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5954689-3e43-4523-802f-ab910693d012 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e880ade912f3412abf44ba73939d6e50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:22:17.458518 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5954689-3e43-4523-802f-ab910693d012 service glance] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:17.460810 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5954689-3e43-4523-802f-ab910693d012 service glance] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:17.462126 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5954689-3e43-4523-802f-ab910693d012 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:17.603502 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5954689-3e43-4523-802f-ab910693d012 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:22:17.605169 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5954689-3e43-4523-802f-ab910693d012 service glance] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:22:17.636598 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1293/2590] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:22:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 30 07:22:17.841402 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ccc77-5f7a-421f-9d10-f5e99f1bebeb None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:17.841886 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ccc77-5f7a-421f-9d10-f5e99f1bebeb None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:17.842311 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ccc77-5f7a-421f-9d10-f5e99f1bebeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:17.880351 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-b96ccc77-5f7a-421f-9d10-f5e99f1bebeb None None] MFA Rules not processed for user `67102c1adcf0491e9ecdef970ab2d5ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:22:17.882038 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-b96ccc77-5f7a-421f-9d10-f5e99f1bebeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:22:17.972859 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1298/2591] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Mar 30 07:22:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:22:18.001586 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5954689-3e43-4523-802f-ab910693d012 service glance] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:22:18.003356 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-e5954689-3e43-4523-802f-ab910693d012 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:22:18.079324 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5954689-3e43-4523-802f-ab910693d012 service glance] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:22:18.084367 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb62ff4b-fe74-4db3-a6fd-a9e040da45ff service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c452249c502d4b0688e8dd068f8c4951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:22:18.085025 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb62ff4b-fe74-4db3-a6fd-a9e040da45ff service swift] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:18.085309 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb62ff4b-fe74-4db3-a6fd-a9e040da45ff service swift] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:18.085582 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb62ff4b-fe74-4db3-a6fd-a9e040da45ff service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:18.094526 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb62ff4b-fe74-4db3-a6fd-a9e040da45ff service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:22:18.096171 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb62ff4b-fe74-4db3-a6fd-a9e040da45ff service swift] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:22:18.105952 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1294/2592] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Mar 30 07:22:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 30 07:22:20.923170 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96ccc77-5f7a-421f-9d10-f5e99f1bebeb None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:22:20.934338 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96ccc77-5f7a-421f-9d10-f5e99f1bebeb None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:22:20.938140 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46dba85-7eac-47b1-ab34-214ac915c764 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3802cb341445f994b9204744060ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:22:20.938859 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46dba85-7eac-47b1-ab34-214ac915c764 service neutron] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:20.939137 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46dba85-7eac-47b1-ab34-214ac915c764 service neutron] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:20.939414 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46dba85-7eac-47b1-ab34-214ac915c764 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:20.941575 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-e46dba85-7eac-47b1-ab34-214ac915c764 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:22:21.024661 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46dba85-7eac-47b1-ab34-214ac915c764 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:22:21.026044 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46dba85-7eac-47b1-ab34-214ac915c764 service neutron] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:22:21.041558 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1299/2593] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:22:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:22:25.681336 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb62ff4b-fe74-4db3-a6fd-a9e040da45ff service swift] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:22:25.682840 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-fb62ff4b-fe74-4db3-a6fd-a9e040da45ff service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:22:25.699562 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb62ff4b-fe74-4db3-a6fd-a9e040da45ff service swift] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:22:25.707145 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0df719-7e0d-443d-aeab-e71a307624bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:22:25.710210 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0df719-7e0d-443d-aeab-e71a307624bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:25.711505 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0df719-7e0d-443d-aeab-e71a307624bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:25.712043 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0df719-7e0d-443d-aeab-e71a307624bf admin admin] PATH_INFO: `/v3/users/93c4c81f994a48feb4d712c6b5120996` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:25.721577 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0df719-7e0d-443d-aeab-e71a307624bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=93c4c81f994a48feb4d712c6b5120996)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:22:25.724097 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0df719-7e0d-443d-aeab-e71a307624bf admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:22:25.804991 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-4c0df719-7e0d-443d-aeab-e71a307624bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93c4c81f994a48feb4d712c6b5120996'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:22:25.807419 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-4c0df719-7e0d-443d-aeab-e71a307624bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93c4c81f994a48feb4d712c6b5120996'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:22:25.842971 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-4c0df719-7e0d-443d-aeab-e71a307624bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93c4c81f994a48feb4d712c6b5120996'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:22:25.866214 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-4c0df719-7e0d-443d-aeab-e71a307624bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93c4c81f994a48feb4d712c6b5120996'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:22:25.866969 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-4c0df719-7e0d-443d-aeab-e71a307624bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93c4c81f994a48feb4d712c6b5120996'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:22:25.883370 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1295/2594] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Mar 30 07:22:25 2022] DELETE /identity/v3/users/93c4c81f994a48feb4d712c6b5120996 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:22:26.132973 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46dba85-7eac-47b1-ab34-214ac915c764 service neutron] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:22:26.151443 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46dba85-7eac-47b1-ab34-214ac915c764 service neutron] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:22:26.288366 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2b26e8-2bd9-4e98-ab07-be55e9aebdbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:22:26.289258 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b26e8-2bd9-4e98-ab07-be55e9aebdbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:26.289537 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b26e8-2bd9-4e98-ab07-be55e9aebdbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:26.289807 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b26e8-2bd9-4e98-ab07-be55e9aebdbe admin admin] PATH_INFO: `/v3/projects/8ee09b83520e4e8ba691a79d60604388` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:26.291027 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2b26e8-2bd9-4e98-ab07-be55e9aebdbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ee09b83520e4e8ba691a79d60604388)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:22:26.293136 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2b26e8-2bd9-4e98-ab07-be55e9aebdbe admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:22:26.354466 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-5d2b26e8-2bd9-4e98-ab07-be55e9aebdbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ee09b83520e4e8ba691a79d60604388', 'request_id': 'req-5d2b26e8-2bd9-4e98-ab07-be55e9aebdbe'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:22:26.364664 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-5d2b26e8-2bd9-4e98-ab07-be55e9aebdbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ee09b83520e4e8ba691a79d60604388', 'request_id': 'req-5d2b26e8-2bd9-4e98-ab07-be55e9aebdbe'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:22:26.383126 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-5d2b26e8-2bd9-4e98-ab07-be55e9aebdbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ee09b83520e4e8ba691a79d60604388', 'request_id': 'req-5d2b26e8-2bd9-4e98-ab07-be55e9aebdbe'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:22:26.402344 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-5d2b26e8-2bd9-4e98-ab07-be55e9aebdbe admin admin] The token cache is being invalidate because project 8ee09b83520e4e8ba691a79d60604388 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79961) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 07:22:26.402344 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-5d2b26e8-2bd9-4e98-ab07-be55e9aebdbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:22:26.403793 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-5d2b26e8-2bd9-4e98-ab07-be55e9aebdbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:22:26.407894 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1300/2595] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Mar 30 07:22:26 2022] DELETE /identity/v3/projects/8ee09b83520e4e8ba691a79d60604388 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:22:26.411169 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b926c3b-4dbc-4d08-8548-24b2f430580d None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:26.411452 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b926c3b-4dbc-4d08-8548-24b2f430580d None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:26.412045 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b926c3b-4dbc-4d08-8548-24b2f430580d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:26.454239 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-7b926c3b-4dbc-4d08-8548-24b2f430580d None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:22:26.455553 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-7b926c3b-4dbc-4d08-8548-24b2f430580d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:22:26.555420 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9d1cd5-f906-4ff0-ae56-79a26d3de93f None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:26.555908 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9d1cd5-f906-4ff0-ae56-79a26d3de93f None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:26.556319 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9d1cd5-f906-4ff0-ae56-79a26d3de93f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:26.558843 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1296/2596] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:22:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:22:26.578736 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-7d9d1cd5-f906-4ff0-ae56-79a26d3de93f None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:22:26.580326 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-7d9d1cd5-f906-4ff0-ae56-79a26d3de93f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:22:26.594603 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b926c3b-4dbc-4d08-8548-24b2f430580d None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:22:26.595531 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1301/2597] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:22:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:22:26.606354 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b926c3b-4dbc-4d08-8548-24b2f430580d None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:22:26.611320 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9e22f6-34bc-4b3e-b0c1-b969bc53241d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:22:26.612384 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9e22f6-34bc-4b3e-b0c1-b969bc53241d admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:26.612723 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9e22f6-34bc-4b3e-b0c1-b969bc53241d admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:26.613084 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9e22f6-34bc-4b3e-b0c1-b969bc53241d admin admin] PATH_INFO: `/v3/domains` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:26.614033 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9e22f6-34bc-4b3e-b0c1-b969bc53241d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:22:26.616533 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9e22f6-34bc-4b3e-b0c1-b969bc53241d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:22:26.616724 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9e22f6-34bc-4b3e-b0c1-b969bc53241d admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:22:26.638367 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9d1cd5-f906-4ff0-ae56-79a26d3de93f None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:22:26.649085 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9d1cd5-f906-4ff0-ae56-79a26d3de93f None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:22:26.649676 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1297/2598] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Mar 30 07:22:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:22:26.654951 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc9b748-20ac-4f4a-a6a2-b42f4ad403d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:22:26.655900 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc9b748-20ac-4f4a-a6a2-b42f4ad403d9 admin admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:26.656437 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc9b748-20ac-4f4a-a6a2-b42f4ad403d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:26.656961 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc9b748-20ac-4f4a-a6a2-b42f4ad403d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:26.659033 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc9b748-20ac-4f4a-a6a2-b42f4ad403d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:22:26.661395 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc9b748-20ac-4f4a-a6a2-b42f4ad403d9 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:22:26.717938 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1302/2599] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Mar 30 07:22:26 2022] POST /identity/v3/projects => generated 381 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:22:26.722429 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9e22f6-34bc-4b3e-b0c1-b969bc53241d admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:22:26.736844 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9e22f6-34bc-4b3e-b0c1-b969bc53241d admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:22:26.828511 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb0d0e7-1e5c-47f2-84b7-8b8d028b043e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:22:26.829424 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb0d0e7-1e5c-47f2-84b7-8b8d028b043e admin admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:26.829865 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb0d0e7-1e5c-47f2-84b7-8b8d028b043e admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:26.830288 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb0d0e7-1e5c-47f2-84b7-8b8d028b043e admin admin] PATH_INFO: `/v3/users` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:26.831300 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb0d0e7-1e5c-47f2-84b7-8b8d028b043e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:22:26.834513 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb0d0e7-1e5c-47f2-84b7-8b8d028b043e admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:22:26.866130 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1298/2600] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Mar 30 07:22:26 2022] POST /identity/v3/users => generated 291 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:22:26.870707 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc9b748-20ac-4f4a-a6a2-b42f4ad403d9 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:22:26.889446 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc9b748-20ac-4f4a-a6a2-b42f4ad403d9 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:22:26.898525 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0431b4-f352-46f5-a090-94b120bf47a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:22:26.899362 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0431b4-f352-46f5-a090-94b120bf47a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:26.899684 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0431b4-f352-46f5-a090-94b120bf47a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:26.900147 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0431b4-f352-46f5-a090-94b120bf47a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:26.900874 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0431b4-f352-46f5-a090-94b120bf47a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:22:26.902708 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0431b4-f352-46f5-a090-94b120bf47a3 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:22:26.922067 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1303/2601] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:22:26 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 30 07:22:26.925846 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb0d0e7-1e5c-47f2-84b7-8b8d028b043e admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:22:26.954913 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb0d0e7-1e5c-47f2-84b7-8b8d028b043e admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:22:26.965479 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b192bd97-233a-4aa2-87c0-5d21c38d38ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:22:26.965479 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b192bd97-233a-4aa2-87c0-5d21c38d38ff admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:26.966533 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b192bd97-233a-4aa2-87c0-5d21c38d38ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:26.967649 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b192bd97-233a-4aa2-87c0-5d21c38d38ff admin admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:26.968522 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b192bd97-233a-4aa2-87c0-5d21c38d38ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:22:26.970821 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b192bd97-233a-4aa2-87c0-5d21c38d38ff admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:22:26.984325 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1299/2602] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:22:26 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 30 07:22:26.988311 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0431b4-f352-46f5-a090-94b120bf47a3 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:22:27.018743 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0431b4-f352-46f5-a090-94b120bf47a3 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:22:27.035103 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d34e837-d42a-4790-8cbf-55dd3058caf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:22:27.036408 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d34e837-d42a-4790-8cbf-55dd3058caf2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:27.036756 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d34e837-d42a-4790-8cbf-55dd3058caf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:27.037251 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d34e837-d42a-4790-8cbf-55dd3058caf2 admin admin] PATH_INFO: `/v3/projects/5076625dc75549cda91111376ed08ae3/users/fb4fe7663c214240bec346ba36b641e4/roles/5d79031a64754b57ba120367465e2252` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:27.064441 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d34e837-d42a-4790-8cbf-55dd3058caf2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5076625dc75549cda91111376ed08ae3, user_id=fb4fe7663c214240bec346ba36b641e4, role_id=5d79031a64754b57ba120367465e2252)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:22:27.067524 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d34e837-d42a-4790-8cbf-55dd3058caf2 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:22:27.104161 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1304/2603] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:22:26 2022] PUT /identity/v3/projects/5076625dc75549cda91111376ed08ae3/users/fb4fe7663c214240bec346ba36b641e4/roles/5d79031a64754b57ba120367465e2252 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:22:27.108138 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c4aa98-453f-4d9a-a60f-cdad803a6260 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:27.108359 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c4aa98-453f-4d9a-a60f-cdad803a6260 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:27.108718 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c4aa98-453f-4d9a-a60f-cdad803a6260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:27.201001 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-f7c4aa98-453f-4d9a-a60f-cdad803a6260 None None] MFA Rules not processed for user `fb4fe7663c214240bec346ba36b641e4`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:22:27.215285 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-f7c4aa98-453f-4d9a-a60f-cdad803a6260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:22:27.489278 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1300/2604] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:22:27 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 382 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:22:27.494997 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d34e837-d42a-4790-8cbf-55dd3058caf2 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:22:27.621666 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d34e837-d42a-4790-8cbf-55dd3058caf2 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:22:27.626944 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e97357-5209-407a-8bb4-ccbf36f1a70b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:22:27.627910 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e97357-5209-407a-8bb4-ccbf36f1a70b admin admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:27.628543 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e97357-5209-407a-8bb4-ccbf36f1a70b admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:27.628979 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e97357-5209-407a-8bb4-ccbf36f1a70b admin admin] PATH_INFO: `/v3/projects` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:27.629831 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e97357-5209-407a-8bb4-ccbf36f1a70b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:22:27.632121 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e97357-5209-407a-8bb4-ccbf36f1a70b admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:22:27.665417 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1305/2605] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Mar 30 07:22:27 2022] POST /identity/v3/projects => generated 381 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:22:27.669816 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c4aa98-453f-4d9a-a60f-cdad803a6260 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:22:27.684336 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c4aa98-453f-4d9a-a60f-cdad803a6260 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:22:27.777679 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dd52d9-dbf8-46b3-856d-ac4db3198a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:22:27.779292 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd52d9-dbf8-46b3-856d-ac4db3198a22 admin admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:27.779919 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd52d9-dbf8-46b3-856d-ac4db3198a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:27.780504 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd52d9-dbf8-46b3-856d-ac4db3198a22 admin admin] PATH_INFO: `/v3/users` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:27.781371 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dd52d9-dbf8-46b3-856d-ac4db3198a22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:22:27.783631 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dd52d9-dbf8-46b3-856d-ac4db3198a22 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:22:27.830858 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e97357-5209-407a-8bb4-ccbf36f1a70b admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:22:27.841774 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1301/2606] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Mar 30 07:22:27 2022] POST /identity/v3/users => generated 297 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 07:22:27.843925 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e97357-5209-407a-8bb4-ccbf36f1a70b admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:22:27.848928 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c503f41c-b250-4371-abb9-45dcb855fa8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:22:27.850386 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c503f41c-b250-4371-abb9-45dcb855fa8c admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:27.850742 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c503f41c-b250-4371-abb9-45dcb855fa8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:27.851085 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c503f41c-b250-4371-abb9-45dcb855fa8c admin admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:27.854586 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c503f41c-b250-4371-abb9-45dcb855fa8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:22:27.862245 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c503f41c-b250-4371-abb9-45dcb855fa8c admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:22:27.884329 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dd52d9-dbf8-46b3-856d-ac4db3198a22 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:22:27.894524 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1306/2607] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:22:27 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:22:27.896456 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dd52d9-dbf8-46b3-856d-ac4db3198a22 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:22:27.902248 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b263a4c-95fd-4244-af0a-d03c254e9a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:22:27.903245 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b263a4c-95fd-4244-af0a-d03c254e9a23 admin admin] REQUEST_METHOD: `PUT` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:27.903625 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b263a4c-95fd-4244-af0a-d03c254e9a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:27.904973 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b263a4c-95fd-4244-af0a-d03c254e9a23 admin admin] PATH_INFO: `/v3/projects/821472c496aa4c45ac79d1a7ade89adc/users/e081963aeacc428f97ea26c7c6b28056/roles/1c39b9ab8cfd4c0ea71845831920a845` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:27.927197 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b263a4c-95fd-4244-af0a-d03c254e9a23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=821472c496aa4c45ac79d1a7ade89adc, user_id=e081963aeacc428f97ea26c7c6b28056, role_id=1c39b9ab8cfd4c0ea71845831920a845)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:22:27.930286 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b263a4c-95fd-4244-af0a-d03c254e9a23 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:22:27.966367 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c503f41c-b250-4371-abb9-45dcb855fa8c admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:22:27.966830 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1302/2608] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:22:27 2022] PUT /identity/v3/projects/821472c496aa4c45ac79d1a7ade89adc/users/e081963aeacc428f97ea26c7c6b28056/roles/1c39b9ab8cfd4c0ea71845831920a845 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:22:27.981739 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c503f41c-b250-4371-abb9-45dcb855fa8c admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:22:28.093264 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c23bee9-6b61-4746-bf11-0add6d13bd98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:22:28.094794 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c23bee9-6b61-4746-bf11-0add6d13bd98 admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:28.095247 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c23bee9-6b61-4746-bf11-0add6d13bd98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:28.095677 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c23bee9-6b61-4746-bf11-0add6d13bd98 admin admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:28.096652 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c23bee9-6b61-4746-bf11-0add6d13bd98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:22:28.098460 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c23bee9-6b61-4746-bf11-0add6d13bd98 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:22:28.115763 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1307/2609] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:22:27 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:22:28.116726 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b263a4c-95fd-4244-af0a-d03c254e9a23 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:22:28.132562 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b263a4c-95fd-4244-af0a-d03c254e9a23 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:22:28.139210 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea3587e-8675-4a2f-9ac0-bfd3294d3417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:22:28.140185 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea3587e-8675-4a2f-9ac0-bfd3294d3417 admin admin] REQUEST_METHOD: `PUT` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:28.140532 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea3587e-8675-4a2f-9ac0-bfd3294d3417 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:28.140876 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea3587e-8675-4a2f-9ac0-bfd3294d3417 admin admin] PATH_INFO: `/v3/projects/821472c496aa4c45ac79d1a7ade89adc/users/e081963aeacc428f97ea26c7c6b28056/roles/1c39b9ab8cfd4c0ea71845831920a845` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:28.143733 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea3587e-8675-4a2f-9ac0-bfd3294d3417 admin admin] RBAC: Authorizing `identity:create_grant(project_id=821472c496aa4c45ac79d1a7ade89adc, user_id=e081963aeacc428f97ea26c7c6b28056, role_id=1c39b9ab8cfd4c0ea71845831920a845)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:22:28.146588 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea3587e-8675-4a2f-9ac0-bfd3294d3417 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:22:28.163451 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1303/2610] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:22:28 2022] PUT /identity/v3/projects/821472c496aa4c45ac79d1a7ade89adc/users/e081963aeacc428f97ea26c7c6b28056/roles/1c39b9ab8cfd4c0ea71845831920a845 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 07:22:28.173803 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6279c957-c834-471c-bd82-e02390e9a9bb None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:28.174501 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6279c957-c834-471c-bd82-e02390e9a9bb None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:28.174984 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6279c957-c834-471c-bd82-e02390e9a9bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:28.215884 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-6279c957-c834-471c-bd82-e02390e9a9bb None None] MFA Rules not processed for user `e081963aeacc428f97ea26c7c6b28056`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:22:28.217108 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-6279c957-c834-471c-bd82-e02390e9a9bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:22:28.328984 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1308/2611] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:22:28 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:22:28.341971 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea3587e-8675-4a2f-9ac0-bfd3294d3417 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:22:28.343722 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-dea3587e-8675-4a2f-9ac0-bfd3294d3417 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:22:28.423285 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea3587e-8675-4a2f-9ac0-bfd3294d3417 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:22:28.434797 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8485e256-2d6e-4008-9a7e-7b6c0ecf8f90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e2fda180e8d448d895c40cdad34bc4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:22:28.436593 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485e256-2d6e-4008-9a7e-7b6c0ecf8f90 service cinder] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:28.436875 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485e256-2d6e-4008-9a7e-7b6c0ecf8f90 service cinder] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:28.437162 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485e256-2d6e-4008-9a7e-7b6c0ecf8f90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:28.456822 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8485e256-2d6e-4008-9a7e-7b6c0ecf8f90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:22:28.458591 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8485e256-2d6e-4008-9a7e-7b6c0ecf8f90 service cinder] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:22:28.472078 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1304/2612] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:22:28 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:22:28.583522 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6279c957-c834-471c-bd82-e02390e9a9bb None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:22:28.598692 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6279c957-c834-471c-bd82-e02390e9a9bb None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:22:28.603943 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04bda99-3119-4922-8d8c-e1d5093df1d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e2fda180e8d448d895c40cdad34bc4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:22:28.604885 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04bda99-3119-4922-8d8c-e1d5093df1d2 service cinder] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:28.605376 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04bda99-3119-4922-8d8c-e1d5093df1d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:28.605807 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04bda99-3119-4922-8d8c-e1d5093df1d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:28.697467 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04bda99-3119-4922-8d8c-e1d5093df1d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:22:28.702810 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04bda99-3119-4922-8d8c-e1d5093df1d2 service cinder] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:22:28.717095 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1309/2613] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:22:28 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:22:29.251079 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce6c3d0-aa96-49dd-8b38-1f7a82c3dace None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:29.251583 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce6c3d0-aa96-49dd-8b38-1f7a82c3dace None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:29.251689 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce6c3d0-aa96-49dd-8b38-1f7a82c3dace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:29.277035 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-3ce6c3d0-aa96-49dd-8b38-1f7a82c3dace None None] MFA Rules not processed for user `38e427dd29ea4380b01a1c257cc3da00`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:22:29.278266 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-3ce6c3d0-aa96-49dd-8b38-1f7a82c3dace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:22:29.355862 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1305/2614] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:22:29 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:22:30.566977 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90a7ac6-481d-4298-ba53-9dbf7734e28b None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:30.567513 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90a7ac6-481d-4298-ba53-9dbf7734e28b None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:30.567678 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90a7ac6-481d-4298-ba53-9dbf7734e28b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:30.588803 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-a90a7ac6-481d-4298-ba53-9dbf7734e28b None None] MFA Rules not processed for user `f52cc2951a1c4a11a369acd769c78db1`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:22:30.591087 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-a90a7ac6-481d-4298-ba53-9dbf7734e28b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:22:30.707942 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1310/2615] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:22:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:22:35.994231 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4b2ec7-54d0-4054-8246-38a09ef0580d None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:35.994734 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4b2ec7-54d0-4054-8246-38a09ef0580d None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:35.994839 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4b2ec7-54d0-4054-8246-38a09ef0580d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:36.014622 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-5e4b2ec7-54d0-4054-8246-38a09ef0580d None None] MFA Rules not processed for user `67102c1adcf0491e9ecdef970ab2d5ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:22:36.015957 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-5e4b2ec7-54d0-4054-8246-38a09ef0580d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:22:36.078084 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1306/2616] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Mar 30 07:22:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:22:36.093888 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90a7ac6-481d-4298-ba53-9dbf7734e28b None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:22:36.095289 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-a90a7ac6-481d-4298-ba53-9dbf7734e28b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:22:36.164481 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90a7ac6-481d-4298-ba53-9dbf7734e28b None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:22:36.170149 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad53305-bfcb-4dde-944c-b790ec88cb1b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c452249c502d4b0688e8dd068f8c4951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:22:36.170644 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad53305-bfcb-4dde-944c-b790ec88cb1b service swift] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:36.171123 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad53305-bfcb-4dde-944c-b790ec88cb1b service swift] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:36.171546 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad53305-bfcb-4dde-944c-b790ec88cb1b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:36.180748 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad53305-bfcb-4dde-944c-b790ec88cb1b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:22:36.182352 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad53305-bfcb-4dde-944c-b790ec88cb1b service swift] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:22:36.190698 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1311/2617] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Mar 30 07:22:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 30 07:22:38.436961 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4b2ec7-54d0-4054-8246-38a09ef0580d None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:22:38.499731 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4b2ec7-54d0-4054-8246-38a09ef0580d None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:22:38.504432 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2fce50-952c-4885-a320-438d781ec9f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:22:38.505327 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2fce50-952c-4885-a320-438d781ec9f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:38.505600 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2fce50-952c-4885-a320-438d781ec9f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:38.505874 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2fce50-952c-4885-a320-438d781ec9f8 admin admin] PATH_INFO: `/v3/users/fb4fe7663c214240bec346ba36b641e4` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:38.507227 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2fce50-952c-4885-a320-438d781ec9f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb4fe7663c214240bec346ba36b641e4)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:22:38.509326 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2fce50-952c-4885-a320-438d781ec9f8 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:22:38.556309 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-6f2fce50-952c-4885-a320-438d781ec9f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb4fe7663c214240bec346ba36b641e4'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:22:38.556972 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-6f2fce50-952c-4885-a320-438d781ec9f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb4fe7663c214240bec346ba36b641e4'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:22:38.564489 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-6f2fce50-952c-4885-a320-438d781ec9f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb4fe7663c214240bec346ba36b641e4'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:22:38.577012 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-6f2fce50-952c-4885-a320-438d781ec9f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb4fe7663c214240bec346ba36b641e4'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:22:38.577667 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-6f2fce50-952c-4885-a320-438d781ec9f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb4fe7663c214240bec346ba36b641e4'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:22:38.591200 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1307/2618] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Mar 30 07:22:38 2022] DELETE /identity/v3/users/fb4fe7663c214240bec346ba36b641e4 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:22:38.596860 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ff793-5f92-42de-9a73-3de63b50ea9d None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:38.597352 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ff793-5f92-42de-9a73-3de63b50ea9d None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:38.597473 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ff793-5f92-42de-9a73-3de63b50ea9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:38.620506 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-377ff793-5f92-42de-9a73-3de63b50ea9d None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:22:38.622033 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-377ff793-5f92-42de-9a73-3de63b50ea9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:22:38.699043 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1312/2619] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:22:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:22:38.705790 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2fce50-952c-4885-a320-438d781ec9f8 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:22:38.707516 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-6f2fce50-952c-4885-a320-438d781ec9f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:22:38.768670 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2fce50-952c-4885-a320-438d781ec9f8 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:22:38.772683 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1652b6a-2422-4992-9041-bd83a4bb86ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3802cb341445f994b9204744060ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:22:38.773347 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1652b6a-2422-4992-9041-bd83a4bb86ab service neutron] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:38.773627 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1652b6a-2422-4992-9041-bd83a4bb86ab service neutron] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:38.773899 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1652b6a-2422-4992-9041-bd83a4bb86ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:38.783317 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1652b6a-2422-4992-9041-bd83a4bb86ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:22:38.784768 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1652b6a-2422-4992-9041-bd83a4bb86ab service neutron] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:22:38.794034 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1308/2620] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:22:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:22:39.110311 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377ff793-5f92-42de-9a73-3de63b50ea9d None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:22:39.111983 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-377ff793-5f92-42de-9a73-3de63b50ea9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:22:39.124825 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377ff793-5f92-42de-9a73-3de63b50ea9d None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:22:39.129584 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad446ab-654f-4b13-b32d-6d27dabdfa89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:22:39.130460 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad446ab-654f-4b13-b32d-6d27dabdfa89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:39.130740 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad446ab-654f-4b13-b32d-6d27dabdfa89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:39.131037 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad446ab-654f-4b13-b32d-6d27dabdfa89 admin admin] PATH_INFO: `/v3/projects/5076625dc75549cda91111376ed08ae3` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:39.132484 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad446ab-654f-4b13-b32d-6d27dabdfa89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5076625dc75549cda91111376ed08ae3)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:22:39.134669 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad446ab-654f-4b13-b32d-6d27dabdfa89 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:22:39.182128 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-4ad446ab-654f-4b13-b32d-6d27dabdfa89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5076625dc75549cda91111376ed08ae3', 'request_id': 'req-4ad446ab-654f-4b13-b32d-6d27dabdfa89'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:22:39.187332 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-4ad446ab-654f-4b13-b32d-6d27dabdfa89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5076625dc75549cda91111376ed08ae3', 'request_id': 'req-4ad446ab-654f-4b13-b32d-6d27dabdfa89'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:22:39.196180 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-4ad446ab-654f-4b13-b32d-6d27dabdfa89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5076625dc75549cda91111376ed08ae3', 'request_id': 'req-4ad446ab-654f-4b13-b32d-6d27dabdfa89'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:22:39.207768 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-4ad446ab-654f-4b13-b32d-6d27dabdfa89 admin admin] The token cache is being invalidate because project 5076625dc75549cda91111376ed08ae3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79961) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 07:22:39.208025 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-4ad446ab-654f-4b13-b32d-6d27dabdfa89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:22:39.208747 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-4ad446ab-654f-4b13-b32d-6d27dabdfa89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:22:39.210474 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1313/2621] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Mar 30 07:22:39 2022] DELETE /identity/v3/projects/5076625dc75549cda91111376ed08ae3 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:22:39.215161 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1652b6a-2422-4992-9041-bd83a4bb86ab service neutron] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:22:39.225677 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1652b6a-2422-4992-9041-bd83a4bb86ab service neutron] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:22:39.286675 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685cecaa-5bad-4cfd-99a3-7d5ecbbbc9a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:22:39.287560 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685cecaa-5bad-4cfd-99a3-7d5ecbbbc9a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:39.287869 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685cecaa-5bad-4cfd-99a3-7d5ecbbbc9a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:39.288343 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685cecaa-5bad-4cfd-99a3-7d5ecbbbc9a1 admin admin] PATH_INFO: `/v3/users/e081963aeacc428f97ea26c7c6b28056` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:39.289558 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685cecaa-5bad-4cfd-99a3-7d5ecbbbc9a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e081963aeacc428f97ea26c7c6b28056)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:22:39.291459 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685cecaa-5bad-4cfd-99a3-7d5ecbbbc9a1 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:22:39.354874 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-685cecaa-5bad-4cfd-99a3-7d5ecbbbc9a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e081963aeacc428f97ea26c7c6b28056'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:22:39.355633 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-685cecaa-5bad-4cfd-99a3-7d5ecbbbc9a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e081963aeacc428f97ea26c7c6b28056'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:22:39.369861 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-685cecaa-5bad-4cfd-99a3-7d5ecbbbc9a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e081963aeacc428f97ea26c7c6b28056'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:22:39.385684 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-685cecaa-5bad-4cfd-99a3-7d5ecbbbc9a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e081963aeacc428f97ea26c7c6b28056'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:22:39.386639 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-685cecaa-5bad-4cfd-99a3-7d5ecbbbc9a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e081963aeacc428f97ea26c7c6b28056'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:22:39.405626 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1309/2622] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Mar 30 07:22:39 2022] DELETE /identity/v3/users/e081963aeacc428f97ea26c7c6b28056 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:22:39.726297 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad446ab-654f-4b13-b32d-6d27dabdfa89 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:22:39.728199 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-4ad446ab-654f-4b13-b32d-6d27dabdfa89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:22:39.749204 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad446ab-654f-4b13-b32d-6d27dabdfa89 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:22:39.823717 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d2c4ae-c2ae-4f83-93fa-79b8a8fe5058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:22:39.824610 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d2c4ae-c2ae-4f83-93fa-79b8a8fe5058 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:39.824881 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d2c4ae-c2ae-4f83-93fa-79b8a8fe5058 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:39.825143 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d2c4ae-c2ae-4f83-93fa-79b8a8fe5058 admin admin] PATH_INFO: `/v3/projects/821472c496aa4c45ac79d1a7ade89adc` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:39.826299 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d2c4ae-c2ae-4f83-93fa-79b8a8fe5058 admin admin] RBAC: Authorizing `identity:delete_project(project_id=821472c496aa4c45ac79d1a7ade89adc)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:22:39.828243 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d2c4ae-c2ae-4f83-93fa-79b8a8fe5058 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:22:39.877860 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-f8d2c4ae-c2ae-4f83-93fa-79b8a8fe5058 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '821472c496aa4c45ac79d1a7ade89adc', 'request_id': 'req-f8d2c4ae-c2ae-4f83-93fa-79b8a8fe5058'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:22:39.884287 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-f8d2c4ae-c2ae-4f83-93fa-79b8a8fe5058 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '821472c496aa4c45ac79d1a7ade89adc', 'request_id': 'req-f8d2c4ae-c2ae-4f83-93fa-79b8a8fe5058'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:22:39.895894 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-f8d2c4ae-c2ae-4f83-93fa-79b8a8fe5058 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '821472c496aa4c45ac79d1a7ade89adc', 'request_id': 'req-f8d2c4ae-c2ae-4f83-93fa-79b8a8fe5058'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:22:39.908344 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-f8d2c4ae-c2ae-4f83-93fa-79b8a8fe5058 admin admin] The token cache is being invalidate because project 821472c496aa4c45ac79d1a7ade89adc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79961) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 07:22:39.908625 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-f8d2c4ae-c2ae-4f83-93fa-79b8a8fe5058 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:22:39.909342 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-f8d2c4ae-c2ae-4f83-93fa-79b8a8fe5058 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:22:39.910965 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1314/2623] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Mar 30 07:22:39 2022] DELETE /identity/v3/projects/821472c496aa4c45ac79d1a7ade89adc => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:22:39.916972 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1650d5d9-935c-483e-94bb-a687dfb62c6d None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:39.917471 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1650d5d9-935c-483e-94bb-a687dfb62c6d None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:39.917567 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1650d5d9-935c-483e-94bb-a687dfb62c6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:39.935320 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-1650d5d9-935c-483e-94bb-a687dfb62c6d None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:22:39.936541 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-1650d5d9-935c-483e-94bb-a687dfb62c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:22:40.000443 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1310/2624] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:22:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:22:40.008847 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b647568-25ad-4d09-a164-32452dbe9346 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:40.009130 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b647568-25ad-4d09-a164-32452dbe9346 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:40.009402 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b647568-25ad-4d09-a164-32452dbe9346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:40.030638 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-7b647568-25ad-4d09-a164-32452dbe9346 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:22:40.032263 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-7b647568-25ad-4d09-a164-32452dbe9346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:22:40.046271 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1315/2625] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:22:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:22:40.051770 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1650d5d9-935c-483e-94bb-a687dfb62c6d None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:22:40.064141 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1650d5d9-935c-483e-94bb-a687dfb62c6d None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:22:40.070620 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592332b7-ed7c-4e83-b6da-e057a27bacd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:22:40.071385 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592332b7-ed7c-4e83-b6da-e057a27bacd3 admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:40.071670 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592332b7-ed7c-4e83-b6da-e057a27bacd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:40.072051 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592332b7-ed7c-4e83-b6da-e057a27bacd3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:40.072857 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592332b7-ed7c-4e83-b6da-e057a27bacd3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:22:40.073169 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592332b7-ed7c-4e83-b6da-e057a27bacd3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:22:40.075077 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592332b7-ed7c-4e83-b6da-e057a27bacd3 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:22:40.091863 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1311/2626] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Mar 30 07:22:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:22:40.093099 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b647568-25ad-4d09-a164-32452dbe9346 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:22:40.103223 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b647568-25ad-4d09-a164-32452dbe9346 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:22:40.110290 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406651ec-3546-4a2b-9d6e-5c4461bb5032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:22:40.111354 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406651ec-3546-4a2b-9d6e-5c4461bb5032 admin admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:40.111899 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406651ec-3546-4a2b-9d6e-5c4461bb5032 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:40.112393 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406651ec-3546-4a2b-9d6e-5c4461bb5032 admin admin] PATH_INFO: `/v3/projects` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:40.113332 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406651ec-3546-4a2b-9d6e-5c4461bb5032 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:22:40.115481 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406651ec-3546-4a2b-9d6e-5c4461bb5032 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:22:40.149888 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1316/2627] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Mar 30 07:22:40 2022] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 07:22:40.151022 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592332b7-ed7c-4e83-b6da-e057a27bacd3 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:22:40.161430 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592332b7-ed7c-4e83-b6da-e057a27bacd3 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:22:40.305351 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc57a24f-5415-42f7-88db-b891a2e2a20e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:22:40.306077 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc57a24f-5415-42f7-88db-b891a2e2a20e admin admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:40.306362 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc57a24f-5415-42f7-88db-b891a2e2a20e admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:40.306641 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc57a24f-5415-42f7-88db-b891a2e2a20e admin admin] PATH_INFO: `/v3/users` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:40.307354 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc57a24f-5415-42f7-88db-b891a2e2a20e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:22:40.309518 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc57a24f-5415-42f7-88db-b891a2e2a20e admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:22:40.332795 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1312/2628] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Mar 30 07:22:40 2022] POST /identity/v3/users => generated 293 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:22:40.337088 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406651ec-3546-4a2b-9d6e-5c4461bb5032 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:22:40.349800 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406651ec-3546-4a2b-9d6e-5c4461bb5032 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:22:40.356183 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9de0956-86e1-4542-9d29-9827d9543f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:22:40.364735 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de0956-86e1-4542-9d29-9827d9543f69 admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:40.365151 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de0956-86e1-4542-9d29-9827d9543f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:40.365531 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de0956-86e1-4542-9d29-9827d9543f69 admin admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:40.366534 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9de0956-86e1-4542-9d29-9827d9543f69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:22:40.368341 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9de0956-86e1-4542-9d29-9827d9543f69 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:22:40.380260 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1317/2629] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:22:40 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 30 07:22:40.384869 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc57a24f-5415-42f7-88db-b891a2e2a20e admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:22:40.395229 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc57a24f-5415-42f7-88db-b891a2e2a20e admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:22:40.400357 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80b7c0b-444b-4742-a788-76c39da3bc45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:22:40.401039 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b7c0b-444b-4742-a788-76c39da3bc45 admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:40.401320 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b7c0b-444b-4742-a788-76c39da3bc45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:40.401756 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b7c0b-444b-4742-a788-76c39da3bc45 admin admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:40.402619 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80b7c0b-444b-4742-a788-76c39da3bc45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:22:40.404359 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80b7c0b-444b-4742-a788-76c39da3bc45 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:22:40.415880 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1313/2630] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:22:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:22:40.419592 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9de0956-86e1-4542-9d29-9827d9543f69 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:22:40.431350 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9de0956-86e1-4542-9d29-9827d9543f69 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:22:40.436231 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc1c493-a3a2-4aaa-934d-a8b57adee5f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:22:40.437145 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc1c493-a3a2-4aaa-934d-a8b57adee5f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:40.437407 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc1c493-a3a2-4aaa-934d-a8b57adee5f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:40.437679 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc1c493-a3a2-4aaa-934d-a8b57adee5f4 admin admin] PATH_INFO: `/v3/projects/fc76ac7874334cc1bccdb197951f6316/users/428512b6939f41f59d2b9de9642c3759/roles/5d79031a64754b57ba120367465e2252` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:40.453427 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc1c493-a3a2-4aaa-934d-a8b57adee5f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc76ac7874334cc1bccdb197951f6316, user_id=428512b6939f41f59d2b9de9642c3759, role_id=5d79031a64754b57ba120367465e2252)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:22:40.456099 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc1c493-a3a2-4aaa-934d-a8b57adee5f4 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:22:40.469760 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1318/2631] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:22:40 2022] PUT /identity/v3/projects/fc76ac7874334cc1bccdb197951f6316/users/428512b6939f41f59d2b9de9642c3759/roles/5d79031a64754b57ba120367465e2252 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:22:40.482081 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8bff6f-f22a-4d5e-abd3-34016a5a98fa None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:40.482367 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8bff6f-f22a-4d5e-abd3-34016a5a98fa None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:40.482635 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8bff6f-f22a-4d5e-abd3-34016a5a98fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:40.510755 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-3e8bff6f-f22a-4d5e-abd3-34016a5a98fa None None] MFA Rules not processed for user `428512b6939f41f59d2b9de9642c3759`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:22:40.512009 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-3e8bff6f-f22a-4d5e-abd3-34016a5a98fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:22:40.622600 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1314/2632] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:22:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:22:40.627001 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc1c493-a3a2-4aaa-934d-a8b57adee5f4 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:22:40.710986 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc1c493-a3a2-4aaa-934d-a8b57adee5f4 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:22:40.716759 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8b327f-1c85-4815-8def-1d51f799f04e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:22:40.717608 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8b327f-1c85-4815-8def-1d51f799f04e admin admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:40.717874 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8b327f-1c85-4815-8def-1d51f799f04e admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:40.718183 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8b327f-1c85-4815-8def-1d51f799f04e admin admin] PATH_INFO: `/v3/projects` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:40.718954 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8b327f-1c85-4815-8def-1d51f799f04e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:22:40.721219 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8b327f-1c85-4815-8def-1d51f799f04e admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:22:40.763888 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1319/2633] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Mar 30 07:22:40 2022] POST /identity/v3/projects => generated 385 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:22:40.766003 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8bff6f-f22a-4d5e-abd3-34016a5a98fa None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:22:40.779958 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8bff6f-f22a-4d5e-abd3-34016a5a98fa None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:22:40.839899 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa15b31-4c4a-450b-9086-28ddc5bfdc05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:22:40.840583 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa15b31-4c4a-450b-9086-28ddc5bfdc05 admin admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:40.840864 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa15b31-4c4a-450b-9086-28ddc5bfdc05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:40.841139 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa15b31-4c4a-450b-9086-28ddc5bfdc05 admin admin] PATH_INFO: `/v3/users` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:40.841826 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa15b31-4c4a-450b-9086-28ddc5bfdc05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:22:40.843799 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa15b31-4c4a-450b-9086-28ddc5bfdc05 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:22:40.868132 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1315/2634] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Mar 30 07:22:40 2022] POST /identity/v3/users => generated 299 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 07:22:40.869257 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8b327f-1c85-4815-8def-1d51f799f04e admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:22:40.879334 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8b327f-1c85-4815-8def-1d51f799f04e admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:22:40.884213 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6eb3ec-8619-4415-b111-fd1640b021f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:22:40.884863 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6eb3ec-8619-4415-b111-fd1640b021f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:40.885150 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6eb3ec-8619-4415-b111-fd1640b021f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:40.885414 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6eb3ec-8619-4415-b111-fd1640b021f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:40.886160 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6eb3ec-8619-4415-b111-fd1640b021f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:22:40.887764 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6eb3ec-8619-4415-b111-fd1640b021f4 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:22:40.898539 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1320/2635] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:22:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 30 07:22:40.902577 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa15b31-4c4a-450b-9086-28ddc5bfdc05 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:22:40.912848 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa15b31-4c4a-450b-9086-28ddc5bfdc05 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:22:40.917980 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bf0f25-afe3-4fc5-a98f-e7cd758062e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:22:40.918860 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bf0f25-afe3-4fc5-a98f-e7cd758062e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:40.919141 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bf0f25-afe3-4fc5-a98f-e7cd758062e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:40.919398 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bf0f25-afe3-4fc5-a98f-e7cd758062e2 admin admin] PATH_INFO: `/v3/projects/671914d0ef414e7cb31e31feb630a046/users/766221d069d0408a840f6b4abc11bfee/roles/1c39b9ab8cfd4c0ea71845831920a845` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:40.934243 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bf0f25-afe3-4fc5-a98f-e7cd758062e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=671914d0ef414e7cb31e31feb630a046, user_id=766221d069d0408a840f6b4abc11bfee, role_id=1c39b9ab8cfd4c0ea71845831920a845)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:22:40.936937 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bf0f25-afe3-4fc5-a98f-e7cd758062e2 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:22:40.951689 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1316/2636] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:22:40 2022] PUT /identity/v3/projects/671914d0ef414e7cb31e31feb630a046/users/766221d069d0408a840f6b4abc11bfee/roles/1c39b9ab8cfd4c0ea71845831920a845 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:22:40.955648 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6eb3ec-8619-4415-b111-fd1640b021f4 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:22:40.967687 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6eb3ec-8619-4415-b111-fd1640b021f4 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:22:41.046615 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37b9c4d-f43d-43e5-bc53-0dba71bfdb97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:22:41.047279 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b9c4d-f43d-43e5-bc53-0dba71bfdb97 admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:41.047561 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b9c4d-f43d-43e5-bc53-0dba71bfdb97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:41.047866 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b9c4d-f43d-43e5-bc53-0dba71bfdb97 admin admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:41.048601 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37b9c4d-f43d-43e5-bc53-0dba71bfdb97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:22:41.050207 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37b9c4d-f43d-43e5-bc53-0dba71bfdb97 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:22:41.060417 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1321/2637] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:22:40 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:22:41.065560 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bf0f25-afe3-4fc5-a98f-e7cd758062e2 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:22:41.082131 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bf0f25-afe3-4fc5-a98f-e7cd758062e2 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:22:41.087923 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089550d2-8dad-43bc-be06-1ba6389791b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:22:41.088847 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089550d2-8dad-43bc-be06-1ba6389791b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:41.089118 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089550d2-8dad-43bc-be06-1ba6389791b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:41.089413 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089550d2-8dad-43bc-be06-1ba6389791b2 admin admin] PATH_INFO: `/v3/projects/671914d0ef414e7cb31e31feb630a046/users/766221d069d0408a840f6b4abc11bfee/roles/1c39b9ab8cfd4c0ea71845831920a845` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:41.091691 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089550d2-8dad-43bc-be06-1ba6389791b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=671914d0ef414e7cb31e31feb630a046, user_id=766221d069d0408a840f6b4abc11bfee, role_id=1c39b9ab8cfd4c0ea71845831920a845)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:22:41.094455 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089550d2-8dad-43bc-be06-1ba6389791b2 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:22:41.118113 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1317/2638] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:22:41 2022] PUT /identity/v3/projects/671914d0ef414e7cb31e31feb630a046/users/766221d069d0408a840f6b4abc11bfee/roles/1c39b9ab8cfd4c0ea71845831920a845 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 07:22:41.128994 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e31c0-78a2-4255-96e7-628ed9c07439 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:41.129211 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e31c0-78a2-4255-96e7-628ed9c07439 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:41.129436 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e31c0-78a2-4255-96e7-628ed9c07439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:41.163820 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-e78e31c0-78a2-4255-96e7-628ed9c07439 None None] MFA Rules not processed for user `766221d069d0408a840f6b4abc11bfee`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:22:41.165089 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-e78e31c0-78a2-4255-96e7-628ed9c07439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:22:41.239583 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1322/2639] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:22:41 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:22:41.251095 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089550d2-8dad-43bc-be06-1ba6389791b2 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:22:41.252903 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-089550d2-8dad-43bc-be06-1ba6389791b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:22:41.311856 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089550d2-8dad-43bc-be06-1ba6389791b2 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:22:41.318213 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820b0540-30d8-4cf4-aa9d-2d9148b2f78a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e2fda180e8d448d895c40cdad34bc4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:22:41.320166 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820b0540-30d8-4cf4-aa9d-2d9148b2f78a service cinder] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:41.320452 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820b0540-30d8-4cf4-aa9d-2d9148b2f78a service cinder] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:41.320726 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820b0540-30d8-4cf4-aa9d-2d9148b2f78a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:41.330844 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820b0540-30d8-4cf4-aa9d-2d9148b2f78a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:22:41.332341 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820b0540-30d8-4cf4-aa9d-2d9148b2f78a service cinder] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:22:41.343036 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1318/2640] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:22:41 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:22:41.438803 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78e31c0-78a2-4255-96e7-628ed9c07439 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:22:41.508717 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78e31c0-78a2-4255-96e7-628ed9c07439 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:22:41.514007 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e006490-d802-4533-a900-be41da6a5b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:22:41.515104 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e006490-d802-4533-a900-be41da6a5b16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:41.515383 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e006490-d802-4533-a900-be41da6a5b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:41.515652 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e006490-d802-4533-a900-be41da6a5b16 admin admin] PATH_INFO: `/v3/users/428512b6939f41f59d2b9de9642c3759` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:41.516947 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e006490-d802-4533-a900-be41da6a5b16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=428512b6939f41f59d2b9de9642c3759)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:22:41.518903 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e006490-d802-4533-a900-be41da6a5b16 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:22:41.567470 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-0e006490-d802-4533-a900-be41da6a5b16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '428512b6939f41f59d2b9de9642c3759'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:22:41.568126 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-0e006490-d802-4533-a900-be41da6a5b16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '428512b6939f41f59d2b9de9642c3759'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:22:41.568721 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-0e006490-d802-4533-a900-be41da6a5b16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '428512b6939f41f59d2b9de9642c3759'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:22:41.577340 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-0e006490-d802-4533-a900-be41da6a5b16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '428512b6939f41f59d2b9de9642c3759'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:22:41.584328 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-0e006490-d802-4533-a900-be41da6a5b16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '428512b6939f41f59d2b9de9642c3759'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:22:41.600857 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1323/2641] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Mar 30 07:22:41 2022] DELETE /identity/v3/users/428512b6939f41f59d2b9de9642c3759 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 07:22:41.606312 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ad6c66-21b8-4275-bbf5-98dc29146ded None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:41.606599 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ad6c66-21b8-4275-bbf5-98dc29146ded None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:41.606899 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ad6c66-21b8-4275-bbf5-98dc29146ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:41.625087 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-96ad6c66-21b8-4275-bbf5-98dc29146ded None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:22:41.626272 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-96ad6c66-21b8-4275-bbf5-98dc29146ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:22:41.689243 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1319/2642] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:22:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:22:41.699728 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e006490-d802-4533-a900-be41da6a5b16 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:22:41.701217 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-0e006490-d802-4533-a900-be41da6a5b16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:22:41.763721 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e006490-d802-4533-a900-be41da6a5b16 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:22:41.767740 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367cfc9a-cca4-40f7-a472-f0f10eb7e7a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3802cb341445f994b9204744060ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:22:41.768635 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367cfc9a-cca4-40f7-a472-f0f10eb7e7a1 service neutron] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:41.768775 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367cfc9a-cca4-40f7-a472-f0f10eb7e7a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:41.768976 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367cfc9a-cca4-40f7-a472-f0f10eb7e7a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:41.779739 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367cfc9a-cca4-40f7-a472-f0f10eb7e7a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:22:41.781332 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367cfc9a-cca4-40f7-a472-f0f10eb7e7a1 service neutron] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:22:41.792231 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1324/2643] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:22:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:22:42.127047 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ad6c66-21b8-4275-bbf5-98dc29146ded None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:22:42.128523 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-96ad6c66-21b8-4275-bbf5-98dc29146ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:22:42.140946 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ad6c66-21b8-4275-bbf5-98dc29146ded None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:22:42.146502 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4279af-2574-4fd9-83a8-641713f1b5fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:22:42.147481 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4279af-2574-4fd9-83a8-641713f1b5fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:42.147800 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4279af-2574-4fd9-83a8-641713f1b5fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:42.148051 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4279af-2574-4fd9-83a8-641713f1b5fc admin admin] PATH_INFO: `/v3/projects/fc76ac7874334cc1bccdb197951f6316` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:42.149399 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4279af-2574-4fd9-83a8-641713f1b5fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc76ac7874334cc1bccdb197951f6316)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:22:42.151357 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4279af-2574-4fd9-83a8-641713f1b5fc admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:22:42.200015 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-be4279af-2574-4fd9-83a8-641713f1b5fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc76ac7874334cc1bccdb197951f6316', 'request_id': 'req-be4279af-2574-4fd9-83a8-641713f1b5fc'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:22:42.215654 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-be4279af-2574-4fd9-83a8-641713f1b5fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc76ac7874334cc1bccdb197951f6316', 'request_id': 'req-be4279af-2574-4fd9-83a8-641713f1b5fc'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:22:42.227237 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-be4279af-2574-4fd9-83a8-641713f1b5fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc76ac7874334cc1bccdb197951f6316', 'request_id': 'req-be4279af-2574-4fd9-83a8-641713f1b5fc'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:22:42.239354 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-be4279af-2574-4fd9-83a8-641713f1b5fc admin admin] The token cache is being invalidate because project fc76ac7874334cc1bccdb197951f6316 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79960) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 07:22:42.239667 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-be4279af-2574-4fd9-83a8-641713f1b5fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:22:42.240353 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-be4279af-2574-4fd9-83a8-641713f1b5fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:22:42.242508 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1320/2644] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Mar 30 07:22:42 2022] DELETE /identity/v3/projects/fc76ac7874334cc1bccdb197951f6316 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:22:42.246376 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367cfc9a-cca4-40f7-a472-f0f10eb7e7a1 service neutron] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:22:42.256495 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367cfc9a-cca4-40f7-a472-f0f10eb7e7a1 service neutron] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:22:42.326070 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7eb0a1-5613-4f9b-9ad1-fa6857e874e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:22:42.327404 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7eb0a1-5613-4f9b-9ad1-fa6857e874e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:42.327905 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7eb0a1-5613-4f9b-9ad1-fa6857e874e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:42.328350 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7eb0a1-5613-4f9b-9ad1-fa6857e874e8 admin admin] PATH_INFO: `/v3/users/766221d069d0408a840f6b4abc11bfee` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:42.329782 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7eb0a1-5613-4f9b-9ad1-fa6857e874e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=766221d069d0408a840f6b4abc11bfee)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:22:42.332056 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7eb0a1-5613-4f9b-9ad1-fa6857e874e8 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:22:42.387468 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-3f7eb0a1-5613-4f9b-9ad1-fa6857e874e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '766221d069d0408a840f6b4abc11bfee'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:22:42.388182 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-3f7eb0a1-5613-4f9b-9ad1-fa6857e874e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '766221d069d0408a840f6b4abc11bfee'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:22:42.389123 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-3f7eb0a1-5613-4f9b-9ad1-fa6857e874e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '766221d069d0408a840f6b4abc11bfee'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:22:42.400748 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-3f7eb0a1-5613-4f9b-9ad1-fa6857e874e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '766221d069d0408a840f6b4abc11bfee'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:22:42.408901 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-3f7eb0a1-5613-4f9b-9ad1-fa6857e874e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '766221d069d0408a840f6b4abc11bfee'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:22:42.429555 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1325/2645] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Mar 30 07:22:42 2022] DELETE /identity/v3/users/766221d069d0408a840f6b4abc11bfee => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:22:42.768819 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4279af-2574-4fd9-83a8-641713f1b5fc admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:22:42.770268 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-be4279af-2574-4fd9-83a8-641713f1b5fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:22:42.793579 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4279af-2574-4fd9-83a8-641713f1b5fc admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:22:42.881587 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77931720-0420-4c13-8c08-d689c016a959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:22:42.882495 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77931720-0420-4c13-8c08-d689c016a959 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:42.882775 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77931720-0420-4c13-8c08-d689c016a959 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:42.883050 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77931720-0420-4c13-8c08-d689c016a959 admin admin] PATH_INFO: `/v3/projects/671914d0ef414e7cb31e31feb630a046` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:42.884311 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77931720-0420-4c13-8c08-d689c016a959 admin admin] RBAC: Authorizing `identity:delete_project(project_id=671914d0ef414e7cb31e31feb630a046)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:22:42.886243 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77931720-0420-4c13-8c08-d689c016a959 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:22:42.940891 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-77931720-0420-4c13-8c08-d689c016a959 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '671914d0ef414e7cb31e31feb630a046', 'request_id': 'req-77931720-0420-4c13-8c08-d689c016a959'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:22:42.951772 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-77931720-0420-4c13-8c08-d689c016a959 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '671914d0ef414e7cb31e31feb630a046', 'request_id': 'req-77931720-0420-4c13-8c08-d689c016a959'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:22:42.957801 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-77931720-0420-4c13-8c08-d689c016a959 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '671914d0ef414e7cb31e31feb630a046', 'request_id': 'req-77931720-0420-4c13-8c08-d689c016a959'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:22:42.986763 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-77931720-0420-4c13-8c08-d689c016a959 admin admin] The token cache is being invalidate because project 671914d0ef414e7cb31e31feb630a046 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79960) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 07:22:42.987197 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-77931720-0420-4c13-8c08-d689c016a959 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:22:42.988070 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-77931720-0420-4c13-8c08-d689c016a959 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:22:42.992043 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1321/2646] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Mar 30 07:22:42 2022] DELETE /identity/v3/projects/671914d0ef414e7cb31e31feb630a046 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:22:42.996738 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097b77bd-d399-4088-b9bf-105f9b99af27 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:42.997612 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097b77bd-d399-4088-b9bf-105f9b99af27 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:42.998045 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097b77bd-d399-4088-b9bf-105f9b99af27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:43.032565 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-097b77bd-d399-4088-b9bf-105f9b99af27 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:22:43.034673 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-097b77bd-d399-4088-b9bf-105f9b99af27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:22:43.119488 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1326/2647] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:22:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:22:43.127353 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e7c3d-c9a9-4b88-bbfe-99b4beabd281 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:43.127907 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e7c3d-c9a9-4b88-bbfe-99b4beabd281 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:43.128010 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e7c3d-c9a9-4b88-bbfe-99b4beabd281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:43.153593 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-999e7c3d-c9a9-4b88-bbfe-99b4beabd281 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:22:43.154951 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-999e7c3d-c9a9-4b88-bbfe-99b4beabd281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:22:43.164178 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1322/2648] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:22:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:22:43.168664 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097b77bd-d399-4088-b9bf-105f9b99af27 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:22:43.179153 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097b77bd-d399-4088-b9bf-105f9b99af27 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:22:43.184386 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6aa294-d881-48bc-97e4-90b29310cc8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:22:43.185044 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6aa294-d881-48bc-97e4-90b29310cc8b admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:43.185325 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6aa294-d881-48bc-97e4-90b29310cc8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:43.185597 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6aa294-d881-48bc-97e4-90b29310cc8b admin admin] PATH_INFO: `/v3/domains` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:43.186301 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6aa294-d881-48bc-97e4-90b29310cc8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:22:43.186631 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6aa294-d881-48bc-97e4-90b29310cc8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:22:43.188272 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6aa294-d881-48bc-97e4-90b29310cc8b admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:22:43.200658 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1327/2649] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Mar 30 07:22:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:22:43.217126 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999e7c3d-c9a9-4b88-bbfe-99b4beabd281 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:22:43.228841 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999e7c3d-c9a9-4b88-bbfe-99b4beabd281 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:22:43.233759 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79438dce-b355-492a-9884-903c2157560a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:22:43.234508 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79438dce-b355-492a-9884-903c2157560a admin admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:43.234967 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79438dce-b355-492a-9884-903c2157560a admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:43.235353 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79438dce-b355-492a-9884-903c2157560a admin admin] PATH_INFO: `/v3/projects` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:43.236125 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79438dce-b355-492a-9884-903c2157560a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:22:43.238073 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79438dce-b355-492a-9884-903c2157560a admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:22:43.273928 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1323/2650] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Mar 30 07:22:43 2022] POST /identity/v3/projects => generated 391 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:22:43.275300 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6aa294-d881-48bc-97e4-90b29310cc8b admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:22:43.288512 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6aa294-d881-48bc-97e4-90b29310cc8b admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:22:43.348675 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38003ad6-a14d-4f8a-94e6-d6a3efc3f205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:22:43.349350 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38003ad6-a14d-4f8a-94e6-d6a3efc3f205 admin admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:43.349635 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38003ad6-a14d-4f8a-94e6-d6a3efc3f205 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:43.349904 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38003ad6-a14d-4f8a-94e6-d6a3efc3f205 admin admin] PATH_INFO: `/v3/users` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:43.350615 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38003ad6-a14d-4f8a-94e6-d6a3efc3f205 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:22:43.352949 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38003ad6-a14d-4f8a-94e6-d6a3efc3f205 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:22:43.374269 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1328/2651] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Mar 30 07:22:43 2022] POST /identity/v3/users => generated 296 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 07:22:43.378637 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79438dce-b355-492a-9884-903c2157560a admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:22:43.389413 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79438dce-b355-492a-9884-903c2157560a admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:22:43.395283 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf84d162-2add-455a-bc6f-92679335838f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:22:43.395996 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf84d162-2add-455a-bc6f-92679335838f admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:43.396278 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf84d162-2add-455a-bc6f-92679335838f admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:43.396615 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf84d162-2add-455a-bc6f-92679335838f admin admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:43.400791 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf84d162-2add-455a-bc6f-92679335838f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:22:43.400791 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf84d162-2add-455a-bc6f-92679335838f admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:22:43.412152 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1324/2652] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:22:43 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:22:43.417418 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38003ad6-a14d-4f8a-94e6-d6a3efc3f205 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:22:43.430010 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38003ad6-a14d-4f8a-94e6-d6a3efc3f205 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:22:43.435951 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893b47a8-656c-4ecf-bcad-34db1fa7d128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:22:43.436885 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893b47a8-656c-4ecf-bcad-34db1fa7d128 admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:43.437169 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893b47a8-656c-4ecf-bcad-34db1fa7d128 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:43.437471 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893b47a8-656c-4ecf-bcad-34db1fa7d128 admin admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:43.438230 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893b47a8-656c-4ecf-bcad-34db1fa7d128 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:22:43.439872 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893b47a8-656c-4ecf-bcad-34db1fa7d128 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:22:43.454304 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1329/2653] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:22:43 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 30 07:22:43.455693 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf84d162-2add-455a-bc6f-92679335838f admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:22:43.470378 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf84d162-2add-455a-bc6f-92679335838f admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:22:43.486909 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae03d4ed-04b5-4351-af3e-fcb5ea0eb74d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:22:43.487997 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae03d4ed-04b5-4351-af3e-fcb5ea0eb74d admin admin] REQUEST_METHOD: `PUT` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:43.488388 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae03d4ed-04b5-4351-af3e-fcb5ea0eb74d admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:43.488748 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae03d4ed-04b5-4351-af3e-fcb5ea0eb74d admin admin] PATH_INFO: `/v3/projects/13f0a725cdbe4ba88dcd5ee2d96c7f96/users/4135e08b14674a02ba4a8ec736e0fd9a/roles/5d79031a64754b57ba120367465e2252` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:43.504896 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae03d4ed-04b5-4351-af3e-fcb5ea0eb74d admin admin] RBAC: Authorizing `identity:create_grant(project_id=13f0a725cdbe4ba88dcd5ee2d96c7f96, user_id=4135e08b14674a02ba4a8ec736e0fd9a, role_id=5d79031a64754b57ba120367465e2252)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:22:43.507798 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae03d4ed-04b5-4351-af3e-fcb5ea0eb74d admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:22:43.527854 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1325/2654] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:22:43 2022] PUT /identity/v3/projects/13f0a725cdbe4ba88dcd5ee2d96c7f96/users/4135e08b14674a02ba4a8ec736e0fd9a/roles/5d79031a64754b57ba120367465e2252 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 07:22:43.535103 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78557b1f-42b3-418b-b837-4dc186b7d7c5 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:43.535550 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78557b1f-42b3-418b-b837-4dc186b7d7c5 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:43.535865 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78557b1f-42b3-418b-b837-4dc186b7d7c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:43.564156 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-78557b1f-42b3-418b-b837-4dc186b7d7c5 None None] MFA Rules not processed for user `4135e08b14674a02ba4a8ec736e0fd9a`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:22:43.565384 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-78557b1f-42b3-418b-b837-4dc186b7d7c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:22:43.631274 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1330/2655] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:22:43 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:22:43.636040 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae03d4ed-04b5-4351-af3e-fcb5ea0eb74d admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:22:43.712745 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae03d4ed-04b5-4351-af3e-fcb5ea0eb74d admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:22:43.719727 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c339343f-3b2d-4209-82e5-b985179198d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:22:43.720447 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c339343f-3b2d-4209-82e5-b985179198d6 admin admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:43.720723 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c339343f-3b2d-4209-82e5-b985179198d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:43.720974 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c339343f-3b2d-4209-82e5-b985179198d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:43.721683 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c339343f-3b2d-4209-82e5-b985179198d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:22:43.723592 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c339343f-3b2d-4209-82e5-b985179198d6 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:22:43.760706 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1326/2656] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Mar 30 07:22:43 2022] POST /identity/v3/projects => generated 391 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:22:43.764913 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78557b1f-42b3-418b-b837-4dc186b7d7c5 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:22:43.779549 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78557b1f-42b3-418b-b837-4dc186b7d7c5 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:22:43.859872 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7b545e-a68d-4496-9055-3415f0b9d31f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:22:43.864051 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b545e-a68d-4496-9055-3415f0b9d31f admin admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:43.864453 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b545e-a68d-4496-9055-3415f0b9d31f admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:43.864805 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b545e-a68d-4496-9055-3415f0b9d31f admin admin] PATH_INFO: `/v3/users` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:43.865593 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7b545e-a68d-4496-9055-3415f0b9d31f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:22:43.868044 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7b545e-a68d-4496-9055-3415f0b9d31f admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:22:43.889824 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1331/2657] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Mar 30 07:22:43 2022] POST /identity/v3/users => generated 302 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:22:43.893951 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c339343f-3b2d-4209-82e5-b985179198d6 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:22:43.930000 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c339343f-3b2d-4209-82e5-b985179198d6 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:22:43.936898 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f34cff-0848-4ce7-87cb-9861aac04dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:22:43.938167 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f34cff-0848-4ce7-87cb-9861aac04dc3 admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:43.938671 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f34cff-0848-4ce7-87cb-9861aac04dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:43.939147 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f34cff-0848-4ce7-87cb-9861aac04dc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:43.939960 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f34cff-0848-4ce7-87cb-9861aac04dc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:22:43.941772 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f34cff-0848-4ce7-87cb-9861aac04dc3 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:22:43.958004 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1327/2658] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:22:43 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:22:43.958830 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7b545e-a68d-4496-9055-3415f0b9d31f admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:22:43.969099 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7b545e-a68d-4496-9055-3415f0b9d31f admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:22:43.974141 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ceb177-0a31-41ce-bfbd-fd947f04dd83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:22:43.975052 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ceb177-0a31-41ce-bfbd-fd947f04dd83 admin admin] REQUEST_METHOD: `PUT` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:43.975371 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ceb177-0a31-41ce-bfbd-fd947f04dd83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:43.975644 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ceb177-0a31-41ce-bfbd-fd947f04dd83 admin admin] PATH_INFO: `/v3/projects/20341ad0ce0144bcbce9b63aceffa566/users/0fcdeb2f47d64a22b15a56e7bbd1d499/roles/1c39b9ab8cfd4c0ea71845831920a845` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:43.993274 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ceb177-0a31-41ce-bfbd-fd947f04dd83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20341ad0ce0144bcbce9b63aceffa566, user_id=0fcdeb2f47d64a22b15a56e7bbd1d499, role_id=1c39b9ab8cfd4c0ea71845831920a845)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:22:43.996369 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ceb177-0a31-41ce-bfbd-fd947f04dd83 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:22:44.011521 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1332/2659] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:22:43 2022] PUT /identity/v3/projects/20341ad0ce0144bcbce9b63aceffa566/users/0fcdeb2f47d64a22b15a56e7bbd1d499/roles/1c39b9ab8cfd4c0ea71845831920a845 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:22:44.015627 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f34cff-0848-4ce7-87cb-9861aac04dc3 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:22:44.035678 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f34cff-0848-4ce7-87cb-9861aac04dc3 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:22:44.099499 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaddbbb-74de-4e21-bda4-6f997c92e605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:22:44.100205 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaddbbb-74de-4e21-bda4-6f997c92e605 admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:44.100556 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaddbbb-74de-4e21-bda4-6f997c92e605 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:44.100915 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaddbbb-74de-4e21-bda4-6f997c92e605 admin admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:44.101779 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaddbbb-74de-4e21-bda4-6f997c92e605 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:22:44.103718 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaddbbb-74de-4e21-bda4-6f997c92e605 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:22:44.114178 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1328/2660] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:22:44 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:22:44.118811 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ceb177-0a31-41ce-bfbd-fd947f04dd83 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:22:44.131450 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ceb177-0a31-41ce-bfbd-fd947f04dd83 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:22:44.140330 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d35eed4-9e7c-44c0-a3fb-a48010a5302e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:22:44.142149 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d35eed4-9e7c-44c0-a3fb-a48010a5302e admin admin] REQUEST_METHOD: `PUT` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:44.142612 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d35eed4-9e7c-44c0-a3fb-a48010a5302e admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:44.142811 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d35eed4-9e7c-44c0-a3fb-a48010a5302e admin admin] PATH_INFO: `/v3/projects/20341ad0ce0144bcbce9b63aceffa566/users/0fcdeb2f47d64a22b15a56e7bbd1d499/roles/1c39b9ab8cfd4c0ea71845831920a845` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:44.145968 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d35eed4-9e7c-44c0-a3fb-a48010a5302e admin admin] RBAC: Authorizing `identity:create_grant(project_id=20341ad0ce0144bcbce9b63aceffa566, user_id=0fcdeb2f47d64a22b15a56e7bbd1d499, role_id=1c39b9ab8cfd4c0ea71845831920a845)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:22:44.150092 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d35eed4-9e7c-44c0-a3fb-a48010a5302e admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:22:44.174640 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1333/2661] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:22:44 2022] PUT /identity/v3/projects/20341ad0ce0144bcbce9b63aceffa566/users/0fcdeb2f47d64a22b15a56e7bbd1d499/roles/1c39b9ab8cfd4c0ea71845831920a845 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 07:22:44.192816 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c73e4a0-cf39-428f-b656-f1f3c6759f7b None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:44.193320 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c73e4a0-cf39-428f-b656-f1f3c6759f7b None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:44.193419 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c73e4a0-cf39-428f-b656-f1f3c6759f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:44.279912 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-2c73e4a0-cf39-428f-b656-f1f3c6759f7b None None] MFA Rules not processed for user `0fcdeb2f47d64a22b15a56e7bbd1d499`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:22:44.282115 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-2c73e4a0-cf39-428f-b656-f1f3c6759f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:22:44.361352 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1329/2662] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:22:44 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:22:44.373856 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d35eed4-9e7c-44c0-a3fb-a48010a5302e admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:22:44.375880 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-8d35eed4-9e7c-44c0-a3fb-a48010a5302e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:22:44.453527 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d35eed4-9e7c-44c0-a3fb-a48010a5302e admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:22:44.457270 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a23e97-9291-4954-a1bf-9e7ac3dc2e3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e2fda180e8d448d895c40cdad34bc4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:22:44.458261 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a23e97-9291-4954-a1bf-9e7ac3dc2e3e service cinder] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:44.458724 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a23e97-9291-4954-a1bf-9e7ac3dc2e3e service cinder] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:44.459092 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a23e97-9291-4954-a1bf-9e7ac3dc2e3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:44.470447 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a23e97-9291-4954-a1bf-9e7ac3dc2e3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:22:44.472068 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a23e97-9291-4954-a1bf-9e7ac3dc2e3e service cinder] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:22:44.484102 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1334/2663] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:22:44 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:22:44.527789 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c73e4a0-cf39-428f-b656-f1f3c6759f7b None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:22:44.529345 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-2c73e4a0-cf39-428f-b656-f1f3c6759f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:22:44.541960 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c73e4a0-cf39-428f-b656-f1f3c6759f7b None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:22:44.545963 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035e00e4-fc09-44be-9e09-c78d76b133f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e2fda180e8d448d895c40cdad34bc4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:22:44.546605 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e00e4-fc09-44be-9e09-c78d76b133f8 service cinder] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:44.546887 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e00e4-fc09-44be-9e09-c78d76b133f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:44.547167 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e00e4-fc09-44be-9e09-c78d76b133f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:44.616085 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035e00e4-fc09-44be-9e09-c78d76b133f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:22:44.618003 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035e00e4-fc09-44be-9e09-c78d76b133f8 service cinder] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:22:44.640573 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1330/2664] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:22:44 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:22:47.932957 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a23e97-9291-4954-a1bf-9e7ac3dc2e3e service cinder] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:22:47.998728 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a23e97-9291-4954-a1bf-9e7ac3dc2e3e service cinder] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:22:48.005520 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeaf8fb-3596-475b-afc7-bd2010d51ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:22:48.006801 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeaf8fb-3596-475b-afc7-bd2010d51ddf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:48.007343 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeaf8fb-3596-475b-afc7-bd2010d51ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:48.008243 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeaf8fb-3596-475b-afc7-bd2010d51ddf admin admin] PATH_INFO: `/v3/users/4135e08b14674a02ba4a8ec736e0fd9a` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:48.009655 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeaf8fb-3596-475b-afc7-bd2010d51ddf admin admin] RBAC: Authorizing `identity:delete_user(user_id=4135e08b14674a02ba4a8ec736e0fd9a)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:22:48.011687 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeaf8fb-3596-475b-afc7-bd2010d51ddf admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:22:48.084959 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-8aeaf8fb-3596-475b-afc7-bd2010d51ddf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4135e08b14674a02ba4a8ec736e0fd9a'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:22:48.085610 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-8aeaf8fb-3596-475b-afc7-bd2010d51ddf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4135e08b14674a02ba4a8ec736e0fd9a'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:22:48.086264 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-8aeaf8fb-3596-475b-afc7-bd2010d51ddf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4135e08b14674a02ba4a8ec736e0fd9a'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:22:48.094982 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-8aeaf8fb-3596-475b-afc7-bd2010d51ddf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4135e08b14674a02ba4a8ec736e0fd9a'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:22:48.105495 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-8aeaf8fb-3596-475b-afc7-bd2010d51ddf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4135e08b14674a02ba4a8ec736e0fd9a'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:22:48.124911 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1335/2665] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Mar 30 07:22:47 2022] DELETE /identity/v3/users/4135e08b14674a02ba4a8ec736e0fd9a => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:22:48.129548 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5151a9-d8e6-4a0d-995f-d275c20f0b47 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:48.130164 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5151a9-d8e6-4a0d-995f-d275c20f0b47 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:48.130271 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5151a9-d8e6-4a0d-995f-d275c20f0b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:48.148513 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-ad5151a9-d8e6-4a0d-995f-d275c20f0b47 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:22:48.149849 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-ad5151a9-d8e6-4a0d-995f-d275c20f0b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:22:48.218267 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1331/2666] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:22:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:22:48.228124 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeaf8fb-3596-475b-afc7-bd2010d51ddf admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:22:48.230014 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-8aeaf8fb-3596-475b-afc7-bd2010d51ddf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:22:48.287304 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeaf8fb-3596-475b-afc7-bd2010d51ddf admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:22:48.290890 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331fa2ad-3aa9-4175-adc4-ca1c59c01fb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3802cb341445f994b9204744060ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:22:48.291544 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331fa2ad-3aa9-4175-adc4-ca1c59c01fb3 service neutron] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:48.291898 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331fa2ad-3aa9-4175-adc4-ca1c59c01fb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:48.292176 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331fa2ad-3aa9-4175-adc4-ca1c59c01fb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:48.301544 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331fa2ad-3aa9-4175-adc4-ca1c59c01fb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:22:48.302981 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331fa2ad-3aa9-4175-adc4-ca1c59c01fb3 service neutron] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:22:48.312967 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1336/2667] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:22:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:22:48.581217 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5151a9-d8e6-4a0d-995f-d275c20f0b47 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:22:48.582879 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-ad5151a9-d8e6-4a0d-995f-d275c20f0b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:22:48.595506 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5151a9-d8e6-4a0d-995f-d275c20f0b47 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:22:48.600596 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db67e4f-b6f7-48e0-be07-5590cbcdc582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:22:48.601493 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db67e4f-b6f7-48e0-be07-5590cbcdc582 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:48.601767 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db67e4f-b6f7-48e0-be07-5590cbcdc582 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:48.602413 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db67e4f-b6f7-48e0-be07-5590cbcdc582 admin admin] PATH_INFO: `/v3/projects/13f0a725cdbe4ba88dcd5ee2d96c7f96` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:48.604461 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db67e4f-b6f7-48e0-be07-5590cbcdc582 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13f0a725cdbe4ba88dcd5ee2d96c7f96)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:22:48.606346 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db67e4f-b6f7-48e0-be07-5590cbcdc582 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:22:48.667017 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-6db67e4f-b6f7-48e0-be07-5590cbcdc582 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13f0a725cdbe4ba88dcd5ee2d96c7f96', 'request_id': 'req-6db67e4f-b6f7-48e0-be07-5590cbcdc582'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:22:48.675298 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-6db67e4f-b6f7-48e0-be07-5590cbcdc582 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13f0a725cdbe4ba88dcd5ee2d96c7f96', 'request_id': 'req-6db67e4f-b6f7-48e0-be07-5590cbcdc582'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:22:48.681236 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-6db67e4f-b6f7-48e0-be07-5590cbcdc582 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13f0a725cdbe4ba88dcd5ee2d96c7f96', 'request_id': 'req-6db67e4f-b6f7-48e0-be07-5590cbcdc582'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:22:48.693433 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-6db67e4f-b6f7-48e0-be07-5590cbcdc582 admin admin] The token cache is being invalidate because project 13f0a725cdbe4ba88dcd5ee2d96c7f96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79960) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 07:22:48.693433 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-6db67e4f-b6f7-48e0-be07-5590cbcdc582 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:22:48.694364 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-6db67e4f-b6f7-48e0-be07-5590cbcdc582 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:22:48.695935 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1332/2668] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Mar 30 07:22:48 2022] DELETE /identity/v3/projects/13f0a725cdbe4ba88dcd5ee2d96c7f96 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:22:48.699990 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331fa2ad-3aa9-4175-adc4-ca1c59c01fb3 service neutron] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:22:48.710468 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331fa2ad-3aa9-4175-adc4-ca1c59c01fb3 service neutron] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:22:48.767427 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dbfa43-6552-4890-8bd6-4cb6d6bf64cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:22:48.768341 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dbfa43-6552-4890-8bd6-4cb6d6bf64cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:48.768608 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dbfa43-6552-4890-8bd6-4cb6d6bf64cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:48.768877 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dbfa43-6552-4890-8bd6-4cb6d6bf64cc admin admin] PATH_INFO: `/v3/users/0fcdeb2f47d64a22b15a56e7bbd1d499` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:48.770074 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dbfa43-6552-4890-8bd6-4cb6d6bf64cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fcdeb2f47d64a22b15a56e7bbd1d499)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:22:48.772092 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dbfa43-6552-4890-8bd6-4cb6d6bf64cc admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:22:48.818854 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-79dbfa43-6552-4890-8bd6-4cb6d6bf64cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fcdeb2f47d64a22b15a56e7bbd1d499'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:22:48.819493 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-79dbfa43-6552-4890-8bd6-4cb6d6bf64cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fcdeb2f47d64a22b15a56e7bbd1d499'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:22:48.820135 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-79dbfa43-6552-4890-8bd6-4cb6d6bf64cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fcdeb2f47d64a22b15a56e7bbd1d499'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:22:48.828967 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-79dbfa43-6552-4890-8bd6-4cb6d6bf64cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fcdeb2f47d64a22b15a56e7bbd1d499'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:22:48.836343 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-79dbfa43-6552-4890-8bd6-4cb6d6bf64cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fcdeb2f47d64a22b15a56e7bbd1d499'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:22:48.853143 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1337/2669] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Mar 30 07:22:48 2022] DELETE /identity/v3/users/0fcdeb2f47d64a22b15a56e7bbd1d499 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:22:49.124346 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db67e4f-b6f7-48e0-be07-5590cbcdc582 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:22:49.126390 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-6db67e4f-b6f7-48e0-be07-5590cbcdc582 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:22:49.141498 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db67e4f-b6f7-48e0-be07-5590cbcdc582 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:22:49.202469 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e466d2b-64be-41d9-8dd0-443a0a93c469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:22:49.203270 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e466d2b-64be-41d9-8dd0-443a0a93c469 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:49.203715 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e466d2b-64be-41d9-8dd0-443a0a93c469 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:49.204171 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e466d2b-64be-41d9-8dd0-443a0a93c469 admin admin] PATH_INFO: `/v3/projects/20341ad0ce0144bcbce9b63aceffa566` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:49.207516 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e466d2b-64be-41d9-8dd0-443a0a93c469 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20341ad0ce0144bcbce9b63aceffa566)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:22:49.209952 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e466d2b-64be-41d9-8dd0-443a0a93c469 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:22:49.268366 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-9e466d2b-64be-41d9-8dd0-443a0a93c469 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20341ad0ce0144bcbce9b63aceffa566', 'request_id': 'req-9e466d2b-64be-41d9-8dd0-443a0a93c469'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:22:49.276366 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-9e466d2b-64be-41d9-8dd0-443a0a93c469 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20341ad0ce0144bcbce9b63aceffa566', 'request_id': 'req-9e466d2b-64be-41d9-8dd0-443a0a93c469'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:22:49.281733 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-9e466d2b-64be-41d9-8dd0-443a0a93c469 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20341ad0ce0144bcbce9b63aceffa566', 'request_id': 'req-9e466d2b-64be-41d9-8dd0-443a0a93c469'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:22:49.292564 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-9e466d2b-64be-41d9-8dd0-443a0a93c469 admin admin] The token cache is being invalidate because project 20341ad0ce0144bcbce9b63aceffa566 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79960) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 07:22:49.292846 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-9e466d2b-64be-41d9-8dd0-443a0a93c469 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:22:49.293553 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-9e466d2b-64be-41d9-8dd0-443a0a93c469 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:22:49.295141 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1333/2670] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Mar 30 07:22:49 2022] DELETE /identity/v3/projects/20341ad0ce0144bcbce9b63aceffa566 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:22:49.300101 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d55f6-5648-4a1d-b986-e532d9b4b989 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:49.300603 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d55f6-5648-4a1d-b986-e532d9b4b989 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:49.300704 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d55f6-5648-4a1d-b986-e532d9b4b989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:49.318389 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-f14d55f6-5648-4a1d-b986-e532d9b4b989 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:22:49.319571 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-f14d55f6-5648-4a1d-b986-e532d9b4b989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:22:49.375435 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1338/2671] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:22:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:22:49.385766 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3540858c-7ff5-442d-a5d3-fb670e38b455 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:49.386121 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3540858c-7ff5-442d-a5d3-fb670e38b455 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:49.386549 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3540858c-7ff5-442d-a5d3-fb670e38b455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:49.406162 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-3540858c-7ff5-442d-a5d3-fb670e38b455 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:22:49.407354 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-3540858c-7ff5-442d-a5d3-fb670e38b455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:22:49.416379 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1334/2672] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:22:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:22:49.420857 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14d55f6-5648-4a1d-b986-e532d9b4b989 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:22:49.430754 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14d55f6-5648-4a1d-b986-e532d9b4b989 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:22:49.435800 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933a5a70-de07-4c36-b236-30de69fdcb6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:22:49.436485 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933a5a70-de07-4c36-b236-30de69fdcb6d admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:49.436756 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933a5a70-de07-4c36-b236-30de69fdcb6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:49.437028 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933a5a70-de07-4c36-b236-30de69fdcb6d admin admin] PATH_INFO: `/v3/domains` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:49.437752 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933a5a70-de07-4c36-b236-30de69fdcb6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:22:49.438053 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933a5a70-de07-4c36-b236-30de69fdcb6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:22:49.439644 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933a5a70-de07-4c36-b236-30de69fdcb6d admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:22:49.451400 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1339/2673] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Mar 30 07:22:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:22:49.455800 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3540858c-7ff5-442d-a5d3-fb670e38b455 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:22:49.464984 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3540858c-7ff5-442d-a5d3-fb670e38b455 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:22:49.472149 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa63ce85-7f5e-4128-a40f-1bf0af193ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:22:49.473077 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa63ce85-7f5e-4128-a40f-1bf0af193ed0 admin admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:49.473466 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa63ce85-7f5e-4128-a40f-1bf0af193ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:49.473844 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa63ce85-7f5e-4128-a40f-1bf0af193ed0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:49.474711 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa63ce85-7f5e-4128-a40f-1bf0af193ed0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:22:49.478033 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa63ce85-7f5e-4128-a40f-1bf0af193ed0 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:22:49.511509 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1335/2674] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Mar 30 07:22:49 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:22:49.512770 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933a5a70-de07-4c36-b236-30de69fdcb6d admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:22:49.522784 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933a5a70-de07-4c36-b236-30de69fdcb6d admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:22:49.580211 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8f57e3-9c53-4caf-96f1-68df25aa809d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:22:49.580915 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f57e3-9c53-4caf-96f1-68df25aa809d admin admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:49.581196 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f57e3-9c53-4caf-96f1-68df25aa809d admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:49.581466 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f57e3-9c53-4caf-96f1-68df25aa809d admin admin] PATH_INFO: `/v3/users` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:49.582148 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8f57e3-9c53-4caf-96f1-68df25aa809d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:22:49.584140 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8f57e3-9c53-4caf-96f1-68df25aa809d admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:22:49.609112 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1340/2675] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Mar 30 07:22:49 2022] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:22:49.613475 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa63ce85-7f5e-4128-a40f-1bf0af193ed0 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:22:49.624532 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa63ce85-7f5e-4128-a40f-1bf0af193ed0 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:22:49.629324 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b730c64-c0fb-483a-95c9-71c9a2eef734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:22:49.629988 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b730c64-c0fb-483a-95c9-71c9a2eef734 admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:49.630274 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b730c64-c0fb-483a-95c9-71c9a2eef734 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:49.630548 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b730c64-c0fb-483a-95c9-71c9a2eef734 admin admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:49.631276 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b730c64-c0fb-483a-95c9-71c9a2eef734 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:22:49.632925 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b730c64-c0fb-483a-95c9-71c9a2eef734 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:22:49.643504 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1336/2676] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:22:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:22:49.647445 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8f57e3-9c53-4caf-96f1-68df25aa809d admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:22:49.657954 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8f57e3-9c53-4caf-96f1-68df25aa809d admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:22:49.663093 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1092cc0a-6361-47ba-bb05-b741863f93d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:22:49.663740 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1092cc0a-6361-47ba-bb05-b741863f93d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:49.664050 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1092cc0a-6361-47ba-bb05-b741863f93d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:49.664348 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1092cc0a-6361-47ba-bb05-b741863f93d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:49.665071 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1092cc0a-6361-47ba-bb05-b741863f93d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:22:49.666734 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1092cc0a-6361-47ba-bb05-b741863f93d5 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:22:49.679003 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1341/2677] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:22:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:22:49.683371 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b730c64-c0fb-483a-95c9-71c9a2eef734 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:22:49.693307 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b730c64-c0fb-483a-95c9-71c9a2eef734 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:22:49.698256 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c0a27f-173e-4c75-a0d5-ed33c4697c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:22:49.699140 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c0a27f-173e-4c75-a0d5-ed33c4697c18 admin admin] REQUEST_METHOD: `PUT` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:49.699415 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c0a27f-173e-4c75-a0d5-ed33c4697c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:49.699685 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c0a27f-173e-4c75-a0d5-ed33c4697c18 admin admin] PATH_INFO: `/v3/projects/0ef7207eb8f14a18b7eb96918477ad64/users/5bfb4d8f91ed4538adaabe4b5acc7e3d/roles/5d79031a64754b57ba120367465e2252` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:49.718314 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c0a27f-173e-4c75-a0d5-ed33c4697c18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ef7207eb8f14a18b7eb96918477ad64, user_id=5bfb4d8f91ed4538adaabe4b5acc7e3d, role_id=5d79031a64754b57ba120367465e2252)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:22:49.720951 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c0a27f-173e-4c75-a0d5-ed33c4697c18 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:22:49.739626 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1337/2678] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:22:49 2022] PUT /identity/v3/projects/0ef7207eb8f14a18b7eb96918477ad64/users/5bfb4d8f91ed4538adaabe4b5acc7e3d/roles/5d79031a64754b57ba120367465e2252 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 07:22:49.750351 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3551c579-c100-4eee-b455-05a1f86925ad None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:49.750644 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3551c579-c100-4eee-b455-05a1f86925ad None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:49.750919 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3551c579-c100-4eee-b455-05a1f86925ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:49.779545 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-3551c579-c100-4eee-b455-05a1f86925ad None None] MFA Rules not processed for user `5bfb4d8f91ed4538adaabe4b5acc7e3d`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:22:49.780825 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-3551c579-c100-4eee-b455-05a1f86925ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:22:49.849897 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1342/2679] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:22:49 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:22:49.861384 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c0a27f-173e-4c75-a0d5-ed33c4697c18 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:22:49.863236 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-73c0a27f-173e-4c75-a0d5-ed33c4697c18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:22:49.924315 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c0a27f-173e-4c75-a0d5-ed33c4697c18 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:22:49.928852 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3506b2-8f81-4ae2-b7cf-7acfb358b9f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e2fda180e8d448d895c40cdad34bc4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:22:49.929507 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3506b2-8f81-4ae2-b7cf-7acfb358b9f5 service cinder] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:49.929787 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3506b2-8f81-4ae2-b7cf-7acfb358b9f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:49.930058 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3506b2-8f81-4ae2-b7cf-7acfb358b9f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:49.939986 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3506b2-8f81-4ae2-b7cf-7acfb358b9f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:22:49.941420 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3506b2-8f81-4ae2-b7cf-7acfb358b9f5 service cinder] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:22:49.950896 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1338/2680] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:22:49 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:22:53.049475 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3551c579-c100-4eee-b455-05a1f86925ad None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:22:53.108871 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3551c579-c100-4eee-b455-05a1f86925ad None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:22:53.113652 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19eacc8-9072-47ac-a100-6c594506726e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:22:53.114529 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19eacc8-9072-47ac-a100-6c594506726e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:53.114776 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19eacc8-9072-47ac-a100-6c594506726e admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:53.115194 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19eacc8-9072-47ac-a100-6c594506726e admin admin] PATH_INFO: `/v3/users/5bfb4d8f91ed4538adaabe4b5acc7e3d` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:53.116426 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19eacc8-9072-47ac-a100-6c594506726e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bfb4d8f91ed4538adaabe4b5acc7e3d)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:22:53.118697 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19eacc8-9072-47ac-a100-6c594506726e admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:22:53.167424 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-c19eacc8-9072-47ac-a100-6c594506726e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bfb4d8f91ed4538adaabe4b5acc7e3d'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:22:53.168081 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-c19eacc8-9072-47ac-a100-6c594506726e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bfb4d8f91ed4538adaabe4b5acc7e3d'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:22:53.168729 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-c19eacc8-9072-47ac-a100-6c594506726e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bfb4d8f91ed4538adaabe4b5acc7e3d'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:22:53.176341 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-c19eacc8-9072-47ac-a100-6c594506726e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bfb4d8f91ed4538adaabe4b5acc7e3d'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:22:53.183524 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-c19eacc8-9072-47ac-a100-6c594506726e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bfb4d8f91ed4538adaabe4b5acc7e3d'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:22:53.202368 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1343/2681] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Mar 30 07:22:53 2022] DELETE /identity/v3/users/5bfb4d8f91ed4538adaabe4b5acc7e3d => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:22:53.206838 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cfcb1e-324e-4162-9e38-6f7269e382b3 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:53.207298 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cfcb1e-324e-4162-9e38-6f7269e382b3 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:53.207476 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cfcb1e-324e-4162-9e38-6f7269e382b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:53.225511 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-f0cfcb1e-324e-4162-9e38-6f7269e382b3 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:22:53.226715 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-f0cfcb1e-324e-4162-9e38-6f7269e382b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:22:53.288519 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1339/2682] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:22:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:22:53.299925 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19eacc8-9072-47ac-a100-6c594506726e admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:22:53.301695 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-c19eacc8-9072-47ac-a100-6c594506726e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:22:53.363028 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19eacc8-9072-47ac-a100-6c594506726e admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:22:53.367124 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae006092-3183-41ad-8f9c-2608855dbc3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3802cb341445f994b9204744060ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:22:53.367765 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae006092-3183-41ad-8f9c-2608855dbc3a service neutron] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:53.368110 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae006092-3183-41ad-8f9c-2608855dbc3a service neutron] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:53.368381 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae006092-3183-41ad-8f9c-2608855dbc3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:53.378836 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae006092-3183-41ad-8f9c-2608855dbc3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:22:53.380367 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae006092-3183-41ad-8f9c-2608855dbc3a service neutron] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:22:53.390763 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1344/2683] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:22:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 30 07:22:53.747789 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cfcb1e-324e-4162-9e38-6f7269e382b3 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:22:53.749374 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-f0cfcb1e-324e-4162-9e38-6f7269e382b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:22:53.762868 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cfcb1e-324e-4162-9e38-6f7269e382b3 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:22:53.768343 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e10c47-3cae-493a-9e5e-dcb237dedcfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:22:53.769757 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e10c47-3cae-493a-9e5e-dcb237dedcfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:53.770055 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e10c47-3cae-493a-9e5e-dcb237dedcfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:53.770328 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e10c47-3cae-493a-9e5e-dcb237dedcfe admin admin] PATH_INFO: `/v3/projects/0ef7207eb8f14a18b7eb96918477ad64` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:53.771711 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e10c47-3cae-493a-9e5e-dcb237dedcfe admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ef7207eb8f14a18b7eb96918477ad64)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:22:53.773651 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e10c47-3cae-493a-9e5e-dcb237dedcfe admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:22:53.822465 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-a8e10c47-3cae-493a-9e5e-dcb237dedcfe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ef7207eb8f14a18b7eb96918477ad64', 'request_id': 'req-a8e10c47-3cae-493a-9e5e-dcb237dedcfe'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:22:53.831900 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-a8e10c47-3cae-493a-9e5e-dcb237dedcfe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ef7207eb8f14a18b7eb96918477ad64', 'request_id': 'req-a8e10c47-3cae-493a-9e5e-dcb237dedcfe'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:22:53.837634 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-a8e10c47-3cae-493a-9e5e-dcb237dedcfe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ef7207eb8f14a18b7eb96918477ad64', 'request_id': 'req-a8e10c47-3cae-493a-9e5e-dcb237dedcfe'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:22:53.849128 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-a8e10c47-3cae-493a-9e5e-dcb237dedcfe admin admin] The token cache is being invalidate because project 0ef7207eb8f14a18b7eb96918477ad64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79960) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 07:22:53.849435 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-a8e10c47-3cae-493a-9e5e-dcb237dedcfe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:22:53.850071 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-a8e10c47-3cae-493a-9e5e-dcb237dedcfe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:22:53.851618 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1340/2684] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Mar 30 07:22:53 2022] DELETE /identity/v3/projects/0ef7207eb8f14a18b7eb96918477ad64 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:22:53.856954 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a007429d-9335-48ce-9973-3e63602f8d11 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:53.857246 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a007429d-9335-48ce-9973-3e63602f8d11 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:53.857526 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a007429d-9335-48ce-9973-3e63602f8d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:53.875265 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-a007429d-9335-48ce-9973-3e63602f8d11 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:22:53.876583 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-a007429d-9335-48ce-9973-3e63602f8d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:22:53.940761 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1345/2685] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:22:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:22:53.948782 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8e3996-1405-4c55-8ba3-fa8084060140 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:53.949071 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8e3996-1405-4c55-8ba3-fa8084060140 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:53.949337 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8e3996-1405-4c55-8ba3-fa8084060140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:53.969498 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-7b8e3996-1405-4c55-8ba3-fa8084060140 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:22:53.970707 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-7b8e3996-1405-4c55-8ba3-fa8084060140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:22:53.979185 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1341/2686] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:22:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:22:53.983769 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a007429d-9335-48ce-9973-3e63602f8d11 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:22:53.993721 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a007429d-9335-48ce-9973-3e63602f8d11 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:22:53.998986 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429dd735-b032-49bc-bdb4-737ed0ecd46f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:22:53.999656 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429dd735-b032-49bc-bdb4-737ed0ecd46f admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:53.999973 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429dd735-b032-49bc-bdb4-737ed0ecd46f admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:54.000249 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429dd735-b032-49bc-bdb4-737ed0ecd46f admin admin] PATH_INFO: `/v3/domains` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:54.000971 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429dd735-b032-49bc-bdb4-737ed0ecd46f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:22:54.001276 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429dd735-b032-49bc-bdb4-737ed0ecd46f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:22:54.002862 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429dd735-b032-49bc-bdb4-737ed0ecd46f admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:22:54.017968 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1346/2687] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Mar 30 07:22:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:22:54.019174 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8e3996-1405-4c55-8ba3-fa8084060140 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:22:54.029079 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8e3996-1405-4c55-8ba3-fa8084060140 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:22:54.034148 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd23f5cc-d9ab-425d-8ffc-0f62b92a659a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:22:54.034834 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd23f5cc-d9ab-425d-8ffc-0f62b92a659a admin admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:54.035080 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd23f5cc-d9ab-425d-8ffc-0f62b92a659a admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:54.035359 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd23f5cc-d9ab-425d-8ffc-0f62b92a659a admin admin] PATH_INFO: `/v3/projects` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:54.036093 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd23f5cc-d9ab-425d-8ffc-0f62b92a659a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:22:54.037969 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd23f5cc-d9ab-425d-8ffc-0f62b92a659a admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:22:54.065449 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1342/2688] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Mar 30 07:22:54 2022] POST /identity/v3/projects => generated 369 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:22:54.069643 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429dd735-b032-49bc-bdb4-737ed0ecd46f admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:22:54.080334 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429dd735-b032-49bc-bdb4-737ed0ecd46f admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:22:54.141862 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2887b6-b604-4ae7-a8c2-afdd4fbead7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:22:54.142469 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2887b6-b604-4ae7-a8c2-afdd4fbead7c admin admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:54.142744 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2887b6-b604-4ae7-a8c2-afdd4fbead7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:54.143008 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2887b6-b604-4ae7-a8c2-afdd4fbead7c admin admin] PATH_INFO: `/v3/users` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:54.143725 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2887b6-b604-4ae7-a8c2-afdd4fbead7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:22:54.145662 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2887b6-b604-4ae7-a8c2-afdd4fbead7c admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:22:54.167003 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1347/2689] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Mar 30 07:22:54 2022] POST /identity/v3/users => generated 285 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 07:22:54.172007 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd23f5cc-d9ab-425d-8ffc-0f62b92a659a admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:22:54.182625 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd23f5cc-d9ab-425d-8ffc-0f62b92a659a admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:22:54.188241 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1259736f-f20c-424a-ac8b-b9e6a7b9596e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:22:54.188902 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1259736f-f20c-424a-ac8b-b9e6a7b9596e admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:54.189179 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1259736f-f20c-424a-ac8b-b9e6a7b9596e admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:54.189446 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1259736f-f20c-424a-ac8b-b9e6a7b9596e admin admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:54.190169 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1259736f-f20c-424a-ac8b-b9e6a7b9596e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:22:54.191760 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1259736f-f20c-424a-ac8b-b9e6a7b9596e admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:22:54.207037 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1343/2690] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:22:54 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:22:54.211225 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2887b6-b604-4ae7-a8c2-afdd4fbead7c admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:22:54.224202 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2887b6-b604-4ae7-a8c2-afdd4fbead7c admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:22:54.231542 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea235bb6-60ed-456b-9697-0e2aedb774a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:22:54.232324 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea235bb6-60ed-456b-9697-0e2aedb774a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:54.232627 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea235bb6-60ed-456b-9697-0e2aedb774a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:54.232947 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea235bb6-60ed-456b-9697-0e2aedb774a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:54.233678 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea235bb6-60ed-456b-9697-0e2aedb774a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:22:54.235325 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea235bb6-60ed-456b-9697-0e2aedb774a6 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:22:54.246715 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1348/2691] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:22:54 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:22:54.255154 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1259736f-f20c-424a-ac8b-b9e6a7b9596e admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:22:54.266103 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1259736f-f20c-424a-ac8b-b9e6a7b9596e admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:22:54.271215 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a651e3e1-4206-4540-aa62-5348922ed384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:22:54.272173 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a651e3e1-4206-4540-aa62-5348922ed384 admin admin] REQUEST_METHOD: `PUT` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:54.272459 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a651e3e1-4206-4540-aa62-5348922ed384 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:54.272734 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a651e3e1-4206-4540-aa62-5348922ed384 admin admin] PATH_INFO: `/v3/projects/3cdeb484cb3247359ac8b6c9712d0b8d/users/23115226ec8a4e1f8cec8299d5293e38/roles/5d79031a64754b57ba120367465e2252` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:54.287639 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a651e3e1-4206-4540-aa62-5348922ed384 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cdeb484cb3247359ac8b6c9712d0b8d, user_id=23115226ec8a4e1f8cec8299d5293e38, role_id=5d79031a64754b57ba120367465e2252)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:22:54.290328 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a651e3e1-4206-4540-aa62-5348922ed384 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:22:54.304744 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1344/2692] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:22:54 2022] PUT /identity/v3/projects/3cdeb484cb3247359ac8b6c9712d0b8d/users/23115226ec8a4e1f8cec8299d5293e38/roles/5d79031a64754b57ba120367465e2252 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 07:22:54.316530 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ffe874-e9b3-47cd-8aba-458b24cc8ed4 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:54.316822 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ffe874-e9b3-47cd-8aba-458b24cc8ed4 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:54.317102 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ffe874-e9b3-47cd-8aba-458b24cc8ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:54.346504 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-26ffe874-e9b3-47cd-8aba-458b24cc8ed4 None None] MFA Rules not processed for user `23115226ec8a4e1f8cec8299d5293e38`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:22:54.347621 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-26ffe874-e9b3-47cd-8aba-458b24cc8ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:22:54.418987 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1349/2693] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:22:54 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:22:54.432898 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a651e3e1-4206-4540-aa62-5348922ed384 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:22:54.436201 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-a651e3e1-4206-4540-aa62-5348922ed384 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:22:54.504082 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a651e3e1-4206-4540-aa62-5348922ed384 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:22:54.508339 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafa10a7-9761-4ba2-9cee-b8dfe611aa41 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e880ade912f3412abf44ba73939d6e50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:22:54.508982 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa10a7-9761-4ba2-9cee-b8dfe611aa41 service glance] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:22:54.509263 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa10a7-9761-4ba2-9cee-b8dfe611aa41 service glance] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:22:54.509531 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa10a7-9761-4ba2-9cee-b8dfe611aa41 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:22:54.518728 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafa10a7-9761-4ba2-9cee-b8dfe611aa41 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:22:54.520187 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafa10a7-9761-4ba2-9cee-b8dfe611aa41 service glance] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:22:54.530888 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1345/2694] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:22:54 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:23:07.400217 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ffe874-e9b3-47cd-8aba-458b24cc8ed4 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:23:07.401719 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-26ffe874-e9b3-47cd-8aba-458b24cc8ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:23:07.460044 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ffe874-e9b3-47cd-8aba-458b24cc8ed4 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:23:07.463936 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f9d521-bbf0-4010-b053-fb51affe7179 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3802cb341445f994b9204744060ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:23:07.464580 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f9d521-bbf0-4010-b053-fb51affe7179 service neutron] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:23:07.464849 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f9d521-bbf0-4010-b053-fb51affe7179 service neutron] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:23:07.465119 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f9d521-bbf0-4010-b053-fb51affe7179 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:23:07.467276 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-45f9d521-bbf0-4010-b053-fb51affe7179 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:23:07.531411 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f9d521-bbf0-4010-b053-fb51affe7179 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:23:07.532882 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f9d521-bbf0-4010-b053-fb51affe7179 service neutron] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:23:07.542399 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1350/2695] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:23:07 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 30 07:23:25.587004 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cc7f7c-2443-42eb-92fa-37461717562e None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:23:25.587558 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cc7f7c-2443-42eb-92fa-37461717562e None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:23:25.587558 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cc7f7c-2443-42eb-92fa-37461717562e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:23:25.607127 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-a6cc7f7c-2443-42eb-92fa-37461717562e None None] MFA Rules not processed for user `b0a49ff45f0e43958ceeffd704999f00`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:23:25.608351 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-a6cc7f7c-2443-42eb-92fa-37461717562e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:23:25.673735 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1346/2696] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:23:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:23:26.834949 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f9d521-bbf0-4010-b053-fb51affe7179 service neutron] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:23:26.907649 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f9d521-bbf0-4010-b053-fb51affe7179 service neutron] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:23:26.912352 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de8ab2d-cdf7-4703-8a28-5e534aa7bc41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:23:26.913215 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de8ab2d-cdf7-4703-8a28-5e534aa7bc41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:23:26.913497 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de8ab2d-cdf7-4703-8a28-5e534aa7bc41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:23:26.913759 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de8ab2d-cdf7-4703-8a28-5e534aa7bc41 admin admin] PATH_INFO: `/v3/users/23115226ec8a4e1f8cec8299d5293e38` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:23:26.914948 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de8ab2d-cdf7-4703-8a28-5e534aa7bc41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23115226ec8a4e1f8cec8299d5293e38)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:23:26.916899 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de8ab2d-cdf7-4703-8a28-5e534aa7bc41 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:23:26.966952 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-5de8ab2d-cdf7-4703-8a28-5e534aa7bc41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23115226ec8a4e1f8cec8299d5293e38'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:23:26.967683 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-5de8ab2d-cdf7-4703-8a28-5e534aa7bc41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23115226ec8a4e1f8cec8299d5293e38'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:23:26.968409 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-5de8ab2d-cdf7-4703-8a28-5e534aa7bc41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23115226ec8a4e1f8cec8299d5293e38'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:23:26.977170 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-5de8ab2d-cdf7-4703-8a28-5e534aa7bc41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23115226ec8a4e1f8cec8299d5293e38'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:23:26.984301 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-5de8ab2d-cdf7-4703-8a28-5e534aa7bc41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23115226ec8a4e1f8cec8299d5293e38'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:23:27.002775 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1351/2697] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Mar 30 07:23:26 2022] DELETE /identity/v3/users/23115226ec8a4e1f8cec8299d5293e38 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:23:27.007440 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625de7b8-d47c-42d7-b0ed-19a09f5f30fa None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:23:27.007980 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625de7b8-d47c-42d7-b0ed-19a09f5f30fa None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:23:27.008095 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625de7b8-d47c-42d7-b0ed-19a09f5f30fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:23:27.026148 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-625de7b8-d47c-42d7-b0ed-19a09f5f30fa None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:23:27.027446 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-625de7b8-d47c-42d7-b0ed-19a09f5f30fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:23:27.103646 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1347/2698] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:23:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:23:27.114468 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de8ab2d-cdf7-4703-8a28-5e534aa7bc41 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:23:27.116197 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-5de8ab2d-cdf7-4703-8a28-5e534aa7bc41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:23:27.180169 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de8ab2d-cdf7-4703-8a28-5e534aa7bc41 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:23:27.184551 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d21cf76-1be6-42e3-86d1-23d6adc85f89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3802cb341445f994b9204744060ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:23:27.185181 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d21cf76-1be6-42e3-86d1-23d6adc85f89 service neutron] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:23:27.185525 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d21cf76-1be6-42e3-86d1-23d6adc85f89 service neutron] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:23:27.185731 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d21cf76-1be6-42e3-86d1-23d6adc85f89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:23:27.195587 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d21cf76-1be6-42e3-86d1-23d6adc85f89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:23:27.197082 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d21cf76-1be6-42e3-86d1-23d6adc85f89 service neutron] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:23:27.206751 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1352/2699] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:23:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:23:27.481299 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625de7b8-d47c-42d7-b0ed-19a09f5f30fa None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:23:27.484000 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-625de7b8-d47c-42d7-b0ed-19a09f5f30fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:23:27.496462 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625de7b8-d47c-42d7-b0ed-19a09f5f30fa None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:23:27.501211 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a408087a-e832-44b0-83f3-03bd71dcfdde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:23:27.502076 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a408087a-e832-44b0-83f3-03bd71dcfdde admin admin] REQUEST_METHOD: `DELETE` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:23:27.502354 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a408087a-e832-44b0-83f3-03bd71dcfdde admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:23:27.502624 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a408087a-e832-44b0-83f3-03bd71dcfdde admin admin] PATH_INFO: `/v3/projects/3cdeb484cb3247359ac8b6c9712d0b8d` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:23:27.503970 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a408087a-e832-44b0-83f3-03bd71dcfdde admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cdeb484cb3247359ac8b6c9712d0b8d)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:23:27.506165 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a408087a-e832-44b0-83f3-03bd71dcfdde admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:23:27.558572 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-a408087a-e832-44b0-83f3-03bd71dcfdde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cdeb484cb3247359ac8b6c9712d0b8d', 'request_id': 'req-a408087a-e832-44b0-83f3-03bd71dcfdde'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:23:27.566666 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-a408087a-e832-44b0-83f3-03bd71dcfdde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cdeb484cb3247359ac8b6c9712d0b8d', 'request_id': 'req-a408087a-e832-44b0-83f3-03bd71dcfdde'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:23:27.572369 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-a408087a-e832-44b0-83f3-03bd71dcfdde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cdeb484cb3247359ac8b6c9712d0b8d', 'request_id': 'req-a408087a-e832-44b0-83f3-03bd71dcfdde'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:23:27.583308 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-a408087a-e832-44b0-83f3-03bd71dcfdde admin admin] The token cache is being invalidate because project 3cdeb484cb3247359ac8b6c9712d0b8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79960) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 07:23:27.583608 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-a408087a-e832-44b0-83f3-03bd71dcfdde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:23:27.584269 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-a408087a-e832-44b0-83f3-03bd71dcfdde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:23:27.586267 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1348/2700] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Mar 30 07:23:27 2022] DELETE /identity/v3/projects/3cdeb484cb3247359ac8b6c9712d0b8d => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:23:27.591324 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b82be06-1c02-4e5a-8340-f3031397bb03 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:23:27.591706 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b82be06-1c02-4e5a-8340-f3031397bb03 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:23:27.592040 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b82be06-1c02-4e5a-8340-f3031397bb03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:23:27.610414 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-8b82be06-1c02-4e5a-8340-f3031397bb03 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:23:27.611671 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-8b82be06-1c02-4e5a-8340-f3031397bb03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:23:27.670971 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1353/2701] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:23:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:23:27.678928 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0e33ef-94ed-487f-bc46-7b0a3ef79bac None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:23:27.679213 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0e33ef-94ed-487f-bc46-7b0a3ef79bac None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:23:27.679487 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0e33ef-94ed-487f-bc46-7b0a3ef79bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:23:27.698371 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-9a0e33ef-94ed-487f-bc46-7b0a3ef79bac None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:23:27.699891 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-9a0e33ef-94ed-487f-bc46-7b0a3ef79bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:23:27.708004 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1349/2702] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:23:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:23:27.714702 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b82be06-1c02-4e5a-8340-f3031397bb03 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:23:27.725768 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b82be06-1c02-4e5a-8340-f3031397bb03 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:23:27.731290 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba029ff-742e-4c3b-b1ea-7b9455d7bff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:23:27.731999 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba029ff-742e-4c3b-b1ea-7b9455d7bff8 admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:23:27.732300 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba029ff-742e-4c3b-b1ea-7b9455d7bff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:23:27.732572 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba029ff-742e-4c3b-b1ea-7b9455d7bff8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:23:27.733289 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba029ff-742e-4c3b-b1ea-7b9455d7bff8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:23:27.733586 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba029ff-742e-4c3b-b1ea-7b9455d7bff8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:23:27.735178 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba029ff-742e-4c3b-b1ea-7b9455d7bff8 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:23:27.748153 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1354/2703] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Mar 30 07:23:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:23:27.752768 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0e33ef-94ed-487f-bc46-7b0a3ef79bac None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:23:27.762451 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0e33ef-94ed-487f-bc46-7b0a3ef79bac None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:23:27.767434 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63a141d-c8ce-4645-b98a-6ddf706e87af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:23:27.768144 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63a141d-c8ce-4645-b98a-6ddf706e87af admin admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:23:27.768430 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63a141d-c8ce-4645-b98a-6ddf706e87af admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:23:27.768701 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63a141d-c8ce-4645-b98a-6ddf706e87af admin admin] PATH_INFO: `/v3/projects` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:23:27.769445 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63a141d-c8ce-4645-b98a-6ddf706e87af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:23:27.771344 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63a141d-c8ce-4645-b98a-6ddf706e87af admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:23:27.799075 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1350/2704] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Mar 30 07:23:27 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:23:27.803485 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba029ff-742e-4c3b-b1ea-7b9455d7bff8 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:23:27.813759 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba029ff-742e-4c3b-b1ea-7b9455d7bff8 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:23:27.872305 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82dec66-0bde-4b8c-846c-a8d400b002fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:23:27.873019 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82dec66-0bde-4b8c-846c-a8d400b002fd admin admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:23:27.873257 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82dec66-0bde-4b8c-846c-a8d400b002fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:23:27.873532 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82dec66-0bde-4b8c-846c-a8d400b002fd admin admin] PATH_INFO: `/v3/users` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:23:27.874214 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82dec66-0bde-4b8c-846c-a8d400b002fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:23:27.876349 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82dec66-0bde-4b8c-846c-a8d400b002fd admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:23:27.897730 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1355/2705] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Mar 30 07:23:27 2022] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 07:23:27.902138 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63a141d-c8ce-4645-b98a-6ddf706e87af admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:23:27.912382 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63a141d-c8ce-4645-b98a-6ddf706e87af admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:23:27.917129 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb422fd-e728-4232-95d1-f257209b7f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:23:27.917828 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb422fd-e728-4232-95d1-f257209b7f23 admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:23:27.918105 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb422fd-e728-4232-95d1-f257209b7f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:23:27.918375 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb422fd-e728-4232-95d1-f257209b7f23 admin admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:23:27.919102 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb422fd-e728-4232-95d1-f257209b7f23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:23:27.920753 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb422fd-e728-4232-95d1-f257209b7f23 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:23:27.931171 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1351/2706] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:23:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:23:27.935455 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82dec66-0bde-4b8c-846c-a8d400b002fd admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:23:27.945645 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82dec66-0bde-4b8c-846c-a8d400b002fd admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:23:27.950817 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093951af-0e21-4456-a2bf-77da2e73d945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:23:27.951618 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093951af-0e21-4456-a2bf-77da2e73d945 admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:23:27.951991 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093951af-0e21-4456-a2bf-77da2e73d945 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:23:27.952472 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093951af-0e21-4456-a2bf-77da2e73d945 admin admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:23:27.953399 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093951af-0e21-4456-a2bf-77da2e73d945 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:23:27.955003 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093951af-0e21-4456-a2bf-77da2e73d945 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:23:27.970298 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1356/2707] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:23:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:23:27.971913 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb422fd-e728-4232-95d1-f257209b7f23 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:23:27.983040 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb422fd-e728-4232-95d1-f257209b7f23 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:23:27.987953 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7498e83f-d474-4178-b4e6-d15e892ffa1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:23:27.988853 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7498e83f-d474-4178-b4e6-d15e892ffa1e admin admin] REQUEST_METHOD: `PUT` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:23:27.989152 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7498e83f-d474-4178-b4e6-d15e892ffa1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:23:27.989423 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7498e83f-d474-4178-b4e6-d15e892ffa1e admin admin] PATH_INFO: `/v3/projects/d7c15e6913c445c3be0d970eedf206ce/users/315896d65bea44dda7c1a74a9d0612ff/roles/5d79031a64754b57ba120367465e2252` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:23:28.004333 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7498e83f-d474-4178-b4e6-d15e892ffa1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7c15e6913c445c3be0d970eedf206ce, user_id=315896d65bea44dda7c1a74a9d0612ff, role_id=5d79031a64754b57ba120367465e2252)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:23:28.006980 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7498e83f-d474-4178-b4e6-d15e892ffa1e admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:23:28.032192 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1352/2708] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:23:27 2022] PUT /identity/v3/projects/d7c15e6913c445c3be0d970eedf206ce/users/315896d65bea44dda7c1a74a9d0612ff/roles/5d79031a64754b57ba120367465e2252 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:23:28.035112 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e165e19-7958-4fa5-95e6-d628adbefe17 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:23:28.035464 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e165e19-7958-4fa5-95e6-d628adbefe17 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:23:28.035827 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e165e19-7958-4fa5-95e6-d628adbefe17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:23:28.064270 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-9e165e19-7958-4fa5-95e6-d628adbefe17 None None] MFA Rules not processed for user `315896d65bea44dda7c1a74a9d0612ff`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:23:28.065729 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-9e165e19-7958-4fa5-95e6-d628adbefe17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:23:28.140509 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1357/2709] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:23:28 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:23:28.152037 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7498e83f-d474-4178-b4e6-d15e892ffa1e admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:23:28.153753 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-7498e83f-d474-4178-b4e6-d15e892ffa1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:23:28.226311 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7498e83f-d474-4178-b4e6-d15e892ffa1e admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:23:28.231311 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d33e84-7b9d-48a7-b8fc-cb925b0ab53f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e2fda180e8d448d895c40cdad34bc4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:23:28.232025 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d33e84-7b9d-48a7-b8fc-cb925b0ab53f service cinder] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:23:28.232306 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d33e84-7b9d-48a7-b8fc-cb925b0ab53f service cinder] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:23:28.232580 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d33e84-7b9d-48a7-b8fc-cb925b0ab53f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:23:28.241667 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d33e84-7b9d-48a7-b8fc-cb925b0ab53f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:23:28.243118 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d33e84-7b9d-48a7-b8fc-cb925b0ab53f service cinder] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:23:28.252542 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1353/2710] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:23:28 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:23:29.622561 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347d7ea3-a05c-4bfe-a03f-dbe59c792d98 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:23:29.623172 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347d7ea3-a05c-4bfe-a03f-dbe59c792d98 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:23:29.623172 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347d7ea3-a05c-4bfe-a03f-dbe59c792d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:23:29.640792 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-347d7ea3-a05c-4bfe-a03f-dbe59c792d98 None None] MFA Rules not processed for user `315896d65bea44dda7c1a74a9d0612ff`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:23:29.641946 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-347d7ea3-a05c-4bfe-a03f-dbe59c792d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:23:29.649111 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1358/2711] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:23:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:23:40.495093 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d33e84-7b9d-48a7-b8fc-cb925b0ab53f service cinder] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:23:40.496723 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-48d33e84-7b9d-48a7-b8fc-cb925b0ab53f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:23:40.555650 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d33e84-7b9d-48a7-b8fc-cb925b0ab53f service cinder] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:23:40.559490 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf32d34a-e7ff-4ab1-aafb-7e387152f7d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3802cb341445f994b9204744060ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:23:40.560177 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf32d34a-e7ff-4ab1-aafb-7e387152f7d1 service neutron] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:23:40.560462 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf32d34a-e7ff-4ab1-aafb-7e387152f7d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:23:40.560738 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf32d34a-e7ff-4ab1-aafb-7e387152f7d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:23:40.562575 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-cf32d34a-e7ff-4ab1-aafb-7e387152f7d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:23:40.632324 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf32d34a-e7ff-4ab1-aafb-7e387152f7d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:23:40.633800 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf32d34a-e7ff-4ab1-aafb-7e387152f7d1 service neutron] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:23:40.644550 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1354/2712] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:23:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:23:45.388368 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347d7ea3-a05c-4bfe-a03f-dbe59c792d98 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:23:45.389886 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-347d7ea3-a05c-4bfe-a03f-dbe59c792d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:23:45.475424 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347d7ea3-a05c-4bfe-a03f-dbe59c792d98 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:23:45.478688 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf32d34a-e7ff-4ab1-aafb-7e387152f7d1 service neutron] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:23:45.480143 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-cf32d34a-e7ff-4ab1-aafb-7e387152f7d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:23:45.483523 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cfbdd5-ed24-415d-9fd9-90a3798d6ea2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd634743546e8456fac2f6ab1aaee09ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:23:45.489894 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cfbdd5-ed24-415d-9fd9-90a3798d6ea2 service placement] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:23:45.490179 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cfbdd5-ed24-415d-9fd9-90a3798d6ea2 service placement] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:23:45.490598 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cfbdd5-ed24-415d-9fd9-90a3798d6ea2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:23:45.494065 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf32d34a-e7ff-4ab1-aafb-7e387152f7d1 service neutron] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:23:45.499522 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-09cfbdd5-ed24-415d-9fd9-90a3798d6ea2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:23:45.500664 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fdaa39-fc4f-403e-86d9-dabf408f4a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:23:45.502103 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fdaa39-fc4f-403e-86d9-dabf408f4a32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:23:45.502392 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fdaa39-fc4f-403e-86d9-dabf408f4a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:23:45.502669 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fdaa39-fc4f-403e-86d9-dabf408f4a32 admin admin] PATH_INFO: `/v3/users/0034481ab42c4890a835c6876d7fcca7` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:23:45.503910 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fdaa39-fc4f-403e-86d9-dabf408f4a32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0034481ab42c4890a835c6876d7fcca7)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:23:45.505871 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fdaa39-fc4f-403e-86d9-dabf408f4a32 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:23:45.513306 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cfbdd5-ed24-415d-9fd9-90a3798d6ea2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:23:45.515317 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cfbdd5-ed24-415d-9fd9-90a3798d6ea2 service placement] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:23:45.527205 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1359/2713] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:23:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:23:45.554876 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-d1fdaa39-fc4f-403e-86d9-dabf408f4a32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0034481ab42c4890a835c6876d7fcca7'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:23:45.555644 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-d1fdaa39-fc4f-403e-86d9-dabf408f4a32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0034481ab42c4890a835c6876d7fcca7'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:23:45.564414 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-d1fdaa39-fc4f-403e-86d9-dabf408f4a32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0034481ab42c4890a835c6876d7fcca7'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:23:45.577341 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-d1fdaa39-fc4f-403e-86d9-dabf408f4a32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0034481ab42c4890a835c6876d7fcca7'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:23:45.578029 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-d1fdaa39-fc4f-403e-86d9-dabf408f4a32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0034481ab42c4890a835c6876d7fcca7'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:23:45.590021 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1355/2714] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Mar 30 07:23:45 2022] DELETE /identity/v3/users/0034481ab42c4890a835c6876d7fcca7 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 07:23:45.760843 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cfbdd5-ed24-415d-9fd9-90a3798d6ea2 service placement] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:23:45.772959 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cfbdd5-ed24-415d-9fd9-90a3798d6ea2 service placement] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:23:45.829525 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc0cf6e-0650-4347-b5cd-901a19365ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:23:45.830433 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc0cf6e-0650-4347-b5cd-901a19365ffe admin admin] REQUEST_METHOD: `DELETE` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:23:45.830710 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc0cf6e-0650-4347-b5cd-901a19365ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:23:45.830975 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc0cf6e-0650-4347-b5cd-901a19365ffe admin admin] PATH_INFO: `/v3/projects/0b879ef71fe5494cadf6882b4230511a` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:23:45.832182 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc0cf6e-0650-4347-b5cd-901a19365ffe admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b879ef71fe5494cadf6882b4230511a)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:23:45.834067 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc0cf6e-0650-4347-b5cd-901a19365ffe admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:23:45.881309 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-bdc0cf6e-0650-4347-b5cd-901a19365ffe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b879ef71fe5494cadf6882b4230511a', 'request_id': 'req-bdc0cf6e-0650-4347-b5cd-901a19365ffe'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:23:45.889691 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-bdc0cf6e-0650-4347-b5cd-901a19365ffe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b879ef71fe5494cadf6882b4230511a', 'request_id': 'req-bdc0cf6e-0650-4347-b5cd-901a19365ffe'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:23:45.898575 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-bdc0cf6e-0650-4347-b5cd-901a19365ffe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b879ef71fe5494cadf6882b4230511a', 'request_id': 'req-bdc0cf6e-0650-4347-b5cd-901a19365ffe'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:23:45.913803 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-bdc0cf6e-0650-4347-b5cd-901a19365ffe admin admin] The token cache is being invalidate because project 0b879ef71fe5494cadf6882b4230511a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79961) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 07:23:45.914149 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-bdc0cf6e-0650-4347-b5cd-901a19365ffe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:23:45.915212 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-bdc0cf6e-0650-4347-b5cd-901a19365ffe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:23:45.917468 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1360/2715] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Mar 30 07:23:45 2022] DELETE /identity/v3/projects/0b879ef71fe5494cadf6882b4230511a => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:23:45.921775 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fdaa39-fc4f-403e-86d9-dabf408f4a32 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:23:45.923431 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-d1fdaa39-fc4f-403e-86d9-dabf408f4a32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:23:45.937339 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fdaa39-fc4f-403e-86d9-dabf408f4a32 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:23:45.993026 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167a3ec7-aadf-4048-b73e-677aba78ed80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:23:45.993906 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167a3ec7-aadf-4048-b73e-677aba78ed80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:23:45.994202 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167a3ec7-aadf-4048-b73e-677aba78ed80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:23:45.994449 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167a3ec7-aadf-4048-b73e-677aba78ed80 admin admin] PATH_INFO: `/v3/users/a76d4b293a6e4d18aecc182498e45128` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:23:45.995720 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167a3ec7-aadf-4048-b73e-677aba78ed80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a76d4b293a6e4d18aecc182498e45128)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:23:45.997701 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167a3ec7-aadf-4048-b73e-677aba78ed80 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:23:46.052660 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-167a3ec7-aadf-4048-b73e-677aba78ed80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a76d4b293a6e4d18aecc182498e45128'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:23:46.053422 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-167a3ec7-aadf-4048-b73e-677aba78ed80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a76d4b293a6e4d18aecc182498e45128'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:23:46.061952 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-167a3ec7-aadf-4048-b73e-677aba78ed80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a76d4b293a6e4d18aecc182498e45128'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:23:46.074003 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-167a3ec7-aadf-4048-b73e-677aba78ed80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a76d4b293a6e4d18aecc182498e45128'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:23:46.074760 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-167a3ec7-aadf-4048-b73e-677aba78ed80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a76d4b293a6e4d18aecc182498e45128'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:23:46.087699 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1356/2716] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Mar 30 07:23:45 2022] DELETE /identity/v3/users/a76d4b293a6e4d18aecc182498e45128 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:23:46.285285 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc0cf6e-0650-4347-b5cd-901a19365ffe admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:23:46.286755 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-bdc0cf6e-0650-4347-b5cd-901a19365ffe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:23:46.303379 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc0cf6e-0650-4347-b5cd-901a19365ffe admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:23:46.361331 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b449ef06-3b91-47dd-a98e-ccc69ea821bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:23:46.362355 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b449ef06-3b91-47dd-a98e-ccc69ea821bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:23:46.362760 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b449ef06-3b91-47dd-a98e-ccc69ea821bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:23:46.363107 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b449ef06-3b91-47dd-a98e-ccc69ea821bf admin admin] PATH_INFO: `/v3/projects/f1f33d3365c84e3e94058b8dd744ca92` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:23:46.364824 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b449ef06-3b91-47dd-a98e-ccc69ea821bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1f33d3365c84e3e94058b8dd744ca92)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:23:46.367092 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b449ef06-3b91-47dd-a98e-ccc69ea821bf admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:23:46.388103 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e82eb8-fac8-47be-91f2-a5c2e5b238ac None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:23:46.388399 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e82eb8-fac8-47be-91f2-a5c2e5b238ac None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:23:46.388672 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e82eb8-fac8-47be-91f2-a5c2e5b238ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:23:46.406743 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-c0e82eb8-fac8-47be-91f2-a5c2e5b238ac None None] MFA Rules not processed for user `67102c1adcf0491e9ecdef970ab2d5ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:23:46.408120 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-c0e82eb8-fac8-47be-91f2-a5c2e5b238ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:23:46.417612 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-b449ef06-3b91-47dd-a98e-ccc69ea821bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1f33d3365c84e3e94058b8dd744ca92', 'request_id': 'req-b449ef06-3b91-47dd-a98e-ccc69ea821bf'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:23:46.424571 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-b449ef06-3b91-47dd-a98e-ccc69ea821bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1f33d3365c84e3e94058b8dd744ca92', 'request_id': 'req-b449ef06-3b91-47dd-a98e-ccc69ea821bf'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:23:46.438441 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-b449ef06-3b91-47dd-a98e-ccc69ea821bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1f33d3365c84e3e94058b8dd744ca92', 'request_id': 'req-b449ef06-3b91-47dd-a98e-ccc69ea821bf'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:23:46.453206 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-b449ef06-3b91-47dd-a98e-ccc69ea821bf admin admin] The token cache is being invalidate because project f1f33d3365c84e3e94058b8dd744ca92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79961) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 07:23:46.453485 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-b449ef06-3b91-47dd-a98e-ccc69ea821bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:23:46.454112 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-b449ef06-3b91-47dd-a98e-ccc69ea821bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:23:46.455788 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1361/2717] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Mar 30 07:23:46 2022] DELETE /identity/v3/projects/f1f33d3365c84e3e94058b8dd744ca92 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:23:46.473830 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1357/2718] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Mar 30 07:23:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 07:23:46.518214 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b449ef06-3b91-47dd-a98e-ccc69ea821bf admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:23:46.519862 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-b449ef06-3b91-47dd-a98e-ccc69ea821bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:23:46.596090 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b449ef06-3b91-47dd-a98e-ccc69ea821bf admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:23:46.602731 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd35c37d-2414-4217-9edb-825049fbd08a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c452249c502d4b0688e8dd068f8c4951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:23:46.603356 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd35c37d-2414-4217-9edb-825049fbd08a service swift] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:23:46.603641 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd35c37d-2414-4217-9edb-825049fbd08a service swift] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:23:46.603939 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd35c37d-2414-4217-9edb-825049fbd08a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:23:46.613985 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd35c37d-2414-4217-9edb-825049fbd08a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:23:46.615641 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd35c37d-2414-4217-9edb-825049fbd08a service swift] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:23:46.625164 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1362/2719] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Mar 30 07:23:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 30 07:23:47.195542 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a752a563-3a2b-406c-8605-96626e1671f3 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:23:47.196121 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a752a563-3a2b-406c-8605-96626e1671f3 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:23:47.196121 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a752a563-3a2b-406c-8605-96626e1671f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:23:47.214041 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-a752a563-3a2b-406c-8605-96626e1671f3 None None] MFA Rules not processed for user `67102c1adcf0491e9ecdef970ab2d5ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:23:47.215456 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-a752a563-3a2b-406c-8605-96626e1671f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:23:47.224520 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1358/2720] 10.222.0.20 () {58 vars in 967 bytes} [Wed Mar 30 07:23:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:23:47.238378 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd35c37d-2414-4217-9edb-825049fbd08a service swift] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:23:47.251500 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd35c37d-2414-4217-9edb-825049fbd08a service swift] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:23:47.257044 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415f0049-2315-480d-812f-1e604df7fddf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c452249c502d4b0688e8dd068f8c4951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:23:47.257690 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415f0049-2315-480d-812f-1e604df7fddf service swift] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:23:47.257970 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415f0049-2315-480d-812f-1e604df7fddf service swift] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:23:47.258241 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415f0049-2315-480d-812f-1e604df7fddf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:23:47.267022 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415f0049-2315-480d-812f-1e604df7fddf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:23:47.268643 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415f0049-2315-480d-812f-1e604df7fddf service swift] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:23:47.276852 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1363/2721] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Mar 30 07:23:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 30 07:23:47.483425 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29934141-7f06-457a-a256-17f0179e9987 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:23:47.483786 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29934141-7f06-457a-a256-17f0179e9987 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:23:47.484093 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29934141-7f06-457a-a256-17f0179e9987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:23:47.502588 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-29934141-7f06-457a-a256-17f0179e9987 None None] MFA Rules not processed for user `67102c1adcf0491e9ecdef970ab2d5ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:23:47.503758 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-29934141-7f06-457a-a256-17f0179e9987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:23:47.511260 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1359/2722] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Mar 30 07:23:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:23:47.523995 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415f0049-2315-480d-812f-1e604df7fddf service swift] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:23:47.534699 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415f0049-2315-480d-812f-1e604df7fddf service swift] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:23:47.540445 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e30344c-f720-4b3b-a352-040b917e5cf3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c452249c502d4b0688e8dd068f8c4951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:23:47.541131 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e30344c-f720-4b3b-a352-040b917e5cf3 service swift] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:23:47.541407 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e30344c-f720-4b3b-a352-040b917e5cf3 service swift] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:23:47.541679 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e30344c-f720-4b3b-a352-040b917e5cf3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:23:47.549888 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e30344c-f720-4b3b-a352-040b917e5cf3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:23:47.551454 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e30344c-f720-4b3b-a352-040b917e5cf3 service swift] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:23:47.559965 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1364/2723] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Mar 30 07:23:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 30 07:23:47.886841 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d63bed-9df6-4578-bb85-00564705ed21 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:23:47.887118 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d63bed-9df6-4578-bb85-00564705ed21 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:23:47.887394 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d63bed-9df6-4578-bb85-00564705ed21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:23:47.905927 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-88d63bed-9df6-4578-bb85-00564705ed21 None None] MFA Rules not processed for user `67102c1adcf0491e9ecdef970ab2d5ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:23:47.907114 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-88d63bed-9df6-4578-bb85-00564705ed21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:23:47.915553 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1360/2724] 10.222.0.20 () {58 vars in 967 bytes} [Wed Mar 30 07:23:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:23:47.927930 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e30344c-f720-4b3b-a352-040b917e5cf3 service swift] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:23:47.939017 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e30344c-f720-4b3b-a352-040b917e5cf3 service swift] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:23:47.945410 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4c24a6-9d8d-43d8-b1cb-ba5f04da312a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c452249c502d4b0688e8dd068f8c4951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:23:47.946042 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c24a6-9d8d-43d8-b1cb-ba5f04da312a service swift] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:23:47.946289 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c24a6-9d8d-43d8-b1cb-ba5f04da312a service swift] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:23:47.946586 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c24a6-9d8d-43d8-b1cb-ba5f04da312a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:23:47.955314 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4c24a6-9d8d-43d8-b1cb-ba5f04da312a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:23:47.956934 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4c24a6-9d8d-43d8-b1cb-ba5f04da312a service swift] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:23:47.964723 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1365/2725] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Mar 30 07:23:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 30 07:23:50.034565 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d63bed-9df6-4578-bb85-00564705ed21 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:23:50.036336 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-88d63bed-9df6-4578-bb85-00564705ed21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:23:50.103758 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d63bed-9df6-4578-bb85-00564705ed21 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:23:50.109944 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147182be-6860-408f-becf-27cf39b79733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:23:50.110822 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147182be-6860-408f-becf-27cf39b79733 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:23:50.111102 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147182be-6860-408f-becf-27cf39b79733 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:23:50.111378 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147182be-6860-408f-becf-27cf39b79733 admin admin] PATH_INFO: `/v3/users/315896d65bea44dda7c1a74a9d0612ff` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:23:50.112853 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147182be-6860-408f-becf-27cf39b79733 admin admin] RBAC: Authorizing `identity:delete_user(user_id=315896d65bea44dda7c1a74a9d0612ff)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:23:50.114819 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147182be-6860-408f-becf-27cf39b79733 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:23:50.174547 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-147182be-6860-408f-becf-27cf39b79733 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '315896d65bea44dda7c1a74a9d0612ff'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:23:50.175347 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-147182be-6860-408f-becf-27cf39b79733 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '315896d65bea44dda7c1a74a9d0612ff'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:23:50.186230 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-147182be-6860-408f-becf-27cf39b79733 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '315896d65bea44dda7c1a74a9d0612ff'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:23:50.199412 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-147182be-6860-408f-becf-27cf39b79733 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '315896d65bea44dda7c1a74a9d0612ff'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:23:50.200151 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-147182be-6860-408f-becf-27cf39b79733 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '315896d65bea44dda7c1a74a9d0612ff'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:23:50.213026 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1361/2726] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Mar 30 07:23:50 2022] DELETE /identity/v3/users/315896d65bea44dda7c1a74a9d0612ff => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:23:50.217802 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5576cf-5158-4cd2-99fb-e793b2b51bf5 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:23:50.218286 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5576cf-5158-4cd2-99fb-e793b2b51bf5 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:23:50.218401 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5576cf-5158-4cd2-99fb-e793b2b51bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:23:50.237390 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-4a5576cf-5158-4cd2-99fb-e793b2b51bf5 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:23:50.238567 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-4a5576cf-5158-4cd2-99fb-e793b2b51bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:23:50.300269 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1366/2727] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:23:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:23:50.311841 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147182be-6860-408f-becf-27cf39b79733 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:23:50.313271 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-147182be-6860-408f-becf-27cf39b79733 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:23:50.369815 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147182be-6860-408f-becf-27cf39b79733 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:23:50.374049 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aa50d1-8bb5-4d97-a0f1-ad26f875b5ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3802cb341445f994b9204744060ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:23:50.374675 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa50d1-8bb5-4d97-a0f1-ad26f875b5ab service neutron] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:23:50.374927 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa50d1-8bb5-4d97-a0f1-ad26f875b5ab service neutron] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:23:50.375220 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa50d1-8bb5-4d97-a0f1-ad26f875b5ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:23:50.385182 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aa50d1-8bb5-4d97-a0f1-ad26f875b5ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:23:50.386590 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aa50d1-8bb5-4d97-a0f1-ad26f875b5ab service neutron] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:23:50.396165 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1362/2728] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:23:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:23:50.572845 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5576cf-5158-4cd2-99fb-e793b2b51bf5 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:23:50.574370 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-4a5576cf-5158-4cd2-99fb-e793b2b51bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:23:50.586434 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5576cf-5158-4cd2-99fb-e793b2b51bf5 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:23:50.591450 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b93825-7413-40ac-97d6-110c19ced7a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:23:50.592366 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b93825-7413-40ac-97d6-110c19ced7a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:23:50.592653 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b93825-7413-40ac-97d6-110c19ced7a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:23:50.592921 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b93825-7413-40ac-97d6-110c19ced7a4 admin admin] PATH_INFO: `/v3/projects/d7c15e6913c445c3be0d970eedf206ce` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:23:50.594102 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b93825-7413-40ac-97d6-110c19ced7a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7c15e6913c445c3be0d970eedf206ce)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:23:50.596023 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b93825-7413-40ac-97d6-110c19ced7a4 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:23:50.643044 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-40b93825-7413-40ac-97d6-110c19ced7a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7c15e6913c445c3be0d970eedf206ce', 'request_id': 'req-40b93825-7413-40ac-97d6-110c19ced7a4'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:23:50.648379 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-40b93825-7413-40ac-97d6-110c19ced7a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7c15e6913c445c3be0d970eedf206ce', 'request_id': 'req-40b93825-7413-40ac-97d6-110c19ced7a4'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:23:50.656429 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-40b93825-7413-40ac-97d6-110c19ced7a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7c15e6913c445c3be0d970eedf206ce', 'request_id': 'req-40b93825-7413-40ac-97d6-110c19ced7a4'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:23:50.667209 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-40b93825-7413-40ac-97d6-110c19ced7a4 admin admin] The token cache is being invalidate because project d7c15e6913c445c3be0d970eedf206ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79961) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 07:23:50.667523 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-40b93825-7413-40ac-97d6-110c19ced7a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:23:50.668142 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-40b93825-7413-40ac-97d6-110c19ced7a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:23:50.669860 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1367/2729] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Mar 30 07:23:50 2022] DELETE /identity/v3/projects/d7c15e6913c445c3be0d970eedf206ce => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:23:50.674894 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29cb7d5-ab14-4ece-ae11-c245a7f27167 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:23:50.675188 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29cb7d5-ab14-4ece-ae11-c245a7f27167 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:23:50.675466 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29cb7d5-ab14-4ece-ae11-c245a7f27167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:23:50.694015 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-e29cb7d5-ab14-4ece-ae11-c245a7f27167 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:23:50.695224 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-e29cb7d5-ab14-4ece-ae11-c245a7f27167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:23:50.761673 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1363/2730] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:23:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:23:50.770492 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed52d234-4259-495a-ae04-142dc8c3f471 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:23:50.770781 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed52d234-4259-495a-ae04-142dc8c3f471 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:23:50.771055 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed52d234-4259-495a-ae04-142dc8c3f471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:23:50.790264 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-ed52d234-4259-495a-ae04-142dc8c3f471 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:23:50.791477 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-ed52d234-4259-495a-ae04-142dc8c3f471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:23:50.800178 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1368/2731] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:23:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:23:50.804743 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29cb7d5-ab14-4ece-ae11-c245a7f27167 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:23:50.814946 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29cb7d5-ab14-4ece-ae11-c245a7f27167 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:23:50.821127 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0a3f58-8696-4dd5-a22b-b5395adca2b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:23:50.821790 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0a3f58-8696-4dd5-a22b-b5395adca2b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:23:50.822075 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0a3f58-8696-4dd5-a22b-b5395adca2b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:23:50.822350 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0a3f58-8696-4dd5-a22b-b5395adca2b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:23:50.823349 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0a3f58-8696-4dd5-a22b-b5395adca2b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:23:50.823886 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0a3f58-8696-4dd5-a22b-b5395adca2b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:23:50.827086 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0a3f58-8696-4dd5-a22b-b5395adca2b3 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:23:50.843887 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1364/2732] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Mar 30 07:23:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:23:50.848516 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed52d234-4259-495a-ae04-142dc8c3f471 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:23:50.858852 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed52d234-4259-495a-ae04-142dc8c3f471 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:23:50.864828 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0546f7d-4b29-4c27-a67d-f3d3a8fe2a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:23:50.865485 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0546f7d-4b29-4c27-a67d-f3d3a8fe2a3e admin admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:23:50.865763 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0546f7d-4b29-4c27-a67d-f3d3a8fe2a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:23:50.866034 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0546f7d-4b29-4c27-a67d-f3d3a8fe2a3e admin admin] PATH_INFO: `/v3/projects` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:23:50.866721 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0546f7d-4b29-4c27-a67d-f3d3a8fe2a3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:23:50.868672 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0546f7d-4b29-4c27-a67d-f3d3a8fe2a3e admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:23:50.898451 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1369/2733] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Mar 30 07:23:50 2022] POST /identity/v3/projects => generated 389 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:23:50.903612 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0a3f58-8696-4dd5-a22b-b5395adca2b3 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:23:50.915308 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0a3f58-8696-4dd5-a22b-b5395adca2b3 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:23:50.973593 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1ac0ba-8e6e-4b02-9407-a13ebe23c305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:23:50.974269 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1ac0ba-8e6e-4b02-9407-a13ebe23c305 admin admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:23:50.974545 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1ac0ba-8e6e-4b02-9407-a13ebe23c305 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:23:50.974810 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1ac0ba-8e6e-4b02-9407-a13ebe23c305 admin admin] PATH_INFO: `/v3/users` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:23:50.975504 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1ac0ba-8e6e-4b02-9407-a13ebe23c305 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:23:50.978039 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1ac0ba-8e6e-4b02-9407-a13ebe23c305 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:23:50.999696 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1365/2734] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Mar 30 07:23:50 2022] POST /identity/v3/users => generated 295 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:23:51.004006 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0546f7d-4b29-4c27-a67d-f3d3a8fe2a3e admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:23:51.014835 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0546f7d-4b29-4c27-a67d-f3d3a8fe2a3e admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:23:51.020177 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eba133-b130-44fd-a50e-20393d76a8b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:23:51.020849 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eba133-b130-44fd-a50e-20393d76a8b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:23:51.021133 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eba133-b130-44fd-a50e-20393d76a8b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:23:51.021408 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eba133-b130-44fd-a50e-20393d76a8b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:23:51.022147 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2eba133-b130-44fd-a50e-20393d76a8b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:23:51.023764 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2eba133-b130-44fd-a50e-20393d76a8b7 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:23:51.035321 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1370/2735] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:23:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:23:51.039040 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1ac0ba-8e6e-4b02-9407-a13ebe23c305 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:23:51.049438 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1ac0ba-8e6e-4b02-9407-a13ebe23c305 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:23:51.054291 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60ac789-fbf8-4ea7-87cf-7c71f60715ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:23:51.055043 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60ac789-fbf8-4ea7-87cf-7c71f60715ff admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:23:51.055386 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60ac789-fbf8-4ea7-87cf-7c71f60715ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:23:51.055663 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60ac789-fbf8-4ea7-87cf-7c71f60715ff admin admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:23:51.056453 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60ac789-fbf8-4ea7-87cf-7c71f60715ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:23:51.058053 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60ac789-fbf8-4ea7-87cf-7c71f60715ff admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:23:51.068338 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1366/2736] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:23:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 30 07:23:51.072560 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eba133-b130-44fd-a50e-20393d76a8b7 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:23:51.085820 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eba133-b130-44fd-a50e-20393d76a8b7 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:23:51.091849 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5268ab5-761f-41a2-8591-525e41545d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:23:51.092767 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5268ab5-761f-41a2-8591-525e41545d0f admin admin] REQUEST_METHOD: `PUT` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:23:51.093046 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5268ab5-761f-41a2-8591-525e41545d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:23:51.093316 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5268ab5-761f-41a2-8591-525e41545d0f admin admin] PATH_INFO: `/v3/projects/7356252178f14472958c505236909312/users/47ca6d21265d47208cabfaa61faf6078/roles/5d79031a64754b57ba120367465e2252` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:23:51.110646 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5268ab5-761f-41a2-8591-525e41545d0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7356252178f14472958c505236909312, user_id=47ca6d21265d47208cabfaa61faf6078, role_id=5d79031a64754b57ba120367465e2252)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:23:51.113356 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5268ab5-761f-41a2-8591-525e41545d0f admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:23:51.130704 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1371/2737] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:23:51 2022] PUT /identity/v3/projects/7356252178f14472958c505236909312/users/47ca6d21265d47208cabfaa61faf6078/roles/5d79031a64754b57ba120367465e2252 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:23:51.145796 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01adb52e-ad36-4495-a572-49f54c6e2137 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:23:51.146081 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01adb52e-ad36-4495-a572-49f54c6e2137 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:23:51.146358 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01adb52e-ad36-4495-a572-49f54c6e2137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:23:51.174234 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-01adb52e-ad36-4495-a572-49f54c6e2137 None None] MFA Rules not processed for user `47ca6d21265d47208cabfaa61faf6078`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:23:51.175436 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-01adb52e-ad36-4495-a572-49f54c6e2137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:23:51.240712 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1367/2738] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:23:51 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:23:51.252115 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5268ab5-761f-41a2-8591-525e41545d0f admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:23:51.254031 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-e5268ab5-761f-41a2-8591-525e41545d0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:23:51.313651 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5268ab5-761f-41a2-8591-525e41545d0f admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:23:51.317853 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5be501f-d079-4ced-9c33-14f7e86c5918 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e2fda180e8d448d895c40cdad34bc4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:23:51.318567 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5be501f-d079-4ced-9c33-14f7e86c5918 service cinder] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:23:51.318783 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5be501f-d079-4ced-9c33-14f7e86c5918 service cinder] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:23:51.319057 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5be501f-d079-4ced-9c33-14f7e86c5918 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:23:51.327784 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5be501f-d079-4ced-9c33-14f7e86c5918 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:23:51.329238 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5be501f-d079-4ced-9c33-14f7e86c5918 service cinder] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:23:51.338150 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1372/2739] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:23:51 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:24:07.620103 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01adb52e-ad36-4495-a572-49f54c6e2137 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:24:07.682156 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01adb52e-ad36-4495-a572-49f54c6e2137 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:24:07.687364 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a95711d-4934-48f6-b5eb-1faecb0fc96b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:24:07.688283 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a95711d-4934-48f6-b5eb-1faecb0fc96b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:24:07.688560 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a95711d-4934-48f6-b5eb-1faecb0fc96b admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:24:07.688819 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a95711d-4934-48f6-b5eb-1faecb0fc96b admin admin] PATH_INFO: `/v3/users/47ca6d21265d47208cabfaa61faf6078` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:24:07.690331 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a95711d-4934-48f6-b5eb-1faecb0fc96b admin admin] RBAC: Authorizing `identity:delete_user(user_id=47ca6d21265d47208cabfaa61faf6078)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:24:07.692300 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a95711d-4934-48f6-b5eb-1faecb0fc96b admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:24:07.745933 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-2a95711d-4934-48f6-b5eb-1faecb0fc96b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47ca6d21265d47208cabfaa61faf6078'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:24:07.746578 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-2a95711d-4934-48f6-b5eb-1faecb0fc96b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47ca6d21265d47208cabfaa61faf6078'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:24:07.755449 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-2a95711d-4934-48f6-b5eb-1faecb0fc96b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47ca6d21265d47208cabfaa61faf6078'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:24:07.766946 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-2a95711d-4934-48f6-b5eb-1faecb0fc96b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47ca6d21265d47208cabfaa61faf6078'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:24:07.767711 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-2a95711d-4934-48f6-b5eb-1faecb0fc96b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47ca6d21265d47208cabfaa61faf6078'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:24:07.780122 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1368/2740] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Mar 30 07:24:07 2022] DELETE /identity/v3/users/47ca6d21265d47208cabfaa61faf6078 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:24:07.784761 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68568321-d05b-4704-9db8-4970465abf3a None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:24:07.785232 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68568321-d05b-4704-9db8-4970465abf3a None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:24:07.785345 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68568321-d05b-4704-9db8-4970465abf3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:24:07.803443 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-68568321-d05b-4704-9db8-4970465abf3a None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:24:07.804685 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-68568321-d05b-4704-9db8-4970465abf3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:24:07.862229 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1373/2741] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:24:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 07:24:07.872075 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a95711d-4934-48f6-b5eb-1faecb0fc96b admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:24:07.873741 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-2a95711d-4934-48f6-b5eb-1faecb0fc96b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:24:07.930973 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a95711d-4934-48f6-b5eb-1faecb0fc96b admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:24:07.935292 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5d45f5-b4ef-4960-b2f8-360f72926a1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3802cb341445f994b9204744060ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:24:07.935959 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5d45f5-b4ef-4960-b2f8-360f72926a1f service neutron] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:24:07.936247 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5d45f5-b4ef-4960-b2f8-360f72926a1f service neutron] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:24:07.936507 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5d45f5-b4ef-4960-b2f8-360f72926a1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:24:07.946853 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5d45f5-b4ef-4960-b2f8-360f72926a1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:24:07.948391 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5d45f5-b4ef-4960-b2f8-360f72926a1f service neutron] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:24:07.958523 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1369/2742] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:24:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:24:08.241792 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68568321-d05b-4704-9db8-4970465abf3a None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:24:08.243434 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-68568321-d05b-4704-9db8-4970465abf3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:24:08.255113 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68568321-d05b-4704-9db8-4970465abf3a None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:24:08.259870 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa16a7a7-16f3-464d-8528-867de3213705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:24:08.260731 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa16a7a7-16f3-464d-8528-867de3213705 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:24:08.261008 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa16a7a7-16f3-464d-8528-867de3213705 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:24:08.261274 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa16a7a7-16f3-464d-8528-867de3213705 admin admin] PATH_INFO: `/v3/projects/7356252178f14472958c505236909312` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:24:08.262429 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa16a7a7-16f3-464d-8528-867de3213705 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7356252178f14472958c505236909312)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:24:08.264391 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa16a7a7-16f3-464d-8528-867de3213705 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:24:08.313473 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-aa16a7a7-16f3-464d-8528-867de3213705 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7356252178f14472958c505236909312', 'request_id': 'req-aa16a7a7-16f3-464d-8528-867de3213705'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:24:08.319199 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-aa16a7a7-16f3-464d-8528-867de3213705 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7356252178f14472958c505236909312', 'request_id': 'req-aa16a7a7-16f3-464d-8528-867de3213705'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:24:08.327567 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-aa16a7a7-16f3-464d-8528-867de3213705 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7356252178f14472958c505236909312', 'request_id': 'req-aa16a7a7-16f3-464d-8528-867de3213705'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:24:08.338318 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-aa16a7a7-16f3-464d-8528-867de3213705 admin admin] The token cache is being invalidate because project 7356252178f14472958c505236909312 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79961) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 07:24:08.338563 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-aa16a7a7-16f3-464d-8528-867de3213705 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:24:08.339222 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-aa16a7a7-16f3-464d-8528-867de3213705 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:24:08.340788 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1374/2743] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Mar 30 07:24:08 2022] DELETE /identity/v3/projects/7356252178f14472958c505236909312 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:24:26.713980 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd0b9a3-708d-418a-b17b-6f800c36e65e None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:24:26.714648 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd0b9a3-708d-418a-b17b-6f800c36e65e None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:24:26.714648 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd0b9a3-708d-418a-b17b-6f800c36e65e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:24:26.735145 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-8cd0b9a3-708d-418a-b17b-6f800c36e65e None None] MFA Rules not processed for user `b0a49ff45f0e43958ceeffd704999f00`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:24:26.736386 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-8cd0b9a3-708d-418a-b17b-6f800c36e65e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:24:26.797986 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1370/2744] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:24:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:24:42.602660 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78984034-5629-41aa-b535-23d6dc978d17 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:24:42.603192 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78984034-5629-41aa-b535-23d6dc978d17 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:24:42.603192 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78984034-5629-41aa-b535-23d6dc978d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:24:42.621699 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-78984034-5629-41aa-b535-23d6dc978d17 None None] MFA Rules not processed for user `38e427dd29ea4380b01a1c257cc3da00`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:24:42.622885 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-78984034-5629-41aa-b535-23d6dc978d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:24:42.686198 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1375/2745] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:24:42 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:24:42.698045 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd0b9a3-708d-418a-b17b-6f800c36e65e None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:24:42.699845 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-8cd0b9a3-708d-418a-b17b-6f800c36e65e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:24:42.775201 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd0b9a3-708d-418a-b17b-6f800c36e65e None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:24:42.781565 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a52a617-76ad-49fd-95fa-eeb57ea0d673 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72b398c5ed14484d8b7a51fee900597b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:24:42.782211 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a52a617-76ad-49fd-95fa-eeb57ea0d673 service nova] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:24:42.782492 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a52a617-76ad-49fd-95fa-eeb57ea0d673 service nova] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:24:42.782761 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a52a617-76ad-49fd-95fa-eeb57ea0d673 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:24:42.784779 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-2a52a617-76ad-49fd-95fa-eeb57ea0d673 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:24:42.795473 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a52a617-76ad-49fd-95fa-eeb57ea0d673 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:24:42.797087 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a52a617-76ad-49fd-95fa-eeb57ea0d673 service nova] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:24:42.806165 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1371/2746] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:24:42 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:24:48.451495 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b04993-4adc-4000-9eba-21633618ae7d None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:24:48.452061 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b04993-4adc-4000-9eba-21633618ae7d None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:24:48.452061 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b04993-4adc-4000-9eba-21633618ae7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:24:48.470954 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-d4b04993-4adc-4000-9eba-21633618ae7d None None] MFA Rules not processed for user `67102c1adcf0491e9ecdef970ab2d5ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:24:48.472086 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-d4b04993-4adc-4000-9eba-21633618ae7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:24:48.526813 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1376/2747] 10.222.0.20 () {58 vars in 967 bytes} [Wed Mar 30 07:24:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:24:48.577232 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a52a617-76ad-49fd-95fa-eeb57ea0d673 service nova] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:24:48.578725 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-2a52a617-76ad-49fd-95fa-eeb57ea0d673 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:24:48.650238 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a52a617-76ad-49fd-95fa-eeb57ea0d673 service nova] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:24:48.656349 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86618829-9b9c-440a-9611-86dbd7d7d8fa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c452249c502d4b0688e8dd068f8c4951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:24:48.657000 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86618829-9b9c-440a-9611-86dbd7d7d8fa service swift] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:24:48.657282 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86618829-9b9c-440a-9611-86dbd7d7d8fa service swift] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:24:48.657556 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86618829-9b9c-440a-9611-86dbd7d7d8fa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:24:48.666122 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86618829-9b9c-440a-9611-86dbd7d7d8fa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:24:48.667711 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86618829-9b9c-440a-9611-86dbd7d7d8fa service swift] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:24:48.676321 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1372/2748] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Mar 30 07:24:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 30 07:24:55.833637 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b04993-4adc-4000-9eba-21633618ae7d None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:24:55.835247 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-d4b04993-4adc-4000-9eba-21633618ae7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:24:55.911960 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b04993-4adc-4000-9eba-21633618ae7d None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:24:55.919925 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb27ae27-df2d-49f4-9aff-514653c84972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:24:55.920780 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb27ae27-df2d-49f4-9aff-514653c84972 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:24:55.921059 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb27ae27-df2d-49f4-9aff-514653c84972 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:24:55.921333 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb27ae27-df2d-49f4-9aff-514653c84972 admin admin] PATH_INFO: `/v3/users/f52cc2951a1c4a11a369acd769c78db1` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:24:55.922542 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb27ae27-df2d-49f4-9aff-514653c84972 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f52cc2951a1c4a11a369acd769c78db1)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:24:55.924594 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb27ae27-df2d-49f4-9aff-514653c84972 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:24:55.970628 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-eb27ae27-df2d-49f4-9aff-514653c84972 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f52cc2951a1c4a11a369acd769c78db1'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:24:55.971276 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-eb27ae27-df2d-49f4-9aff-514653c84972 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f52cc2951a1c4a11a369acd769c78db1'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:24:55.971900 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-eb27ae27-df2d-49f4-9aff-514653c84972 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f52cc2951a1c4a11a369acd769c78db1'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:24:55.979880 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-eb27ae27-df2d-49f4-9aff-514653c84972 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f52cc2951a1c4a11a369acd769c78db1'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:24:55.986863 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-eb27ae27-df2d-49f4-9aff-514653c84972 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f52cc2951a1c4a11a369acd769c78db1'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:24:56.003595 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1377/2749] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Mar 30 07:24:55 2022] DELETE /identity/v3/users/f52cc2951a1c4a11a369acd769c78db1 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:24:56.191151 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86618829-9b9c-440a-9611-86dbd7d7d8fa service swift] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:24:56.201739 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86618829-9b9c-440a-9611-86dbd7d7d8fa service swift] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:24:56.261447 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b602ed9-ae7c-42a5-a830-070b35453211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:24:56.262322 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b602ed9-ae7c-42a5-a830-070b35453211 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:24:56.262724 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b602ed9-ae7c-42a5-a830-070b35453211 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:24:56.263195 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b602ed9-ae7c-42a5-a830-070b35453211 admin admin] PATH_INFO: `/v3/projects/f93c1f92c8c14564bdb5b78a2d2b8b45` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:24:56.264555 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b602ed9-ae7c-42a5-a830-070b35453211 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f93c1f92c8c14564bdb5b78a2d2b8b45)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:24:56.266459 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b602ed9-ae7c-42a5-a830-070b35453211 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:24:56.312591 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-0b602ed9-ae7c-42a5-a830-070b35453211 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f93c1f92c8c14564bdb5b78a2d2b8b45', 'request_id': 'req-0b602ed9-ae7c-42a5-a830-070b35453211'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:24:56.321760 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-0b602ed9-ae7c-42a5-a830-070b35453211 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f93c1f92c8c14564bdb5b78a2d2b8b45', 'request_id': 'req-0b602ed9-ae7c-42a5-a830-070b35453211'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:24:56.328271 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-0b602ed9-ae7c-42a5-a830-070b35453211 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f93c1f92c8c14564bdb5b78a2d2b8b45', 'request_id': 'req-0b602ed9-ae7c-42a5-a830-070b35453211'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:24:56.344454 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-0b602ed9-ae7c-42a5-a830-070b35453211 admin admin] The token cache is being invalidate because project f93c1f92c8c14564bdb5b78a2d2b8b45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79960) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 07:24:56.344878 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-0b602ed9-ae7c-42a5-a830-070b35453211 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:24:56.345915 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-0b602ed9-ae7c-42a5-a830-070b35453211 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:24:56.348497 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1373/2750] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Mar 30 07:24:56 2022] DELETE /identity/v3/projects/f93c1f92c8c14564bdb5b78a2d2b8b45 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:24:56.354807 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb27ae27-df2d-49f4-9aff-514653c84972 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:24:56.357000 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-eb27ae27-df2d-49f4-9aff-514653c84972 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:24:56.370702 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb27ae27-df2d-49f4-9aff-514653c84972 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:24:56.426844 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2650a7-bb4c-46aa-85ce-9a5079dee6de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:24:56.427693 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2650a7-bb4c-46aa-85ce-9a5079dee6de admin admin] REQUEST_METHOD: `DELETE` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:24:56.427994 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2650a7-bb4c-46aa-85ce-9a5079dee6de admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:24:56.428264 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2650a7-bb4c-46aa-85ce-9a5079dee6de admin admin] PATH_INFO: `/v3/users/1ad480000ab14eb9bbb5c0dd0447bc97` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:24:56.429543 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2650a7-bb4c-46aa-85ce-9a5079dee6de admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ad480000ab14eb9bbb5c0dd0447bc97)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:24:56.431464 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2650a7-bb4c-46aa-85ce-9a5079dee6de admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:24:56.487264 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-9b2650a7-bb4c-46aa-85ce-9a5079dee6de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ad480000ab14eb9bbb5c0dd0447bc97'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:24:56.488051 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-9b2650a7-bb4c-46aa-85ce-9a5079dee6de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ad480000ab14eb9bbb5c0dd0447bc97'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:24:56.488745 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-9b2650a7-bb4c-46aa-85ce-9a5079dee6de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ad480000ab14eb9bbb5c0dd0447bc97'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:24:56.497744 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-9b2650a7-bb4c-46aa-85ce-9a5079dee6de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ad480000ab14eb9bbb5c0dd0447bc97'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:24:56.505353 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-9b2650a7-bb4c-46aa-85ce-9a5079dee6de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ad480000ab14eb9bbb5c0dd0447bc97'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:24:56.523639 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1378/2751] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Mar 30 07:24:56 2022] DELETE /identity/v3/users/1ad480000ab14eb9bbb5c0dd0447bc97 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:24:56.698964 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b602ed9-ae7c-42a5-a830-070b35453211 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:24:56.702258 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-0b602ed9-ae7c-42a5-a830-070b35453211 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:24:56.722595 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b602ed9-ae7c-42a5-a830-070b35453211 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:24:56.785946 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe8231d-4973-42a6-98a7-e6d0d2582a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:24:56.786816 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe8231d-4973-42a6-98a7-e6d0d2582a56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:24:56.787098 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe8231d-4973-42a6-98a7-e6d0d2582a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:24:56.787371 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe8231d-4973-42a6-98a7-e6d0d2582a56 admin admin] PATH_INFO: `/v3/projects/7e5218a5dc224bf8a0ff1a0500764999` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:24:56.788643 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe8231d-4973-42a6-98a7-e6d0d2582a56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e5218a5dc224bf8a0ff1a0500764999)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:24:56.790686 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe8231d-4973-42a6-98a7-e6d0d2582a56 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:24:56.837207 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-9fe8231d-4973-42a6-98a7-e6d0d2582a56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e5218a5dc224bf8a0ff1a0500764999', 'request_id': 'req-9fe8231d-4973-42a6-98a7-e6d0d2582a56'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:24:56.844754 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-9fe8231d-4973-42a6-98a7-e6d0d2582a56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e5218a5dc224bf8a0ff1a0500764999', 'request_id': 'req-9fe8231d-4973-42a6-98a7-e6d0d2582a56'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:24:56.850416 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-9fe8231d-4973-42a6-98a7-e6d0d2582a56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e5218a5dc224bf8a0ff1a0500764999', 'request_id': 'req-9fe8231d-4973-42a6-98a7-e6d0d2582a56'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:24:56.861870 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-9fe8231d-4973-42a6-98a7-e6d0d2582a56 admin admin] The token cache is being invalidate because project 7e5218a5dc224bf8a0ff1a0500764999 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79960) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 07:24:56.862151 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-9fe8231d-4973-42a6-98a7-e6d0d2582a56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:24:56.862795 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-9fe8231d-4973-42a6-98a7-e6d0d2582a56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:24:56.864373 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1374/2752] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Mar 30 07:24:56 2022] DELETE /identity/v3/projects/7e5218a5dc224bf8a0ff1a0500764999 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:25:34.316262 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5328a0-cfa2-4c96-a727-8add913b7b3c None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:25:34.316836 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5328a0-cfa2-4c96-a727-8add913b7b3c None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:25:34.316836 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5328a0-cfa2-4c96-a727-8add913b7b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:25:34.334724 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-7f5328a0-cfa2-4c96-a727-8add913b7b3c None None] MFA Rules not processed for user `b0a49ff45f0e43958ceeffd704999f00`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:25:34.335961 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-7f5328a0-cfa2-4c96-a727-8add913b7b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:25:34.400027 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1379/2753] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:25:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:25:34.436484 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe8231d-4973-42a6-98a7-e6d0d2582a56 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:25:34.438096 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-9fe8231d-4973-42a6-98a7-e6d0d2582a56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:25:34.505864 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe8231d-4973-42a6-98a7-e6d0d2582a56 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:25:34.510408 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68faf1c0-d4cd-4817-81cd-632d0211a612 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e880ade912f3412abf44ba73939d6e50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:25:34.511083 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68faf1c0-d4cd-4817-81cd-632d0211a612 service glance] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:25:34.511357 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68faf1c0-d4cd-4817-81cd-632d0211a612 service glance] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:25:34.511628 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68faf1c0-d4cd-4817-81cd-632d0211a612 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:25:34.513600 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-68faf1c0-d4cd-4817-81cd-632d0211a612 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:25:34.583276 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68faf1c0-d4cd-4817-81cd-632d0211a612 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:25:34.584740 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68faf1c0-d4cd-4817-81cd-632d0211a612 service glance] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:25:34.595622 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1375/2754] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:25:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:25:35.238136 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5328a0-cfa2-4c96-a727-8add913b7b3c None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:25:35.239727 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-7f5328a0-cfa2-4c96-a727-8add913b7b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:25:35.295944 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5328a0-cfa2-4c96-a727-8add913b7b3c None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:25:35.299557 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f2ad7e-9bf4-4632-be3f-de838c9e09df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3802cb341445f994b9204744060ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:25:35.300349 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f2ad7e-9bf4-4632-be3f-de838c9e09df service neutron] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:25:35.300624 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f2ad7e-9bf4-4632-be3f-de838c9e09df service neutron] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:25:35.300881 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f2ad7e-9bf4-4632-be3f-de838c9e09df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:25:35.302686 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-34f2ad7e-9bf4-4632-be3f-de838c9e09df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:25:35.316271 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f2ad7e-9bf4-4632-be3f-de838c9e09df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:25:35.317700 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f2ad7e-9bf4-4632-be3f-de838c9e09df service neutron] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:25:35.328611 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1380/2755] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:25:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:25:46.058939 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68faf1c0-d4cd-4817-81cd-632d0211a612 service glance] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:25:46.068858 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68faf1c0-d4cd-4817-81cd-632d0211a612 service glance] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:25:46.073201 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c559aa9-9653-4ffe-b3e1-375bbab6c43a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3802cb341445f994b9204744060ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:25:46.073867 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c559aa9-9653-4ffe-b3e1-375bbab6c43a service neutron] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:25:46.074144 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c559aa9-9653-4ffe-b3e1-375bbab6c43a service neutron] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:25:46.074411 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c559aa9-9653-4ffe-b3e1-375bbab6c43a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:25:46.076423 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-5c559aa9-9653-4ffe-b3e1-375bbab6c43a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:25:46.086211 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c559aa9-9653-4ffe-b3e1-375bbab6c43a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:25:46.088127 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c559aa9-9653-4ffe-b3e1-375bbab6c43a service neutron] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:25:46.095701 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1376/2756] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:25:46 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:26:35.235254 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f2ad7e-9bf4-4632-be3f-de838c9e09df service neutron] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:26:35.236704 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-34f2ad7e-9bf4-4632-be3f-de838c9e09df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:26:35.250264 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f2ad7e-9bf4-4632-be3f-de838c9e09df service neutron] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:26:35.256239 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bf26e0-e3af-4f1c-a761-9f35d95a52cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72b398c5ed14484d8b7a51fee900597b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:26:35.256898 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf26e0-e3af-4f1c-a761-9f35d95a52cd service nova] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:26:35.257172 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf26e0-e3af-4f1c-a761-9f35d95a52cd service nova] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:26:35.257441 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf26e0-e3af-4f1c-a761-9f35d95a52cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:26:35.259999 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-76bf26e0-e3af-4f1c-a761-9f35d95a52cd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:26:35.278935 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bf26e0-e3af-4f1c-a761-9f35d95a52cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:26:35.280847 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bf26e0-e3af-4f1c-a761-9f35d95a52cd service nova] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:26:35.294703 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1381/2757] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:26:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:26:43.374850 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c559aa9-9653-4ffe-b3e1-375bbab6c43a service neutron] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:26:43.376260 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-5c559aa9-9653-4ffe-b3e1-375bbab6c43a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:26:43.447737 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c559aa9-9653-4ffe-b3e1-375bbab6c43a service neutron] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:26:43.453117 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165f0c1b-51cb-483b-9924-27dc195b13c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:26:43.454026 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165f0c1b-51cb-483b-9924-27dc195b13c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:26:43.454305 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165f0c1b-51cb-483b-9924-27dc195b13c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:26:43.454579 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165f0c1b-51cb-483b-9924-27dc195b13c1 admin admin] PATH_INFO: `/v3/users/b0a49ff45f0e43958ceeffd704999f00` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:26:43.455988 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165f0c1b-51cb-483b-9924-27dc195b13c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0a49ff45f0e43958ceeffd704999f00)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:26:43.458288 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165f0c1b-51cb-483b-9924-27dc195b13c1 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:26:43.507102 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-165f0c1b-51cb-483b-9924-27dc195b13c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0a49ff45f0e43958ceeffd704999f00'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:26:43.507749 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-165f0c1b-51cb-483b-9924-27dc195b13c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0a49ff45f0e43958ceeffd704999f00'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:26:43.516305 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-165f0c1b-51cb-483b-9924-27dc195b13c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0a49ff45f0e43958ceeffd704999f00'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:26:43.529133 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-165f0c1b-51cb-483b-9924-27dc195b13c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0a49ff45f0e43958ceeffd704999f00'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:26:43.531017 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-165f0c1b-51cb-483b-9924-27dc195b13c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0a49ff45f0e43958ceeffd704999f00'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:26:43.544168 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1377/2758] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Mar 30 07:26:43 2022] DELETE /identity/v3/users/b0a49ff45f0e43958ceeffd704999f00 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 07:26:43.717186 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bf26e0-e3af-4f1c-a761-9f35d95a52cd service nova] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:26:43.730052 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bf26e0-e3af-4f1c-a761-9f35d95a52cd service nova] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:26:43.792064 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5879bfe-c853-4ca2-989c-2743c5cd41eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:26:43.792853 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5879bfe-c853-4ca2-989c-2743c5cd41eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:26:43.793134 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5879bfe-c853-4ca2-989c-2743c5cd41eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:26:43.793407 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5879bfe-c853-4ca2-989c-2743c5cd41eb admin admin] PATH_INFO: `/v3/projects/2482f983870c40ad8fe2e8a9ae69169c` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:26:43.794699 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5879bfe-c853-4ca2-989c-2743c5cd41eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=2482f983870c40ad8fe2e8a9ae69169c)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:26:43.796754 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5879bfe-c853-4ca2-989c-2743c5cd41eb admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:26:43.844986 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-d5879bfe-c853-4ca2-989c-2743c5cd41eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2482f983870c40ad8fe2e8a9ae69169c', 'request_id': 'req-d5879bfe-c853-4ca2-989c-2743c5cd41eb'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:26:43.850541 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-d5879bfe-c853-4ca2-989c-2743c5cd41eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2482f983870c40ad8fe2e8a9ae69169c', 'request_id': 'req-d5879bfe-c853-4ca2-989c-2743c5cd41eb'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:26:43.859316 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-d5879bfe-c853-4ca2-989c-2743c5cd41eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2482f983870c40ad8fe2e8a9ae69169c', 'request_id': 'req-d5879bfe-c853-4ca2-989c-2743c5cd41eb'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:26:43.871141 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-d5879bfe-c853-4ca2-989c-2743c5cd41eb admin admin] The token cache is being invalidate because project 2482f983870c40ad8fe2e8a9ae69169c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79961) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 07:26:43.871423 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-d5879bfe-c853-4ca2-989c-2743c5cd41eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:26:43.872116 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-d5879bfe-c853-4ca2-989c-2743c5cd41eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:26:43.873675 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1382/2759] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Mar 30 07:26:43 2022] DELETE /identity/v3/projects/2482f983870c40ad8fe2e8a9ae69169c => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:26:43.878853 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc8d9b9-817f-4f43-a2df-4752b1ee61a3 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:26:43.879220 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc8d9b9-817f-4f43-a2df-4752b1ee61a3 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:26:43.879665 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc8d9b9-817f-4f43-a2df-4752b1ee61a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:26:43.899184 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-4dc8d9b9-817f-4f43-a2df-4752b1ee61a3 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:26:43.900467 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-4dc8d9b9-817f-4f43-a2df-4752b1ee61a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:26:43.966486 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1378/2760] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:26:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:26:43.975591 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e42821d-521f-450e-90b8-ca0ad433ad2d None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:26:43.976052 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e42821d-521f-450e-90b8-ca0ad433ad2d None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:26:43.976396 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e42821d-521f-450e-90b8-ca0ad433ad2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:26:43.996041 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-8e42821d-521f-450e-90b8-ca0ad433ad2d None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:26:43.997367 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-8e42821d-521f-450e-90b8-ca0ad433ad2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:26:44.006623 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1383/2761] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:26:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:26:44.011024 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc8d9b9-817f-4f43-a2df-4752b1ee61a3 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:26:44.021277 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc8d9b9-817f-4f43-a2df-4752b1ee61a3 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:26:44.026390 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e8a633-60ad-4c17-9d95-86a4b9d1c24f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:26:44.027070 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e8a633-60ad-4c17-9d95-86a4b9d1c24f admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:26:44.027347 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e8a633-60ad-4c17-9d95-86a4b9d1c24f admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:26:44.027617 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e8a633-60ad-4c17-9d95-86a4b9d1c24f admin admin] PATH_INFO: `/v3/domains` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:26:44.028391 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e8a633-60ad-4c17-9d95-86a4b9d1c24f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:26:44.028699 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e8a633-60ad-4c17-9d95-86a4b9d1c24f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:26:44.030347 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e8a633-60ad-4c17-9d95-86a4b9d1c24f admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:26:44.043732 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1379/2762] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Mar 30 07:26:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:26:44.048227 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e42821d-521f-450e-90b8-ca0ad433ad2d None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:26:44.058469 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e42821d-521f-450e-90b8-ca0ad433ad2d None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:26:44.064596 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24966cb3-0934-4aea-91bd-b14e2adb331a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:26:44.065277 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24966cb3-0934-4aea-91bd-b14e2adb331a admin admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:26:44.065556 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24966cb3-0934-4aea-91bd-b14e2adb331a admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:26:44.065937 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24966cb3-0934-4aea-91bd-b14e2adb331a admin admin] PATH_INFO: `/v3/projects` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:26:44.067028 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24966cb3-0934-4aea-91bd-b14e2adb331a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:26:44.069003 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24966cb3-0934-4aea-91bd-b14e2adb331a admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:26:44.100796 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1384/2763] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Mar 30 07:26:44 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:26:44.102505 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e8a633-60ad-4c17-9d95-86a4b9d1c24f admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:26:44.113202 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e8a633-60ad-4c17-9d95-86a4b9d1c24f admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:26:44.173913 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf5388b-a86b-4f1c-ada6-838020a15be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:26:44.174589 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf5388b-a86b-4f1c-ada6-838020a15be3 admin admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:26:44.174872 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf5388b-a86b-4f1c-ada6-838020a15be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:26:44.175221 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf5388b-a86b-4f1c-ada6-838020a15be3 admin admin] PATH_INFO: `/v3/users` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:26:44.175947 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf5388b-a86b-4f1c-ada6-838020a15be3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:26:44.177873 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf5388b-a86b-4f1c-ada6-838020a15be3 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:26:44.202408 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1380/2764] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Mar 30 07:26:44 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:26:44.207224 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24966cb3-0934-4aea-91bd-b14e2adb331a admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:26:44.220846 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24966cb3-0934-4aea-91bd-b14e2adb331a admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:26:44.225960 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad7cf64-cdfa-4f1c-bedb-5a418a31051d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:26:44.226645 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad7cf64-cdfa-4f1c-bedb-5a418a31051d admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:26:44.227301 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad7cf64-cdfa-4f1c-bedb-5a418a31051d admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:26:44.227575 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad7cf64-cdfa-4f1c-bedb-5a418a31051d admin admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:26:44.228320 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad7cf64-cdfa-4f1c-bedb-5a418a31051d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:26:44.229944 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad7cf64-cdfa-4f1c-bedb-5a418a31051d admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:26:44.240746 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1385/2765] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:26:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:26:44.244851 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf5388b-a86b-4f1c-ada6-838020a15be3 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:26:44.255120 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf5388b-a86b-4f1c-ada6-838020a15be3 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:26:44.259884 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c519611b-5341-4b54-9129-dafaaf456b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:26:44.260553 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c519611b-5341-4b54-9129-dafaaf456b99 admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:26:44.260845 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c519611b-5341-4b54-9129-dafaaf456b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:26:44.261108 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c519611b-5341-4b54-9129-dafaaf456b99 admin admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:26:44.261847 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c519611b-5341-4b54-9129-dafaaf456b99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:26:44.263444 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c519611b-5341-4b54-9129-dafaaf456b99 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:26:44.273887 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1381/2766] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:26:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:26:44.278160 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad7cf64-cdfa-4f1c-bedb-5a418a31051d admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:26:44.288679 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad7cf64-cdfa-4f1c-bedb-5a418a31051d admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:26:44.293675 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472e7b40-d970-4f61-8afd-750083f00710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:26:44.294659 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e7b40-d970-4f61-8afd-750083f00710 admin admin] REQUEST_METHOD: `PUT` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:26:44.294872 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e7b40-d970-4f61-8afd-750083f00710 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:26:44.295146 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e7b40-d970-4f61-8afd-750083f00710 admin admin] PATH_INFO: `/v3/projects/6337a7bc30d54734ad5d9435178a21a8/users/093746898071460fbacf5d1b54389924/roles/5d79031a64754b57ba120367465e2252` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:26:44.310523 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472e7b40-d970-4f61-8afd-750083f00710 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6337a7bc30d54734ad5d9435178a21a8, user_id=093746898071460fbacf5d1b54389924, role_id=5d79031a64754b57ba120367465e2252)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:26:44.313344 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472e7b40-d970-4f61-8afd-750083f00710 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:26:44.328214 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1386/2767] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:26:44 2022] PUT /identity/v3/projects/6337a7bc30d54734ad5d9435178a21a8/users/093746898071460fbacf5d1b54389924/roles/5d79031a64754b57ba120367465e2252 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:26:44.341089 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456c639c-352e-47f8-8784-860ae153eb35 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:26:44.341470 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456c639c-352e-47f8-8784-860ae153eb35 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:26:44.341818 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456c639c-352e-47f8-8784-860ae153eb35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:26:44.370645 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-456c639c-352e-47f8-8784-860ae153eb35 None None] MFA Rules not processed for user `093746898071460fbacf5d1b54389924`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:26:44.371918 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-456c639c-352e-47f8-8784-860ae153eb35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:26:44.437569 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1382/2768] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:26:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:26:44.448711 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472e7b40-d970-4f61-8afd-750083f00710 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:26:44.450715 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-472e7b40-d970-4f61-8afd-750083f00710 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:26:44.522229 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472e7b40-d970-4f61-8afd-750083f00710 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:26:44.527842 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fc11c1-877f-449a-a094-ef5a8d6e2086 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72b398c5ed14484d8b7a51fee900597b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:26:44.528530 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc11c1-877f-449a-a094-ef5a8d6e2086 service nova] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:26:44.528807 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc11c1-877f-449a-a094-ef5a8d6e2086 service nova] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:26:44.529085 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc11c1-877f-449a-a094-ef5a8d6e2086 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:26:44.537363 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fc11c1-877f-449a-a094-ef5a8d6e2086 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:26:44.539005 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fc11c1-877f-449a-a094-ef5a8d6e2086 service nova] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:26:44.551265 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1387/2769] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:26:44 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:26:50.378497 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456c639c-352e-47f8-8784-860ae153eb35 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:26:50.380596 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-456c639c-352e-47f8-8784-860ae153eb35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:26:50.441518 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456c639c-352e-47f8-8784-860ae153eb35 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:26:50.445732 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13694ca3-0941-4fbe-8ba3-ed995322b98a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3802cb341445f994b9204744060ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:26:50.446380 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13694ca3-0941-4fbe-8ba3-ed995322b98a service neutron] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:26:50.446656 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13694ca3-0941-4fbe-8ba3-ed995322b98a service neutron] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:26:50.446927 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13694ca3-0941-4fbe-8ba3-ed995322b98a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:26:50.448797 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-13694ca3-0941-4fbe-8ba3-ed995322b98a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:26:50.516488 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13694ca3-0941-4fbe-8ba3-ed995322b98a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:26:50.518373 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13694ca3-0941-4fbe-8ba3-ed995322b98a service neutron] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:26:50.530503 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1383/2770] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:26:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:26:51.860772 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fc11c1-877f-449a-a094-ef5a8d6e2086 service nova] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:26:51.872669 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fc11c1-877f-449a-a094-ef5a8d6e2086 service nova] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:26:51.878522 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6505cfd-2feb-49c1-b9cc-071d49aaec42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:26:51.879398 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6505cfd-2feb-49c1-b9cc-071d49aaec42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:26:51.879674 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6505cfd-2feb-49c1-b9cc-071d49aaec42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:26:51.880151 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6505cfd-2feb-49c1-b9cc-071d49aaec42 admin admin] PATH_INFO: `/v3/users/093746898071460fbacf5d1b54389924` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:26:51.881406 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6505cfd-2feb-49c1-b9cc-071d49aaec42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=093746898071460fbacf5d1b54389924)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:26:51.883308 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6505cfd-2feb-49c1-b9cc-071d49aaec42 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:26:51.933392 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-a6505cfd-2feb-49c1-b9cc-071d49aaec42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '093746898071460fbacf5d1b54389924'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:26:51.934050 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-a6505cfd-2feb-49c1-b9cc-071d49aaec42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '093746898071460fbacf5d1b54389924'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:26:51.934655 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-a6505cfd-2feb-49c1-b9cc-071d49aaec42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '093746898071460fbacf5d1b54389924'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:26:51.944154 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-a6505cfd-2feb-49c1-b9cc-071d49aaec42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '093746898071460fbacf5d1b54389924'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:26:51.953270 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-a6505cfd-2feb-49c1-b9cc-071d49aaec42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '093746898071460fbacf5d1b54389924'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:26:51.973074 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1388/2771] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Mar 30 07:26:51 2022] DELETE /identity/v3/users/093746898071460fbacf5d1b54389924 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:26:51.978084 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0234e4-2796-4db6-9d34-c53210a6d705 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:26:51.978619 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0234e4-2796-4db6-9d34-c53210a6d705 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:26:51.978619 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0234e4-2796-4db6-9d34-c53210a6d705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:26:51.995399 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-9e0234e4-2796-4db6-9d34-c53210a6d705 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:26:51.996552 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-9e0234e4-2796-4db6-9d34-c53210a6d705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:26:52.066621 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1384/2772] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:26:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:26:52.074839 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6505cfd-2feb-49c1-b9cc-071d49aaec42 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:26:52.076464 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-a6505cfd-2feb-49c1-b9cc-071d49aaec42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:26:52.136697 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6505cfd-2feb-49c1-b9cc-071d49aaec42 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:26:52.140545 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da84773-075d-441e-9047-20ceb6792221 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3802cb341445f994b9204744060ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:26:52.141209 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da84773-075d-441e-9047-20ceb6792221 service neutron] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:26:52.141489 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da84773-075d-441e-9047-20ceb6792221 service neutron] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:26:52.141760 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da84773-075d-441e-9047-20ceb6792221 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:26:52.153005 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da84773-075d-441e-9047-20ceb6792221 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:26:52.154552 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da84773-075d-441e-9047-20ceb6792221 service neutron] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:26:52.164956 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1389/2773] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:26:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 30 07:26:52.737763 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0234e4-2796-4db6-9d34-c53210a6d705 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:26:52.739566 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-9e0234e4-2796-4db6-9d34-c53210a6d705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:26:52.761221 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0234e4-2796-4db6-9d34-c53210a6d705 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:26:52.776250 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8544b8-46db-492b-a00e-7bd70c560a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:26:52.777151 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8544b8-46db-492b-a00e-7bd70c560a62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:26:52.777418 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8544b8-46db-492b-a00e-7bd70c560a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:26:52.777692 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8544b8-46db-492b-a00e-7bd70c560a62 admin admin] PATH_INFO: `/v3/projects/6337a7bc30d54734ad5d9435178a21a8` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:26:52.779693 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8544b8-46db-492b-a00e-7bd70c560a62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6337a7bc30d54734ad5d9435178a21a8)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:26:52.781721 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8544b8-46db-492b-a00e-7bd70c560a62 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:26:52.829161 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-6e8544b8-46db-492b-a00e-7bd70c560a62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6337a7bc30d54734ad5d9435178a21a8', 'request_id': 'req-6e8544b8-46db-492b-a00e-7bd70c560a62'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:26:52.838625 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-6e8544b8-46db-492b-a00e-7bd70c560a62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6337a7bc30d54734ad5d9435178a21a8', 'request_id': 'req-6e8544b8-46db-492b-a00e-7bd70c560a62'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:26:52.845001 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-6e8544b8-46db-492b-a00e-7bd70c560a62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6337a7bc30d54734ad5d9435178a21a8', 'request_id': 'req-6e8544b8-46db-492b-a00e-7bd70c560a62'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:26:52.857045 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-6e8544b8-46db-492b-a00e-7bd70c560a62 admin admin] The token cache is being invalidate because project 6337a7bc30d54734ad5d9435178a21a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79960) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 07:26:52.857277 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-6e8544b8-46db-492b-a00e-7bd70c560a62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:26:52.857939 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-6e8544b8-46db-492b-a00e-7bd70c560a62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:26:52.859530 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1385/2774] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Mar 30 07:26:52 2022] DELETE /identity/v3/projects/6337a7bc30d54734ad5d9435178a21a8 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:26:52.864873 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b823e4-aa32-4756-b5ea-aaf81638768e None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:26:52.865374 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b823e4-aa32-4756-b5ea-aaf81638768e None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:26:52.865655 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b823e4-aa32-4756-b5ea-aaf81638768e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:26:52.884716 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-74b823e4-aa32-4756-b5ea-aaf81638768e None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:26:52.885917 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-74b823e4-aa32-4756-b5ea-aaf81638768e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:26:52.951539 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1390/2775] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:26:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 07:26:52.959535 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb26b0-1f7c-4e30-84ba-d9082b6dee18 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:26:52.959854 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb26b0-1f7c-4e30-84ba-d9082b6dee18 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:26:52.960135 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb26b0-1f7c-4e30-84ba-d9082b6dee18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:26:52.980313 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-37cb26b0-1f7c-4e30-84ba-d9082b6dee18 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:26:52.981567 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-37cb26b0-1f7c-4e30-84ba-d9082b6dee18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:26:52.990410 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1386/2776] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:26:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:26:52.994554 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b823e4-aa32-4756-b5ea-aaf81638768e None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:26:53.005193 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b823e4-aa32-4756-b5ea-aaf81638768e None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:26:53.010020 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bfa4fd-24c9-4901-99f1-16496579c85b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:26:53.010764 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bfa4fd-24c9-4901-99f1-16496579c85b admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:26:53.011104 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bfa4fd-24c9-4901-99f1-16496579c85b admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:26:53.011440 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bfa4fd-24c9-4901-99f1-16496579c85b admin admin] PATH_INFO: `/v3/domains` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:26:53.012269 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bfa4fd-24c9-4901-99f1-16496579c85b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:26:53.012573 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bfa4fd-24c9-4901-99f1-16496579c85b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:26:53.014163 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bfa4fd-24c9-4901-99f1-16496579c85b admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:26:53.026605 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1391/2777] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Mar 30 07:26:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 30 07:26:53.031026 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cb26b0-1f7c-4e30-84ba-d9082b6dee18 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:26:53.040599 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cb26b0-1f7c-4e30-84ba-d9082b6dee18 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:26:53.045196 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13313c54-4c70-4f17-86b3-df16f1bfe8dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:26:53.045858 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13313c54-4c70-4f17-86b3-df16f1bfe8dd admin admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:26:53.046144 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13313c54-4c70-4f17-86b3-df16f1bfe8dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:26:53.046423 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13313c54-4c70-4f17-86b3-df16f1bfe8dd admin admin] PATH_INFO: `/v3/projects` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:26:53.047123 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13313c54-4c70-4f17-86b3-df16f1bfe8dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:26:53.049062 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13313c54-4c70-4f17-86b3-df16f1bfe8dd admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:26:53.075237 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1387/2778] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Mar 30 07:26:53 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:26:53.079715 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bfa4fd-24c9-4901-99f1-16496579c85b admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:26:53.090041 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bfa4fd-24c9-4901-99f1-16496579c85b admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:26:53.148346 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31303fd-f1e8-4bbc-8413-6137077f9d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:26:53.149031 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31303fd-f1e8-4bbc-8413-6137077f9d35 admin admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:26:53.149316 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31303fd-f1e8-4bbc-8413-6137077f9d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:26:53.149587 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31303fd-f1e8-4bbc-8413-6137077f9d35 admin admin] PATH_INFO: `/v3/users` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:26:53.150287 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31303fd-f1e8-4bbc-8413-6137077f9d35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:26:53.152260 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31303fd-f1e8-4bbc-8413-6137077f9d35 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:26:53.173719 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1392/2779] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Mar 30 07:26:53 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 07:26:53.177698 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13313c54-4c70-4f17-86b3-df16f1bfe8dd admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:26:53.188322 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13313c54-4c70-4f17-86b3-df16f1bfe8dd admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:26:53.194158 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8088b4f5-b2c9-4272-a90b-430ec4011111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:26:53.195200 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8088b4f5-b2c9-4272-a90b-430ec4011111 admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:26:53.196175 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8088b4f5-b2c9-4272-a90b-430ec4011111 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:26:53.196627 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8088b4f5-b2c9-4272-a90b-430ec4011111 admin admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:26:53.197537 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8088b4f5-b2c9-4272-a90b-430ec4011111 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:26:53.199307 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8088b4f5-b2c9-4272-a90b-430ec4011111 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:26:53.222966 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1388/2780] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:26:53 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:26:53.224447 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31303fd-f1e8-4bbc-8413-6137077f9d35 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:26:53.237299 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31303fd-f1e8-4bbc-8413-6137077f9d35 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:26:53.242763 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee272c8-463b-434a-8904-76d78b4a8302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:26:53.243564 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee272c8-463b-434a-8904-76d78b4a8302 admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:26:53.244527 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee272c8-463b-434a-8904-76d78b4a8302 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:26:53.244804 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee272c8-463b-434a-8904-76d78b4a8302 admin admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:26:53.245547 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee272c8-463b-434a-8904-76d78b4a8302 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:26:53.247202 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee272c8-463b-434a-8904-76d78b4a8302 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:26:53.261081 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1393/2781] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:26:53 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:26:53.262553 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8088b4f5-b2c9-4272-a90b-430ec4011111 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:26:53.276197 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8088b4f5-b2c9-4272-a90b-430ec4011111 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:26:53.281404 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb02bbc9-b10d-4c03-b90c-9b8deadb82f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:26:53.282543 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb02bbc9-b10d-4c03-b90c-9b8deadb82f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:26:53.282843 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb02bbc9-b10d-4c03-b90c-9b8deadb82f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:26:53.283120 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb02bbc9-b10d-4c03-b90c-9b8deadb82f2 admin admin] PATH_INFO: `/v3/projects/ca6cd681ebef448395fd71a1668601d0/users/dacefd8af8ee49998289bf64142e501d/roles/5d79031a64754b57ba120367465e2252` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:26:53.298217 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb02bbc9-b10d-4c03-b90c-9b8deadb82f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca6cd681ebef448395fd71a1668601d0, user_id=dacefd8af8ee49998289bf64142e501d, role_id=5d79031a64754b57ba120367465e2252)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:26:53.300869 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb02bbc9-b10d-4c03-b90c-9b8deadb82f2 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:26:53.321926 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1389/2782] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:26:53 2022] PUT /identity/v3/projects/ca6cd681ebef448395fd71a1668601d0/users/dacefd8af8ee49998289bf64142e501d/roles/5d79031a64754b57ba120367465e2252 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:26:53.334008 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ccc47-3b2b-49a2-89e6-33ff4d04495d None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:26:53.334206 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ccc47-3b2b-49a2-89e6-33ff4d04495d None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:26:53.334471 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ccc47-3b2b-49a2-89e6-33ff4d04495d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:26:53.365739 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-496ccc47-3b2b-49a2-89e6-33ff4d04495d None None] MFA Rules not processed for user `dacefd8af8ee49998289bf64142e501d`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:26:53.367235 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-496ccc47-3b2b-49a2-89e6-33ff4d04495d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:26:53.438679 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1394/2783] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:26:53 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:26:53.443184 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb02bbc9-b10d-4c03-b90c-9b8deadb82f2 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:26:53.540573 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb02bbc9-b10d-4c03-b90c-9b8deadb82f2 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:26:53.547594 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d81e460-c4e2-4291-b0e3-d4ddffe9ced3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:26:53.548457 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d81e460-c4e2-4291-b0e3-d4ddffe9ced3 admin admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:26:53.548877 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d81e460-c4e2-4291-b0e3-d4ddffe9ced3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:26:53.549205 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d81e460-c4e2-4291-b0e3-d4ddffe9ced3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:26:53.550071 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d81e460-c4e2-4291-b0e3-d4ddffe9ced3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:26:53.554812 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d81e460-c4e2-4291-b0e3-d4ddffe9ced3 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:26:53.606342 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1390/2784] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Mar 30 07:26:53 2022] POST /identity/v3/projects => generated 375 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:26:53.607212 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496ccc47-3b2b-49a2-89e6-33ff4d04495d None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:26:53.636821 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496ccc47-3b2b-49a2-89e6-33ff4d04495d None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:26:53.739459 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0657f9d5-f9e6-434b-909c-585db26a7f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:26:53.745418 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0657f9d5-f9e6-434b-909c-585db26a7f6e admin admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:26:53.745418 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0657f9d5-f9e6-434b-909c-585db26a7f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:26:53.745418 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0657f9d5-f9e6-434b-909c-585db26a7f6e admin admin] PATH_INFO: `/v3/users` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:26:53.745418 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0657f9d5-f9e6-434b-909c-585db26a7f6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:26:53.745418 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0657f9d5-f9e6-434b-909c-585db26a7f6e admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:26:53.777484 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1395/2785] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Mar 30 07:26:53 2022] POST /identity/v3/users => generated 294 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 07:26:53.781502 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d81e460-c4e2-4291-b0e3-d4ddffe9ced3 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:26:53.792306 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d81e460-c4e2-4291-b0e3-d4ddffe9ced3 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:26:53.797405 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bb8851-162a-482f-969b-29c9928da17b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:26:53.798075 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bb8851-162a-482f-969b-29c9928da17b admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:26:53.798359 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bb8851-162a-482f-969b-29c9928da17b admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:26:53.798689 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bb8851-162a-482f-969b-29c9928da17b admin admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:26:53.799357 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bb8851-162a-482f-969b-29c9928da17b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:26:53.800998 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bb8851-162a-482f-969b-29c9928da17b admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:26:53.817626 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1391/2786] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:26:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 30 07:26:53.818953 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0657f9d5-f9e6-434b-909c-585db26a7f6e admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:26:53.829548 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0657f9d5-f9e6-434b-909c-585db26a7f6e admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:26:53.835170 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e72ac4-46d6-493a-8e47-b1376ea3d116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:26:53.836103 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e72ac4-46d6-493a-8e47-b1376ea3d116 admin admin] REQUEST_METHOD: `PUT` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:26:53.836409 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e72ac4-46d6-493a-8e47-b1376ea3d116 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:26:53.836681 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e72ac4-46d6-493a-8e47-b1376ea3d116 admin admin] PATH_INFO: `/v3/projects/bb730228a66e4c5983084bceb60dd260/users/fa0e3369b5314aa0a7df763b4098d300/roles/1c39b9ab8cfd4c0ea71845831920a845` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:26:53.853024 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e72ac4-46d6-493a-8e47-b1376ea3d116 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb730228a66e4c5983084bceb60dd260, user_id=fa0e3369b5314aa0a7df763b4098d300, role_id=1c39b9ab8cfd4c0ea71845831920a845)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:26:53.855707 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e72ac4-46d6-493a-8e47-b1376ea3d116 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:26:53.871152 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1396/2787] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:26:53 2022] PUT /identity/v3/projects/bb730228a66e4c5983084bceb60dd260/users/fa0e3369b5314aa0a7df763b4098d300/roles/1c39b9ab8cfd4c0ea71845831920a845 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:26:53.875502 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bb8851-162a-482f-969b-29c9928da17b admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:26:53.886164 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bb8851-162a-482f-969b-29c9928da17b admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:26:53.948334 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475bbd67-f1d1-4759-a0bc-61de89326bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:26:53.948920 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475bbd67-f1d1-4759-a0bc-61de89326bdb admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:26:53.949202 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475bbd67-f1d1-4759-a0bc-61de89326bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:26:53.949467 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475bbd67-f1d1-4759-a0bc-61de89326bdb admin admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:26:53.950177 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475bbd67-f1d1-4759-a0bc-61de89326bdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:26:53.951769 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475bbd67-f1d1-4759-a0bc-61de89326bdb admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:26:53.963854 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1392/2788] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:26:53 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:26:53.966555 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e72ac4-46d6-493a-8e47-b1376ea3d116 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:26:53.977745 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e72ac4-46d6-493a-8e47-b1376ea3d116 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:26:53.982617 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a918ee95-47ad-4c4f-a8da-7ed94e228af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:26:53.983628 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a918ee95-47ad-4c4f-a8da-7ed94e228af5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:26:53.983961 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a918ee95-47ad-4c4f-a8da-7ed94e228af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:26:53.984228 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a918ee95-47ad-4c4f-a8da-7ed94e228af5 admin admin] PATH_INFO: `/v3/projects/bb730228a66e4c5983084bceb60dd260/users/fa0e3369b5314aa0a7df763b4098d300/roles/1c39b9ab8cfd4c0ea71845831920a845` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:26:53.986202 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a918ee95-47ad-4c4f-a8da-7ed94e228af5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb730228a66e4c5983084bceb60dd260, user_id=fa0e3369b5314aa0a7df763b4098d300, role_id=1c39b9ab8cfd4c0ea71845831920a845)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:26:53.988877 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a918ee95-47ad-4c4f-a8da-7ed94e228af5 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:26:53.999310 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1397/2789] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:26:53 2022] PUT /identity/v3/projects/bb730228a66e4c5983084bceb60dd260/users/fa0e3369b5314aa0a7df763b4098d300/roles/1c39b9ab8cfd4c0ea71845831920a845 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:26:54.009889 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dba19e-c7b8-4ea2-a235-b6aec62a1aad None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:26:54.010427 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dba19e-c7b8-4ea2-a235-b6aec62a1aad None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:26:54.010427 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dba19e-c7b8-4ea2-a235-b6aec62a1aad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:26:54.037260 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-50dba19e-c7b8-4ea2-a235-b6aec62a1aad None None] MFA Rules not processed for user `fa0e3369b5314aa0a7df763b4098d300`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:26:54.038472 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-50dba19e-c7b8-4ea2-a235-b6aec62a1aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:26:54.111270 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1393/2790] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:26:54 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 07:26:54.122220 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a918ee95-47ad-4c4f-a8da-7ed94e228af5 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:26:54.124046 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-a918ee95-47ad-4c4f-a8da-7ed94e228af5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:26:54.182784 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a918ee95-47ad-4c4f-a8da-7ed94e228af5 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:26:54.186652 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1219e7-8fb0-4a56-82a3-a9b8e53e6c4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e2fda180e8d448d895c40cdad34bc4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:26:54.187303 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1219e7-8fb0-4a56-82a3-a9b8e53e6c4a service cinder] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:26:54.187581 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1219e7-8fb0-4a56-82a3-a9b8e53e6c4a service cinder] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:26:54.187870 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1219e7-8fb0-4a56-82a3-a9b8e53e6c4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:26:54.257617 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1219e7-8fb0-4a56-82a3-a9b8e53e6c4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:26:54.259080 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1219e7-8fb0-4a56-82a3-a9b8e53e6c4a service cinder] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:26:54.268782 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1398/2791] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:26:54 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:26:57.126045 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dba19e-c7b8-4ea2-a235-b6aec62a1aad None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:26:57.127734 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-50dba19e-c7b8-4ea2-a235-b6aec62a1aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:26:57.190842 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dba19e-c7b8-4ea2-a235-b6aec62a1aad None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:26:57.195946 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62070cfc-c626-4e51-a728-2a14b6687582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:26:57.196824 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62070cfc-c626-4e51-a728-2a14b6687582 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:26:57.197102 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62070cfc-c626-4e51-a728-2a14b6687582 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:26:57.197382 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62070cfc-c626-4e51-a728-2a14b6687582 admin admin] PATH_INFO: `/v3/users/38e427dd29ea4380b01a1c257cc3da00` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:26:57.198608 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62070cfc-c626-4e51-a728-2a14b6687582 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38e427dd29ea4380b01a1c257cc3da00)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:26:57.200570 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62070cfc-c626-4e51-a728-2a14b6687582 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:26:57.250561 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-62070cfc-c626-4e51-a728-2a14b6687582 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38e427dd29ea4380b01a1c257cc3da00'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:26:57.251240 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-62070cfc-c626-4e51-a728-2a14b6687582 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38e427dd29ea4380b01a1c257cc3da00'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:26:57.260325 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-62070cfc-c626-4e51-a728-2a14b6687582 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38e427dd29ea4380b01a1c257cc3da00'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:26:57.272223 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-62070cfc-c626-4e51-a728-2a14b6687582 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38e427dd29ea4380b01a1c257cc3da00'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:26:57.272874 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-62070cfc-c626-4e51-a728-2a14b6687582 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38e427dd29ea4380b01a1c257cc3da00'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:26:57.285230 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1394/2792] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Mar 30 07:26:57 2022] DELETE /identity/v3/users/38e427dd29ea4380b01a1c257cc3da00 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:26:57.477738 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1219e7-8fb0-4a56-82a3-a9b8e53e6c4a service cinder] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:26:57.489320 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1219e7-8fb0-4a56-82a3-a9b8e53e6c4a service cinder] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:26:57.544352 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8439c95b-114a-4966-8fb9-9e38a5aab3f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:26:57.545253 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8439c95b-114a-4966-8fb9-9e38a5aab3f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:26:57.545531 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8439c95b-114a-4966-8fb9-9e38a5aab3f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:26:57.545800 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8439c95b-114a-4966-8fb9-9e38a5aab3f7 admin admin] PATH_INFO: `/v3/projects/803772b9959c49c988cb738b94678917` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:26:57.547006 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8439c95b-114a-4966-8fb9-9e38a5aab3f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=803772b9959c49c988cb738b94678917)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:26:57.548939 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8439c95b-114a-4966-8fb9-9e38a5aab3f7 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:26:57.596603 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-8439c95b-114a-4966-8fb9-9e38a5aab3f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '803772b9959c49c988cb738b94678917', 'request_id': 'req-8439c95b-114a-4966-8fb9-9e38a5aab3f7'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:26:57.602391 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-8439c95b-114a-4966-8fb9-9e38a5aab3f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '803772b9959c49c988cb738b94678917', 'request_id': 'req-8439c95b-114a-4966-8fb9-9e38a5aab3f7'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:26:57.610243 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-8439c95b-114a-4966-8fb9-9e38a5aab3f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '803772b9959c49c988cb738b94678917', 'request_id': 'req-8439c95b-114a-4966-8fb9-9e38a5aab3f7'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:26:57.621447 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-8439c95b-114a-4966-8fb9-9e38a5aab3f7 admin admin] The token cache is being invalidate because project 803772b9959c49c988cb738b94678917 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79961) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 07:26:57.621730 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-8439c95b-114a-4966-8fb9-9e38a5aab3f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:26:57.622377 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-8439c95b-114a-4966-8fb9-9e38a5aab3f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:26:57.623995 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1399/2793] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Mar 30 07:26:57 2022] DELETE /identity/v3/projects/803772b9959c49c988cb738b94678917 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:26:57.628177 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62070cfc-c626-4e51-a728-2a14b6687582 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:26:57.630116 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-62070cfc-c626-4e51-a728-2a14b6687582 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:26:57.644003 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62070cfc-c626-4e51-a728-2a14b6687582 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:26:57.703152 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e5059b-5f0a-4532-9fde-21bc447c524e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:26:57.704066 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e5059b-5f0a-4532-9fde-21bc447c524e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:26:57.704348 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e5059b-5f0a-4532-9fde-21bc447c524e admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:26:57.704622 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e5059b-5f0a-4532-9fde-21bc447c524e admin admin] PATH_INFO: `/v3/users/81d05f3fa31c4752abacf9d7e697dafb` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:26:57.705864 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e5059b-5f0a-4532-9fde-21bc447c524e admin admin] RBAC: Authorizing `identity:delete_user(user_id=81d05f3fa31c4752abacf9d7e697dafb)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:26:57.707792 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e5059b-5f0a-4532-9fde-21bc447c524e admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:26:57.760550 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-26e5059b-5f0a-4532-9fde-21bc447c524e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81d05f3fa31c4752abacf9d7e697dafb'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:26:57.761266 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-26e5059b-5f0a-4532-9fde-21bc447c524e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81d05f3fa31c4752abacf9d7e697dafb'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:26:57.769827 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-26e5059b-5f0a-4532-9fde-21bc447c524e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81d05f3fa31c4752abacf9d7e697dafb'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:26:57.781995 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-26e5059b-5f0a-4532-9fde-21bc447c524e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81d05f3fa31c4752abacf9d7e697dafb'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:26:57.782737 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-26e5059b-5f0a-4532-9fde-21bc447c524e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81d05f3fa31c4752abacf9d7e697dafb'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:26:57.795989 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1395/2794] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Mar 30 07:26:57 2022] DELETE /identity/v3/users/81d05f3fa31c4752abacf9d7e697dafb => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:26:57.976204 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8439c95b-114a-4966-8fb9-9e38a5aab3f7 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:26:57.978170 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-8439c95b-114a-4966-8fb9-9e38a5aab3f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:26:57.992006 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8439c95b-114a-4966-8fb9-9e38a5aab3f7 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:26:58.047520 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcf4332-356c-4962-825f-369cc620ff38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:26:58.048467 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf4332-356c-4962-825f-369cc620ff38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:26:58.048743 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf4332-356c-4962-825f-369cc620ff38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:26:58.049014 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf4332-356c-4962-825f-369cc620ff38 admin admin] PATH_INFO: `/v3/projects/571848e3be7a42febae87b6a467ef6bf` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:26:58.050220 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcf4332-356c-4962-825f-369cc620ff38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=571848e3be7a42febae87b6a467ef6bf)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:26:58.052221 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcf4332-356c-4962-825f-369cc620ff38 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:26:58.104123 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-efcf4332-356c-4962-825f-369cc620ff38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '571848e3be7a42febae87b6a467ef6bf', 'request_id': 'req-efcf4332-356c-4962-825f-369cc620ff38'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:26:58.110124 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-efcf4332-356c-4962-825f-369cc620ff38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '571848e3be7a42febae87b6a467ef6bf', 'request_id': 'req-efcf4332-356c-4962-825f-369cc620ff38'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:26:58.119499 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-efcf4332-356c-4962-825f-369cc620ff38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '571848e3be7a42febae87b6a467ef6bf', 'request_id': 'req-efcf4332-356c-4962-825f-369cc620ff38'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:26:58.131547 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-efcf4332-356c-4962-825f-369cc620ff38 admin admin] The token cache is being invalidate because project 571848e3be7a42febae87b6a467ef6bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79961) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 07:26:58.131875 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-efcf4332-356c-4962-825f-369cc620ff38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:26:58.132610 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-efcf4332-356c-4962-825f-369cc620ff38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:26:58.134320 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1400/2795] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Mar 30 07:26:57 2022] DELETE /identity/v3/projects/571848e3be7a42febae87b6a467ef6bf => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:26:58.910526 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e5059b-5f0a-4532-9fde-21bc447c524e admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:26:58.912240 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-26e5059b-5f0a-4532-9fde-21bc447c524e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:26:58.967985 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e5059b-5f0a-4532-9fde-21bc447c524e admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:26:59.019290 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af33251-f82a-4ce6-bc7c-6c437203d1a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e2fda180e8d448d895c40cdad34bc4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:26:59.019984 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af33251-f82a-4ce6-bc7c-6c437203d1a0 service cinder] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:26:59.020264 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af33251-f82a-4ce6-bc7c-6c437203d1a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:26:59.020530 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af33251-f82a-4ce6-bc7c-6c437203d1a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:26:59.023006 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-6af33251-f82a-4ce6-bc7c-6c437203d1a0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:26:59.089237 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af33251-f82a-4ce6-bc7c-6c437203d1a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:26:59.090692 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af33251-f82a-4ce6-bc7c-6c437203d1a0 service cinder] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:26:59.100761 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1396/2796] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:26:58 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 30 07:27:20.141341 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcf4332-356c-4962-825f-369cc620ff38 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:27:20.143771 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-efcf4332-356c-4962-825f-369cc620ff38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:27:20.222899 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcf4332-356c-4962-825f-369cc620ff38 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:27:20.228638 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84158fe1-2d93-4a89-b115-97cb252eb37a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:27:20.229515 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84158fe1-2d93-4a89-b115-97cb252eb37a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:27:20.229785 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84158fe1-2d93-4a89-b115-97cb252eb37a admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:27:20.230051 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84158fe1-2d93-4a89-b115-97cb252eb37a admin admin] PATH_INFO: `/v3/users/dacefd8af8ee49998289bf64142e501d` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:27:20.231377 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84158fe1-2d93-4a89-b115-97cb252eb37a admin admin] RBAC: Authorizing `identity:delete_user(user_id=dacefd8af8ee49998289bf64142e501d)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:27:20.233320 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84158fe1-2d93-4a89-b115-97cb252eb37a admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:27:20.279362 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-84158fe1-2d93-4a89-b115-97cb252eb37a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dacefd8af8ee49998289bf64142e501d'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:27:20.280027 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-84158fe1-2d93-4a89-b115-97cb252eb37a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dacefd8af8ee49998289bf64142e501d'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:27:20.280614 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-84158fe1-2d93-4a89-b115-97cb252eb37a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dacefd8af8ee49998289bf64142e501d'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:27:20.288908 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-84158fe1-2d93-4a89-b115-97cb252eb37a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dacefd8af8ee49998289bf64142e501d'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:27:20.295580 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-84158fe1-2d93-4a89-b115-97cb252eb37a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dacefd8af8ee49998289bf64142e501d'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:27:20.312437 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1401/2797] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Mar 30 07:27:20 2022] DELETE /identity/v3/users/dacefd8af8ee49998289bf64142e501d => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:27:20.317061 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7d4589-8df1-4a57-a513-247c0cfd2dd3 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:27:20.317556 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7d4589-8df1-4a57-a513-247c0cfd2dd3 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:27:20.317689 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7d4589-8df1-4a57-a513-247c0cfd2dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:27:20.335556 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-0f7d4589-8df1-4a57-a513-247c0cfd2dd3 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:27:20.336833 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-0f7d4589-8df1-4a57-a513-247c0cfd2dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:27:20.419111 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1397/2798] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:27:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:27:20.429117 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84158fe1-2d93-4a89-b115-97cb252eb37a admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:27:20.430637 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-84158fe1-2d93-4a89-b115-97cb252eb37a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:27:20.487762 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84158fe1-2d93-4a89-b115-97cb252eb37a admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:27:20.492083 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81639a83-e293-4d6d-8d4f-9bdc1fe060f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3802cb341445f994b9204744060ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:27:20.492719 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81639a83-e293-4d6d-8d4f-9bdc1fe060f4 service neutron] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:27:20.492966 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81639a83-e293-4d6d-8d4f-9bdc1fe060f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:27:20.493251 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81639a83-e293-4d6d-8d4f-9bdc1fe060f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:27:20.502759 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81639a83-e293-4d6d-8d4f-9bdc1fe060f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:27:20.504221 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81639a83-e293-4d6d-8d4f-9bdc1fe060f4 service neutron] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:27:20.513672 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1402/2799] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:27:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:27:20.788095 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7d4589-8df1-4a57-a513-247c0cfd2dd3 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:27:20.789574 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-0f7d4589-8df1-4a57-a513-247c0cfd2dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:27:20.801613 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7d4589-8df1-4a57-a513-247c0cfd2dd3 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:27:20.806567 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24bfc4f-35d7-480f-baf6-ac974b11e9e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:27:20.807440 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24bfc4f-35d7-480f-baf6-ac974b11e9e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:27:20.807717 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24bfc4f-35d7-480f-baf6-ac974b11e9e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:27:20.808021 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24bfc4f-35d7-480f-baf6-ac974b11e9e9 admin admin] PATH_INFO: `/v3/projects/ca6cd681ebef448395fd71a1668601d0` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:27:20.809317 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24bfc4f-35d7-480f-baf6-ac974b11e9e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca6cd681ebef448395fd71a1668601d0)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:27:20.811388 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24bfc4f-35d7-480f-baf6-ac974b11e9e9 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:27:20.861561 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-d24bfc4f-35d7-480f-baf6-ac974b11e9e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca6cd681ebef448395fd71a1668601d0', 'request_id': 'req-d24bfc4f-35d7-480f-baf6-ac974b11e9e9'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:27:20.870303 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-d24bfc4f-35d7-480f-baf6-ac974b11e9e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca6cd681ebef448395fd71a1668601d0', 'request_id': 'req-d24bfc4f-35d7-480f-baf6-ac974b11e9e9'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:27:20.875823 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-d24bfc4f-35d7-480f-baf6-ac974b11e9e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca6cd681ebef448395fd71a1668601d0', 'request_id': 'req-d24bfc4f-35d7-480f-baf6-ac974b11e9e9'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:27:20.886560 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-d24bfc4f-35d7-480f-baf6-ac974b11e9e9 admin admin] The token cache is being invalidate because project ca6cd681ebef448395fd71a1668601d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79960) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 07:27:20.886834 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-d24bfc4f-35d7-480f-baf6-ac974b11e9e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:27:20.887547 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-d24bfc4f-35d7-480f-baf6-ac974b11e9e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:27:20.889106 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1398/2800] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Mar 30 07:27:20 2022] DELETE /identity/v3/projects/ca6cd681ebef448395fd71a1668601d0 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:27:20.893144 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81639a83-e293-4d6d-8d4f-9bdc1fe060f4 service neutron] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:27:20.902778 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81639a83-e293-4d6d-8d4f-9bdc1fe060f4 service neutron] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:27:20.961488 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe43d2dc-4de5-4183-a4c3-a5cce24b5644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:27:20.962273 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe43d2dc-4de5-4183-a4c3-a5cce24b5644 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:27:20.962549 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe43d2dc-4de5-4183-a4c3-a5cce24b5644 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:27:20.962815 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe43d2dc-4de5-4183-a4c3-a5cce24b5644 admin admin] PATH_INFO: `/v3/users/fa0e3369b5314aa0a7df763b4098d300` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:27:20.964156 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe43d2dc-4de5-4183-a4c3-a5cce24b5644 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa0e3369b5314aa0a7df763b4098d300)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:27:20.966114 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe43d2dc-4de5-4183-a4c3-a5cce24b5644 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:27:21.015698 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-fe43d2dc-4de5-4183-a4c3-a5cce24b5644 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa0e3369b5314aa0a7df763b4098d300'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:27:21.016372 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-fe43d2dc-4de5-4183-a4c3-a5cce24b5644 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa0e3369b5314aa0a7df763b4098d300'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:27:21.016965 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-fe43d2dc-4de5-4183-a4c3-a5cce24b5644 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa0e3369b5314aa0a7df763b4098d300'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:27:21.024418 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-fe43d2dc-4de5-4183-a4c3-a5cce24b5644 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa0e3369b5314aa0a7df763b4098d300'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:27:21.031782 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-fe43d2dc-4de5-4183-a4c3-a5cce24b5644 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa0e3369b5314aa0a7df763b4098d300'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:27:21.049794 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1403/2801] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Mar 30 07:27:20 2022] DELETE /identity/v3/users/fa0e3369b5314aa0a7df763b4098d300 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:27:21.324908 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24bfc4f-35d7-480f-baf6-ac974b11e9e9 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:27:21.326388 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-d24bfc4f-35d7-480f-baf6-ac974b11e9e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:27:21.339492 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24bfc4f-35d7-480f-baf6-ac974b11e9e9 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:27:21.399239 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf33d07-77d0-4a0d-978a-4647fac745a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:27:21.400162 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf33d07-77d0-4a0d-978a-4647fac745a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:27:21.400439 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf33d07-77d0-4a0d-978a-4647fac745a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:27:21.400707 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf33d07-77d0-4a0d-978a-4647fac745a3 admin admin] PATH_INFO: `/v3/projects/bb730228a66e4c5983084bceb60dd260` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:27:21.402047 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf33d07-77d0-4a0d-978a-4647fac745a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb730228a66e4c5983084bceb60dd260)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:27:21.404450 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf33d07-77d0-4a0d-978a-4647fac745a3 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:27:21.452763 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-cdf33d07-77d0-4a0d-978a-4647fac745a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb730228a66e4c5983084bceb60dd260', 'request_id': 'req-cdf33d07-77d0-4a0d-978a-4647fac745a3'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:27:21.461065 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-cdf33d07-77d0-4a0d-978a-4647fac745a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb730228a66e4c5983084bceb60dd260', 'request_id': 'req-cdf33d07-77d0-4a0d-978a-4647fac745a3'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:27:21.466672 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-cdf33d07-77d0-4a0d-978a-4647fac745a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb730228a66e4c5983084bceb60dd260', 'request_id': 'req-cdf33d07-77d0-4a0d-978a-4647fac745a3'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:27:21.477957 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-cdf33d07-77d0-4a0d-978a-4647fac745a3 admin admin] The token cache is being invalidate because project bb730228a66e4c5983084bceb60dd260 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79960) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 07:27:21.478248 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-cdf33d07-77d0-4a0d-978a-4647fac745a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:27:21.478959 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-cdf33d07-77d0-4a0d-978a-4647fac745a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:27:21.480649 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1399/2802] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Mar 30 07:27:21 2022] DELETE /identity/v3/projects/bb730228a66e4c5983084bceb60dd260 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:27:21.486068 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15facaa-1525-4dda-b311-7cc738384e1e None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:27:21.486570 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15facaa-1525-4dda-b311-7cc738384e1e None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:27:21.486671 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15facaa-1525-4dda-b311-7cc738384e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:27:21.506924 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-a15facaa-1525-4dda-b311-7cc738384e1e None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:27:21.508097 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-a15facaa-1525-4dda-b311-7cc738384e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:27:21.572890 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1404/2803] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:27:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:27:21.583336 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7c275e-0639-40b3-9482-4e32065278b9 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:27:21.583688 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7c275e-0639-40b3-9482-4e32065278b9 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:27:21.584197 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7c275e-0639-40b3-9482-4e32065278b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:27:21.610114 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-aa7c275e-0639-40b3-9482-4e32065278b9 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:27:21.611323 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-aa7c275e-0639-40b3-9482-4e32065278b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:27:21.621076 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1400/2804] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:27:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:27:21.626135 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15facaa-1525-4dda-b311-7cc738384e1e None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:27:21.640593 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15facaa-1525-4dda-b311-7cc738384e1e None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:27:21.647503 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5899e805-bb95-4e02-92cc-df4b0a5c605d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:27:21.648443 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5899e805-bb95-4e02-92cc-df4b0a5c605d admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:27:21.648807 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5899e805-bb95-4e02-92cc-df4b0a5c605d admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:27:21.649097 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5899e805-bb95-4e02-92cc-df4b0a5c605d admin admin] PATH_INFO: `/v3/domains` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:27:21.650106 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5899e805-bb95-4e02-92cc-df4b0a5c605d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:27:21.650488 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5899e805-bb95-4e02-92cc-df4b0a5c605d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:27:21.653299 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5899e805-bb95-4e02-92cc-df4b0a5c605d admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:27:21.670858 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1405/2805] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Mar 30 07:27:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:27:21.675973 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7c275e-0639-40b3-9482-4e32065278b9 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:27:21.690518 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7c275e-0639-40b3-9482-4e32065278b9 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:27:21.699222 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66023cea-0c4e-42c2-ac8b-f40587a0cc2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:27:21.700009 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66023cea-0c4e-42c2-ac8b-f40587a0cc2d admin admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:27:21.700293 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66023cea-0c4e-42c2-ac8b-f40587a0cc2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:27:21.700670 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66023cea-0c4e-42c2-ac8b-f40587a0cc2d admin admin] PATH_INFO: `/v3/projects` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:27:21.701364 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66023cea-0c4e-42c2-ac8b-f40587a0cc2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:27:21.703276 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66023cea-0c4e-42c2-ac8b-f40587a0cc2d admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:27:21.733234 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1401/2806] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Mar 30 07:27:21 2022] POST /identity/v3/projects => generated 399 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:27:21.737472 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5899e805-bb95-4e02-92cc-df4b0a5c605d admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:27:21.748961 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5899e805-bb95-4e02-92cc-df4b0a5c605d admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:27:21.813794 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f7f04d-da23-4df7-98d9-b8574cca432f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:27:21.814475 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f7f04d-da23-4df7-98d9-b8574cca432f admin admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:27:21.814754 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f7f04d-da23-4df7-98d9-b8574cca432f admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:27:21.815021 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f7f04d-da23-4df7-98d9-b8574cca432f admin admin] PATH_INFO: `/v3/users` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:27:21.815722 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f7f04d-da23-4df7-98d9-b8574cca432f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:27:21.817696 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f7f04d-da23-4df7-98d9-b8574cca432f admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:27:21.838856 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1406/2807] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Mar 30 07:27:21 2022] POST /identity/v3/users => generated 300 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:27:21.843552 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66023cea-0c4e-42c2-ac8b-f40587a0cc2d admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:27:21.854397 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66023cea-0c4e-42c2-ac8b-f40587a0cc2d admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:27:21.859998 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8967523-65b5-4082-9abc-b0a0d5a574b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:27:21.860659 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8967523-65b5-4082-9abc-b0a0d5a574b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:27:21.860934 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8967523-65b5-4082-9abc-b0a0d5a574b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:27:21.861233 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8967523-65b5-4082-9abc-b0a0d5a574b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:27:21.861919 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8967523-65b5-4082-9abc-b0a0d5a574b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:27:21.863522 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8967523-65b5-4082-9abc-b0a0d5a574b7 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:27:21.874306 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1402/2808] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:27:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 30 07:27:21.879355 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f7f04d-da23-4df7-98d9-b8574cca432f admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:27:21.889334 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f7f04d-da23-4df7-98d9-b8574cca432f admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:27:21.894711 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66a4285-2de6-4f5f-b986-f277a8d85954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:27:21.895529 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66a4285-2de6-4f5f-b986-f277a8d85954 admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:27:21.896044 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66a4285-2de6-4f5f-b986-f277a8d85954 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:27:21.896395 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66a4285-2de6-4f5f-b986-f277a8d85954 admin admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:27:21.897631 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66a4285-2de6-4f5f-b986-f277a8d85954 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:27:21.900358 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66a4285-2de6-4f5f-b986-f277a8d85954 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:27:21.911842 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1407/2809] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:27:21 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:27:21.917039 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8967523-65b5-4082-9abc-b0a0d5a574b7 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:27:21.936215 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8967523-65b5-4082-9abc-b0a0d5a574b7 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:27:21.945723 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe4184c-f274-4e19-bc98-de639d6c5577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:27:21.947190 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe4184c-f274-4e19-bc98-de639d6c5577 admin admin] REQUEST_METHOD: `PUT` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:27:21.947482 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe4184c-f274-4e19-bc98-de639d6c5577 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:27:21.947751 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe4184c-f274-4e19-bc98-de639d6c5577 admin admin] PATH_INFO: `/v3/projects/0705b6f2568c455a84d7346394cfb344/users/acfebcf27130457986586a0769b238a5/roles/5d79031a64754b57ba120367465e2252` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:27:21.970659 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe4184c-f274-4e19-bc98-de639d6c5577 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0705b6f2568c455a84d7346394cfb344, user_id=acfebcf27130457986586a0769b238a5, role_id=5d79031a64754b57ba120367465e2252)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:27:21.973374 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe4184c-f274-4e19-bc98-de639d6c5577 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:27:21.990819 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1403/2810] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:27:21 2022] PUT /identity/v3/projects/0705b6f2568c455a84d7346394cfb344/users/acfebcf27130457986586a0769b238a5/roles/5d79031a64754b57ba120367465e2252 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:27:22.002506 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf08017-4d75-4baf-89b8-ee04f4f78f3a None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:27:22.002792 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf08017-4d75-4baf-89b8-ee04f4f78f3a None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:27:22.003065 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf08017-4d75-4baf-89b8-ee04f4f78f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:27:22.031408 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-6cf08017-4d75-4baf-89b8-ee04f4f78f3a None None] MFA Rules not processed for user `acfebcf27130457986586a0769b238a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:27:22.032636 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-6cf08017-4d75-4baf-89b8-ee04f4f78f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:27:22.107154 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1408/2811] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:27:22 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 07:27:22.113808 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe4184c-f274-4e19-bc98-de639d6c5577 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:27:22.178903 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe4184c-f274-4e19-bc98-de639d6c5577 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:27:22.184332 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1c79a0-4050-45bb-a191-2191eeafe0e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:27:22.184979 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1c79a0-4050-45bb-a191-2191eeafe0e6 admin admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:27:22.185299 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1c79a0-4050-45bb-a191-2191eeafe0e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:27:22.185568 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1c79a0-4050-45bb-a191-2191eeafe0e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:27:22.186304 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1c79a0-4050-45bb-a191-2191eeafe0e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:27:22.188209 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1c79a0-4050-45bb-a191-2191eeafe0e6 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:27:22.220020 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1404/2812] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Mar 30 07:27:22 2022] POST /identity/v3/projects => generated 401 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:27:22.226319 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf08017-4d75-4baf-89b8-ee04f4f78f3a None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:27:22.242103 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf08017-4d75-4baf-89b8-ee04f4f78f3a None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:27:22.304977 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce854969-37bd-482c-9f46-f03f6bccd168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:27:22.305652 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce854969-37bd-482c-9f46-f03f6bccd168 admin admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:27:22.305934 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce854969-37bd-482c-9f46-f03f6bccd168 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:27:22.306204 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce854969-37bd-482c-9f46-f03f6bccd168 admin admin] PATH_INFO: `/v3/users` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:27:22.306889 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce854969-37bd-482c-9f46-f03f6bccd168 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:27:22.308868 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce854969-37bd-482c-9f46-f03f6bccd168 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:27:22.331508 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1409/2813] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Mar 30 07:27:22 2022] POST /identity/v3/users => generated 307 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:27:22.335638 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1c79a0-4050-45bb-a191-2191eeafe0e6 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:27:22.346102 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1c79a0-4050-45bb-a191-2191eeafe0e6 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:27:22.351034 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12258255-948f-478b-b78d-d15c9b4f2653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:27:22.351726 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12258255-948f-478b-b78d-d15c9b4f2653 admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:27:22.352026 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12258255-948f-478b-b78d-d15c9b4f2653 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:27:22.352692 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12258255-948f-478b-b78d-d15c9b4f2653 admin admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:27:22.353413 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12258255-948f-478b-b78d-d15c9b4f2653 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:27:22.355032 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12258255-948f-478b-b78d-d15c9b4f2653 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:27:22.365394 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1405/2814] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:27:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:27:22.369372 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce854969-37bd-482c-9f46-f03f6bccd168 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:27:22.379695 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce854969-37bd-482c-9f46-f03f6bccd168 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:27:22.384593 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a837880-bd7e-4c05-83ae-88b3ffb0d9e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:27:22.385481 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a837880-bd7e-4c05-83ae-88b3ffb0d9e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:27:22.385758 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a837880-bd7e-4c05-83ae-88b3ffb0d9e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:27:22.386031 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a837880-bd7e-4c05-83ae-88b3ffb0d9e3 admin admin] PATH_INFO: `/v3/projects/4a330f0231304d47b2d10f42bd0d0b48/users/cd85e957d9884f43806b3154ee01acb9/roles/1c39b9ab8cfd4c0ea71845831920a845` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:27:22.400654 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a837880-bd7e-4c05-83ae-88b3ffb0d9e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a330f0231304d47b2d10f42bd0d0b48, user_id=cd85e957d9884f43806b3154ee01acb9, role_id=1c39b9ab8cfd4c0ea71845831920a845)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:27:22.403264 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a837880-bd7e-4c05-83ae-88b3ffb0d9e3 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:27:22.417150 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1410/2815] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:27:22 2022] PUT /identity/v3/projects/4a330f0231304d47b2d10f42bd0d0b48/users/cd85e957d9884f43806b3154ee01acb9/roles/1c39b9ab8cfd4c0ea71845831920a845 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:27:22.421147 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12258255-948f-478b-b78d-d15c9b4f2653 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:27:22.431316 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12258255-948f-478b-b78d-d15c9b4f2653 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:27:22.494824 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea7e211-55cc-4a24-bb5e-cfe15ed41771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:27:22.495499 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea7e211-55cc-4a24-bb5e-cfe15ed41771 admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:27:22.495830 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea7e211-55cc-4a24-bb5e-cfe15ed41771 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:27:22.496108 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea7e211-55cc-4a24-bb5e-cfe15ed41771 admin admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:27:22.496834 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea7e211-55cc-4a24-bb5e-cfe15ed41771 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:27:22.498657 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea7e211-55cc-4a24-bb5e-cfe15ed41771 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:27:22.509203 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1406/2816] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:27:22 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:27:22.513803 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a837880-bd7e-4c05-83ae-88b3ffb0d9e3 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:27:22.524350 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a837880-bd7e-4c05-83ae-88b3ffb0d9e3 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:27:22.529237 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f6526a-e20f-4412-9403-65954bf979c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:27:22.530428 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f6526a-e20f-4412-9403-65954bf979c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:27:22.530678 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f6526a-e20f-4412-9403-65954bf979c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:27:22.530951 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f6526a-e20f-4412-9403-65954bf979c0 admin admin] PATH_INFO: `/v3/projects/4a330f0231304d47b2d10f42bd0d0b48/users/cd85e957d9884f43806b3154ee01acb9/roles/1c39b9ab8cfd4c0ea71845831920a845` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:27:22.533033 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f6526a-e20f-4412-9403-65954bf979c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a330f0231304d47b2d10f42bd0d0b48, user_id=cd85e957d9884f43806b3154ee01acb9, role_id=1c39b9ab8cfd4c0ea71845831920a845)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:27:22.535650 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f6526a-e20f-4412-9403-65954bf979c0 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:27:22.546493 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1411/2817] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:27:22 2022] PUT /identity/v3/projects/4a330f0231304d47b2d10f42bd0d0b48/users/cd85e957d9884f43806b3154ee01acb9/roles/1c39b9ab8cfd4c0ea71845831920a845 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:27:22.558433 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de65457-c5ac-4015-8246-88b57e59ec60 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:27:22.558721 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de65457-c5ac-4015-8246-88b57e59ec60 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:27:22.558992 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de65457-c5ac-4015-8246-88b57e59ec60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:27:22.594240 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-7de65457-c5ac-4015-8246-88b57e59ec60 None None] MFA Rules not processed for user `cd85e957d9884f43806b3154ee01acb9`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:27:22.595454 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-7de65457-c5ac-4015-8246-88b57e59ec60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:27:22.675143 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1407/2818] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:27:22 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:27:22.686149 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f6526a-e20f-4412-9403-65954bf979c0 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:27:22.688159 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-c0f6526a-e20f-4412-9403-65954bf979c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:27:22.749317 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f6526a-e20f-4412-9403-65954bf979c0 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:27:22.753336 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986c6bdd-7e95-4fee-a8a2-4e984c9491dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e2fda180e8d448d895c40cdad34bc4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:27:22.753994 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c6bdd-7e95-4fee-a8a2-4e984c9491dd service cinder] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:27:22.754276 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c6bdd-7e95-4fee-a8a2-4e984c9491dd service cinder] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:27:22.754552 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c6bdd-7e95-4fee-a8a2-4e984c9491dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:27:22.764162 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986c6bdd-7e95-4fee-a8a2-4e984c9491dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:27:22.765606 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986c6bdd-7e95-4fee-a8a2-4e984c9491dd service cinder] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:27:22.775161 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1412/2819] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:27:22 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:27:22.861049 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de65457-c5ac-4015-8246-88b57e59ec60 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:27:22.873875 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de65457-c5ac-4015-8246-88b57e59ec60 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:27:22.877914 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b141bd-18d7-4f16-bf97-6f4073a23839 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e2fda180e8d448d895c40cdad34bc4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:27:22.878566 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b141bd-18d7-4f16-bf97-6f4073a23839 service cinder] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:27:22.878839 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b141bd-18d7-4f16-bf97-6f4073a23839 service cinder] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:27:22.879110 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b141bd-18d7-4f16-bf97-6f4073a23839 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:27:22.937797 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b141bd-18d7-4f16-bf97-6f4073a23839 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:27:22.939173 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b141bd-18d7-4f16-bf97-6f4073a23839 service cinder] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:27:22.949306 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1408/2820] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:27:22 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:27:27.055561 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986c6bdd-7e95-4fee-a8a2-4e984c9491dd service cinder] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:27:27.121096 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986c6bdd-7e95-4fee-a8a2-4e984c9491dd service cinder] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:27:27.128784 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a83734e-2ec2-4710-a6ef-d7533c5d200b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:27:27.129678 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a83734e-2ec2-4710-a6ef-d7533c5d200b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:27:27.129955 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a83734e-2ec2-4710-a6ef-d7533c5d200b admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:27:27.130222 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a83734e-2ec2-4710-a6ef-d7533c5d200b admin admin] PATH_INFO: `/v3/users/acfebcf27130457986586a0769b238a5` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:27:27.131654 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a83734e-2ec2-4710-a6ef-d7533c5d200b admin admin] RBAC: Authorizing `identity:delete_user(user_id=acfebcf27130457986586a0769b238a5)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:27:27.133650 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a83734e-2ec2-4710-a6ef-d7533c5d200b admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:27:27.186344 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-1a83734e-2ec2-4710-a6ef-d7533c5d200b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acfebcf27130457986586a0769b238a5'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:27:27.186909 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-1a83734e-2ec2-4710-a6ef-d7533c5d200b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acfebcf27130457986586a0769b238a5'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:27:27.187540 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-1a83734e-2ec2-4710-a6ef-d7533c5d200b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acfebcf27130457986586a0769b238a5'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:27:27.197451 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-1a83734e-2ec2-4710-a6ef-d7533c5d200b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acfebcf27130457986586a0769b238a5'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:27:27.205824 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-1a83734e-2ec2-4710-a6ef-d7533c5d200b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acfebcf27130457986586a0769b238a5'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:27:27.224861 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1413/2821] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Mar 30 07:27:27 2022] DELETE /identity/v3/users/acfebcf27130457986586a0769b238a5 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:27:27.229988 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc6a0d3-87ba-4987-b88c-d74ef2777375 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:27:27.230479 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc6a0d3-87ba-4987-b88c-d74ef2777375 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:27:27.230600 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc6a0d3-87ba-4987-b88c-d74ef2777375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:27:27.248680 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-cdc6a0d3-87ba-4987-b88c-d74ef2777375 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:27:27.249862 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-cdc6a0d3-87ba-4987-b88c-d74ef2777375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:27:27.317251 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1409/2822] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:27:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 07:27:27.330693 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a83734e-2ec2-4710-a6ef-d7533c5d200b admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:27:27.332178 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-1a83734e-2ec2-4710-a6ef-d7533c5d200b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:27:27.401532 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a83734e-2ec2-4710-a6ef-d7533c5d200b admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:27:27.405744 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74668f27-3685-43bc-8891-d13e0d4335e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3802cb341445f994b9204744060ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:27:27.406392 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74668f27-3685-43bc-8891-d13e0d4335e8 service neutron] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:27:27.406677 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74668f27-3685-43bc-8891-d13e0d4335e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:27:27.406954 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74668f27-3685-43bc-8891-d13e0d4335e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:27:27.416381 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74668f27-3685-43bc-8891-d13e0d4335e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:27:27.417821 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74668f27-3685-43bc-8891-d13e0d4335e8 service neutron] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:27:27.427379 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1414/2823] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:27:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:27:27.697540 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc6a0d3-87ba-4987-b88c-d74ef2777375 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:27:27.699343 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-cdc6a0d3-87ba-4987-b88c-d74ef2777375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:27:27.711431 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc6a0d3-87ba-4987-b88c-d74ef2777375 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:27:27.716602 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9d4f48-0a36-43d2-a155-5084d32aece6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:27:27.717472 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9d4f48-0a36-43d2-a155-5084d32aece6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:27:27.717751 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9d4f48-0a36-43d2-a155-5084d32aece6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:27:27.718001 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9d4f48-0a36-43d2-a155-5084d32aece6 admin admin] PATH_INFO: `/v3/projects/0705b6f2568c455a84d7346394cfb344` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:27:27.719194 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9d4f48-0a36-43d2-a155-5084d32aece6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0705b6f2568c455a84d7346394cfb344)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:27:27.721509 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9d4f48-0a36-43d2-a155-5084d32aece6 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:27:27.767160 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-ed9d4f48-0a36-43d2-a155-5084d32aece6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0705b6f2568c455a84d7346394cfb344', 'request_id': 'req-ed9d4f48-0a36-43d2-a155-5084d32aece6'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:27:27.776888 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-ed9d4f48-0a36-43d2-a155-5084d32aece6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0705b6f2568c455a84d7346394cfb344', 'request_id': 'req-ed9d4f48-0a36-43d2-a155-5084d32aece6'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:27:27.782743 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-ed9d4f48-0a36-43d2-a155-5084d32aece6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0705b6f2568c455a84d7346394cfb344', 'request_id': 'req-ed9d4f48-0a36-43d2-a155-5084d32aece6'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:27:27.795322 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-ed9d4f48-0a36-43d2-a155-5084d32aece6 admin admin] The token cache is being invalidate because project 0705b6f2568c455a84d7346394cfb344 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79960) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 07:27:27.795609 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-ed9d4f48-0a36-43d2-a155-5084d32aece6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:27:27.796286 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-ed9d4f48-0a36-43d2-a155-5084d32aece6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:27:27.797992 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1410/2824] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Mar 30 07:27:27 2022] DELETE /identity/v3/projects/0705b6f2568c455a84d7346394cfb344 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:27:27.802372 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74668f27-3685-43bc-8891-d13e0d4335e8 service neutron] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:27:27.812171 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74668f27-3685-43bc-8891-d13e0d4335e8 service neutron] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:27:27.876975 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e968a4c-d77e-4c87-a36c-5d8689e69abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:27:27.877854 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e968a4c-d77e-4c87-a36c-5d8689e69abf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:27:27.878159 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e968a4c-d77e-4c87-a36c-5d8689e69abf admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:27:27.878430 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e968a4c-d77e-4c87-a36c-5d8689e69abf admin admin] PATH_INFO: `/v3/users/cd85e957d9884f43806b3154ee01acb9` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:27:27.879967 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e968a4c-d77e-4c87-a36c-5d8689e69abf admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd85e957d9884f43806b3154ee01acb9)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:27:27.881899 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e968a4c-d77e-4c87-a36c-5d8689e69abf admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:27:27.935941 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-0e968a4c-d77e-4c87-a36c-5d8689e69abf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd85e957d9884f43806b3154ee01acb9'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:27:27.936577 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-0e968a4c-d77e-4c87-a36c-5d8689e69abf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd85e957d9884f43806b3154ee01acb9'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:27:27.937159 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-0e968a4c-d77e-4c87-a36c-5d8689e69abf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd85e957d9884f43806b3154ee01acb9'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:27:27.945140 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-0e968a4c-d77e-4c87-a36c-5d8689e69abf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd85e957d9884f43806b3154ee01acb9'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:27:27.952399 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-0e968a4c-d77e-4c87-a36c-5d8689e69abf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd85e957d9884f43806b3154ee01acb9'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:27:27.971304 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1415/2825] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Mar 30 07:27:27 2022] DELETE /identity/v3/users/cd85e957d9884f43806b3154ee01acb9 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:27:28.260290 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9d4f48-0a36-43d2-a155-5084d32aece6 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:27:28.261757 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-ed9d4f48-0a36-43d2-a155-5084d32aece6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:27:28.275841 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9d4f48-0a36-43d2-a155-5084d32aece6 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:27:28.338283 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e264b1-42bf-4e7f-88dd-0abf81382a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:27:28.339164 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e264b1-42bf-4e7f-88dd-0abf81382a4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:27:28.339448 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e264b1-42bf-4e7f-88dd-0abf81382a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:27:28.339722 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e264b1-42bf-4e7f-88dd-0abf81382a4a admin admin] PATH_INFO: `/v3/projects/4a330f0231304d47b2d10f42bd0d0b48` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:27:28.341037 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e264b1-42bf-4e7f-88dd-0abf81382a4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a330f0231304d47b2d10f42bd0d0b48)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:27:28.342972 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e264b1-42bf-4e7f-88dd-0abf81382a4a admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:27:28.399179 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-b6e264b1-42bf-4e7f-88dd-0abf81382a4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a330f0231304d47b2d10f42bd0d0b48', 'request_id': 'req-b6e264b1-42bf-4e7f-88dd-0abf81382a4a'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:27:28.406713 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-b6e264b1-42bf-4e7f-88dd-0abf81382a4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a330f0231304d47b2d10f42bd0d0b48', 'request_id': 'req-b6e264b1-42bf-4e7f-88dd-0abf81382a4a'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:27:28.412694 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-b6e264b1-42bf-4e7f-88dd-0abf81382a4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a330f0231304d47b2d10f42bd0d0b48', 'request_id': 'req-b6e264b1-42bf-4e7f-88dd-0abf81382a4a'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:27:28.424098 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-b6e264b1-42bf-4e7f-88dd-0abf81382a4a admin admin] The token cache is being invalidate because project 4a330f0231304d47b2d10f42bd0d0b48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79960) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 07:27:28.424384 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-b6e264b1-42bf-4e7f-88dd-0abf81382a4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:27:28.425090 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-b6e264b1-42bf-4e7f-88dd-0abf81382a4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:27:28.426748 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1411/2826] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Mar 30 07:27:28 2022] DELETE /identity/v3/projects/4a330f0231304d47b2d10f42bd0d0b48 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:27:28.432033 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0c44aa-267e-4272-9daf-95f48b47917c None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:27:28.432538 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0c44aa-267e-4272-9daf-95f48b47917c None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:27:28.432660 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0c44aa-267e-4272-9daf-95f48b47917c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:27:28.451126 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-1d0c44aa-267e-4272-9daf-95f48b47917c None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:27:28.452444 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-1d0c44aa-267e-4272-9daf-95f48b47917c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:27:28.518638 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1416/2827] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:27:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 30 07:27:28.530428 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b98a443-e9e9-4010-b250-4e71f01559be None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:27:28.530716 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b98a443-e9e9-4010-b250-4e71f01559be None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:27:28.531009 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b98a443-e9e9-4010-b250-4e71f01559be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:27:28.550475 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-8b98a443-e9e9-4010-b250-4e71f01559be None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:27:28.551711 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-8b98a443-e9e9-4010-b250-4e71f01559be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:27:28.560951 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1412/2828] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:27:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:27:28.565518 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0c44aa-267e-4272-9daf-95f48b47917c None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:27:28.575616 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0c44aa-267e-4272-9daf-95f48b47917c None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:27:28.581324 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd49c6c-2edf-4372-82e3-129c65549437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:27:28.581974 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd49c6c-2edf-4372-82e3-129c65549437 admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:27:28.582249 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd49c6c-2edf-4372-82e3-129c65549437 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:27:28.582531 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd49c6c-2edf-4372-82e3-129c65549437 admin admin] PATH_INFO: `/v3/domains` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:27:28.583250 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd49c6c-2edf-4372-82e3-129c65549437 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:27:28.583560 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd49c6c-2edf-4372-82e3-129c65549437 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:27:28.585204 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd49c6c-2edf-4372-82e3-129c65549437 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:27:28.596947 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1417/2829] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Mar 30 07:27:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:27:28.601474 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b98a443-e9e9-4010-b250-4e71f01559be None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:27:28.614445 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b98a443-e9e9-4010-b250-4e71f01559be None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:27:28.623221 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e50b97-07e9-46a0-ad86-c56a2355bd1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:27:28.624239 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e50b97-07e9-46a0-ad86-c56a2355bd1a admin admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:27:28.624642 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e50b97-07e9-46a0-ad86-c56a2355bd1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:27:28.625034 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e50b97-07e9-46a0-ad86-c56a2355bd1a admin admin] PATH_INFO: `/v3/projects` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:27:28.626157 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e50b97-07e9-46a0-ad86-c56a2355bd1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:27:28.629987 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e50b97-07e9-46a0-ad86-c56a2355bd1a admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:27:28.658697 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1413/2830] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Mar 30 07:27:28 2022] POST /identity/v3/projects => generated 387 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:27:28.665085 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd49c6c-2edf-4372-82e3-129c65549437 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:27:28.680462 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd49c6c-2edf-4372-82e3-129c65549437 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:27:28.741439 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98892678-261a-4bf8-8d2d-7a3800f584a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:27:28.742029 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98892678-261a-4bf8-8d2d-7a3800f584a1 admin admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:27:28.742309 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98892678-261a-4bf8-8d2d-7a3800f584a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:27:28.742584 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98892678-261a-4bf8-8d2d-7a3800f584a1 admin admin] PATH_INFO: `/v3/users` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:27:28.743343 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98892678-261a-4bf8-8d2d-7a3800f584a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:27:28.745255 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98892678-261a-4bf8-8d2d-7a3800f584a1 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:27:28.765766 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1418/2831] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Mar 30 07:27:28 2022] POST /identity/v3/users => generated 294 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:27:28.770059 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e50b97-07e9-46a0-ad86-c56a2355bd1a admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:27:28.780409 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e50b97-07e9-46a0-ad86-c56a2355bd1a admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:27:28.785463 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae813c9-1529-4f14-a817-1d583787d88a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:27:28.786118 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae813c9-1529-4f14-a817-1d583787d88a admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:27:28.786398 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae813c9-1529-4f14-a817-1d583787d88a admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:27:28.786670 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae813c9-1529-4f14-a817-1d583787d88a admin admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:27:28.787413 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae813c9-1529-4f14-a817-1d583787d88a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:27:28.789030 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae813c9-1529-4f14-a817-1d583787d88a admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:27:28.799378 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1414/2832] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:27:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:27:28.803705 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98892678-261a-4bf8-8d2d-7a3800f584a1 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:27:28.814580 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98892678-261a-4bf8-8d2d-7a3800f584a1 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:27:28.819599 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1276d346-9862-47e3-bf2b-166846cfb501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:27:28.820341 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1276d346-9862-47e3-bf2b-166846cfb501 admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:27:28.820634 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1276d346-9862-47e3-bf2b-166846cfb501 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:27:28.820906 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1276d346-9862-47e3-bf2b-166846cfb501 admin admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:27:28.821633 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1276d346-9862-47e3-bf2b-166846cfb501 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:27:28.823225 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1276d346-9862-47e3-bf2b-166846cfb501 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:27:28.833208 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1419/2833] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:27:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:27:28.837549 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae813c9-1529-4f14-a817-1d583787d88a admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:27:28.848118 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae813c9-1529-4f14-a817-1d583787d88a admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:27:28.853278 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162d794f-a59c-4875-9794-bcb5c219d3fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:27:28.854145 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162d794f-a59c-4875-9794-bcb5c219d3fe admin admin] REQUEST_METHOD: `PUT` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:27:28.854421 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162d794f-a59c-4875-9794-bcb5c219d3fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:27:28.854696 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162d794f-a59c-4875-9794-bcb5c219d3fe admin admin] PATH_INFO: `/v3/projects/6d9e282f4bfa498d92987c63ec58c571/users/af26e2f6e55f46b18e483d6a0423b222/roles/5d79031a64754b57ba120367465e2252` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:27:28.870977 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162d794f-a59c-4875-9794-bcb5c219d3fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d9e282f4bfa498d92987c63ec58c571, user_id=af26e2f6e55f46b18e483d6a0423b222, role_id=5d79031a64754b57ba120367465e2252)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:27:28.873721 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162d794f-a59c-4875-9794-bcb5c219d3fe admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:27:28.890475 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1415/2834] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:27:28 2022] PUT /identity/v3/projects/6d9e282f4bfa498d92987c63ec58c571/users/af26e2f6e55f46b18e483d6a0423b222/roles/5d79031a64754b57ba120367465e2252 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 07:27:28.901508 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c60fc21-da95-4639-a835-226bd2abf79f None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:27:28.901799 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c60fc21-da95-4639-a835-226bd2abf79f None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:27:28.902074 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c60fc21-da95-4639-a835-226bd2abf79f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:27:28.930453 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-7c60fc21-da95-4639-a835-226bd2abf79f None None] MFA Rules not processed for user `af26e2f6e55f46b18e483d6a0423b222`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:27:28.931666 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-7c60fc21-da95-4639-a835-226bd2abf79f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:27:29.003498 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1420/2835] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:27:28 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:27:29.008213 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162d794f-a59c-4875-9794-bcb5c219d3fe admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:27:29.084826 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162d794f-a59c-4875-9794-bcb5c219d3fe admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:27:29.091178 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83dbce7-7334-41b9-9484-9109761c15bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:27:29.091861 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83dbce7-7334-41b9-9484-9109761c15bd admin admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:27:29.092163 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83dbce7-7334-41b9-9484-9109761c15bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:27:29.092438 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83dbce7-7334-41b9-9484-9109761c15bd admin admin] PATH_INFO: `/v3/projects` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:27:29.093115 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83dbce7-7334-41b9-9484-9109761c15bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:27:29.095127 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83dbce7-7334-41b9-9484-9109761c15bd admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:27:29.127330 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1416/2836] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Mar 30 07:27:29 2022] POST /identity/v3/projects => generated 387 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:27:29.132443 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c60fc21-da95-4639-a835-226bd2abf79f None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:27:29.144552 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c60fc21-da95-4639-a835-226bd2abf79f None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:27:29.203284 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aad05c-0ff7-41d8-a04d-554fa70d0ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:27:29.203994 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aad05c-0ff7-41d8-a04d-554fa70d0ad4 admin admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:27:29.204273 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aad05c-0ff7-41d8-a04d-554fa70d0ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:27:29.204547 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aad05c-0ff7-41d8-a04d-554fa70d0ad4 admin admin] PATH_INFO: `/v3/users` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:27:29.205304 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aad05c-0ff7-41d8-a04d-554fa70d0ad4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:27:29.207231 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aad05c-0ff7-41d8-a04d-554fa70d0ad4 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:27:29.228117 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1421/2837] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Mar 30 07:27:29 2022] POST /identity/v3/users => generated 300 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 30 07:27:29.232297 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83dbce7-7334-41b9-9484-9109761c15bd admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:27:29.243091 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83dbce7-7334-41b9-9484-9109761c15bd admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:27:29.249038 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2a614a-7933-4e7b-82f0-6db45dc6e5a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:27:29.249728 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a614a-7933-4e7b-82f0-6db45dc6e5a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:27:29.250003 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a614a-7933-4e7b-82f0-6db45dc6e5a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:27:29.250290 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a614a-7933-4e7b-82f0-6db45dc6e5a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:27:29.251013 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2a614a-7933-4e7b-82f0-6db45dc6e5a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:27:29.252844 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2a614a-7933-4e7b-82f0-6db45dc6e5a9 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:27:29.262897 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1417/2838] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:27:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:27:29.266917 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aad05c-0ff7-41d8-a04d-554fa70d0ad4 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:27:29.277046 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aad05c-0ff7-41d8-a04d-554fa70d0ad4 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:27:29.281711 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddedf1e9-95c2-49cf-9948-36c7db5a6e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:27:29.282592 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddedf1e9-95c2-49cf-9948-36c7db5a6e0f admin admin] REQUEST_METHOD: `PUT` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:27:29.282926 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddedf1e9-95c2-49cf-9948-36c7db5a6e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:27:29.283185 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddedf1e9-95c2-49cf-9948-36c7db5a6e0f admin admin] PATH_INFO: `/v3/projects/219b88c6556e40da927768c4994d117c/users/f844fe148d9b4ec1b1ae117f2c37a403/roles/1c39b9ab8cfd4c0ea71845831920a845` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:27:29.297526 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddedf1e9-95c2-49cf-9948-36c7db5a6e0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=219b88c6556e40da927768c4994d117c, user_id=f844fe148d9b4ec1b1ae117f2c37a403, role_id=1c39b9ab8cfd4c0ea71845831920a845)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:27:29.300255 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddedf1e9-95c2-49cf-9948-36c7db5a6e0f admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:27:29.314883 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1422/2839] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:27:29 2022] PUT /identity/v3/projects/219b88c6556e40da927768c4994d117c/users/f844fe148d9b4ec1b1ae117f2c37a403/roles/1c39b9ab8cfd4c0ea71845831920a845 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:27:29.318982 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2a614a-7933-4e7b-82f0-6db45dc6e5a9 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:27:29.329015 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2a614a-7933-4e7b-82f0-6db45dc6e5a9 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:27:29.403480 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2d5d3a-09b0-47e5-a9fa-92d902bd4b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:27:29.404499 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2d5d3a-09b0-47e5-a9fa-92d902bd4b98 admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:27:29.404897 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2d5d3a-09b0-47e5-a9fa-92d902bd4b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:27:29.405297 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2d5d3a-09b0-47e5-a9fa-92d902bd4b98 admin admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:27:29.406464 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2d5d3a-09b0-47e5-a9fa-92d902bd4b98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:27:29.408679 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2d5d3a-09b0-47e5-a9fa-92d902bd4b98 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:27:29.419497 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1418/2840] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:27:29 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:27:29.425437 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddedf1e9-95c2-49cf-9948-36c7db5a6e0f admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:27:29.436624 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddedf1e9-95c2-49cf-9948-36c7db5a6e0f admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:27:29.442344 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c79a17f-7c8a-4858-973e-22850b8e52f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:27:29.443224 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c79a17f-7c8a-4858-973e-22850b8e52f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:27:29.443541 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c79a17f-7c8a-4858-973e-22850b8e52f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:27:29.443798 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c79a17f-7c8a-4858-973e-22850b8e52f8 admin admin] PATH_INFO: `/v3/projects/219b88c6556e40da927768c4994d117c/users/f844fe148d9b4ec1b1ae117f2c37a403/roles/1c39b9ab8cfd4c0ea71845831920a845` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:27:29.446037 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c79a17f-7c8a-4858-973e-22850b8e52f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=219b88c6556e40da927768c4994d117c, user_id=f844fe148d9b4ec1b1ae117f2c37a403, role_id=1c39b9ab8cfd4c0ea71845831920a845)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:27:29.448772 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c79a17f-7c8a-4858-973e-22850b8e52f8 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:27:29.460073 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1423/2841] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:27:29 2022] PUT /identity/v3/projects/219b88c6556e40da927768c4994d117c/users/f844fe148d9b4ec1b1ae117f2c37a403/roles/1c39b9ab8cfd4c0ea71845831920a845 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:27:29.471787 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e929d-41b8-48a1-84ea-4d1462bc153a None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:27:29.472106 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e929d-41b8-48a1-84ea-4d1462bc153a None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:27:29.472386 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e929d-41b8-48a1-84ea-4d1462bc153a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:27:29.499842 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-0a5e929d-41b8-48a1-84ea-4d1462bc153a None None] MFA Rules not processed for user `f844fe148d9b4ec1b1ae117f2c37a403`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:27:29.501049 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-0a5e929d-41b8-48a1-84ea-4d1462bc153a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:27:29.571737 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1419/2842] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:27:29 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:27:29.583736 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c79a17f-7c8a-4858-973e-22850b8e52f8 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:27:29.586839 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-0c79a17f-7c8a-4858-973e-22850b8e52f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:27:29.650128 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c79a17f-7c8a-4858-973e-22850b8e52f8 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:27:29.655285 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386fc527-08a9-4f4e-b32a-ae7d09bdedb9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e2fda180e8d448d895c40cdad34bc4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:27:29.655991 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386fc527-08a9-4f4e-b32a-ae7d09bdedb9 service cinder] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:27:29.656264 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386fc527-08a9-4f4e-b32a-ae7d09bdedb9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:27:29.656533 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386fc527-08a9-4f4e-b32a-ae7d09bdedb9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:27:29.667028 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386fc527-08a9-4f4e-b32a-ae7d09bdedb9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:27:29.668535 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386fc527-08a9-4f4e-b32a-ae7d09bdedb9 service cinder] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:27:29.678891 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1424/2843] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:27:29 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:27:29.809612 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5e929d-41b8-48a1-84ea-4d1462bc153a None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:27:29.881223 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5e929d-41b8-48a1-84ea-4d1462bc153a None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:27:29.887652 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab44deb9-a9f0-4b44-bec1-3c0f586be709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:27:29.888997 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab44deb9-a9f0-4b44-bec1-3c0f586be709 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:27:29.889391 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab44deb9-a9f0-4b44-bec1-3c0f586be709 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:27:29.889751 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab44deb9-a9f0-4b44-bec1-3c0f586be709 admin admin] PATH_INFO: `/v3/users/af26e2f6e55f46b18e483d6a0423b222` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:27:29.891688 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab44deb9-a9f0-4b44-bec1-3c0f586be709 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af26e2f6e55f46b18e483d6a0423b222)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:27:29.893937 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab44deb9-a9f0-4b44-bec1-3c0f586be709 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:27:29.953190 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-ab44deb9-a9f0-4b44-bec1-3c0f586be709 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af26e2f6e55f46b18e483d6a0423b222'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:27:29.954226 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-ab44deb9-a9f0-4b44-bec1-3c0f586be709 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af26e2f6e55f46b18e483d6a0423b222'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:27:29.966731 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-ab44deb9-a9f0-4b44-bec1-3c0f586be709 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af26e2f6e55f46b18e483d6a0423b222'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:27:29.979316 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-ab44deb9-a9f0-4b44-bec1-3c0f586be709 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af26e2f6e55f46b18e483d6a0423b222'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:27:29.979993 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-ab44deb9-a9f0-4b44-bec1-3c0f586be709 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af26e2f6e55f46b18e483d6a0423b222'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:27:29.992552 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1420/2844] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Mar 30 07:27:29 2022] DELETE /identity/v3/users/af26e2f6e55f46b18e483d6a0423b222 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:27:29.997253 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14908c27-3b53-40bd-8d9c-1bf807343b6d None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:27:29.997533 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14908c27-3b53-40bd-8d9c-1bf807343b6d None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:27:29.997822 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14908c27-3b53-40bd-8d9c-1bf807343b6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:27:30.016726 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-14908c27-3b53-40bd-8d9c-1bf807343b6d None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:27:30.017930 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-14908c27-3b53-40bd-8d9c-1bf807343b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:27:30.077585 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1425/2845] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:27:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:27:30.088491 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab44deb9-a9f0-4b44-bec1-3c0f586be709 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:27:30.091115 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-ab44deb9-a9f0-4b44-bec1-3c0f586be709 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:27:30.160578 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab44deb9-a9f0-4b44-bec1-3c0f586be709 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:27:30.165085 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285f57bc-24a2-4aef-a88a-92eac4da004d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3802cb341445f994b9204744060ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:27:30.165731 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f57bc-24a2-4aef-a88a-92eac4da004d service neutron] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:27:30.166007 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f57bc-24a2-4aef-a88a-92eac4da004d service neutron] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:27:30.166274 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f57bc-24a2-4aef-a88a-92eac4da004d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:27:30.175740 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285f57bc-24a2-4aef-a88a-92eac4da004d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:27:30.177213 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285f57bc-24a2-4aef-a88a-92eac4da004d service neutron] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:27:30.186388 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1421/2846] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:27:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:27:30.463698 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14908c27-3b53-40bd-8d9c-1bf807343b6d None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:27:30.465248 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-14908c27-3b53-40bd-8d9c-1bf807343b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:27:30.478815 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14908c27-3b53-40bd-8d9c-1bf807343b6d None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:27:30.484068 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf98943f-42b1-4fc9-b0f1-4aab9c01a07e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:27:30.484960 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf98943f-42b1-4fc9-b0f1-4aab9c01a07e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:27:30.485221 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf98943f-42b1-4fc9-b0f1-4aab9c01a07e admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:27:30.485627 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf98943f-42b1-4fc9-b0f1-4aab9c01a07e admin admin] PATH_INFO: `/v3/projects/6d9e282f4bfa498d92987c63ec58c571` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:27:30.487331 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf98943f-42b1-4fc9-b0f1-4aab9c01a07e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d9e282f4bfa498d92987c63ec58c571)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:27:30.489477 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf98943f-42b1-4fc9-b0f1-4aab9c01a07e admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:27:30.539596 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-bf98943f-42b1-4fc9-b0f1-4aab9c01a07e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d9e282f4bfa498d92987c63ec58c571', 'request_id': 'req-bf98943f-42b1-4fc9-b0f1-4aab9c01a07e'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:27:30.545702 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-bf98943f-42b1-4fc9-b0f1-4aab9c01a07e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d9e282f4bfa498d92987c63ec58c571', 'request_id': 'req-bf98943f-42b1-4fc9-b0f1-4aab9c01a07e'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:27:30.555316 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-bf98943f-42b1-4fc9-b0f1-4aab9c01a07e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d9e282f4bfa498d92987c63ec58c571', 'request_id': 'req-bf98943f-42b1-4fc9-b0f1-4aab9c01a07e'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:27:30.566491 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-bf98943f-42b1-4fc9-b0f1-4aab9c01a07e admin admin] The token cache is being invalidate because project 6d9e282f4bfa498d92987c63ec58c571 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79961) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 07:27:30.566766 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-bf98943f-42b1-4fc9-b0f1-4aab9c01a07e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:27:30.567408 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-bf98943f-42b1-4fc9-b0f1-4aab9c01a07e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:27:30.568975 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1426/2847] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Mar 30 07:27:30 2022] DELETE /identity/v3/projects/6d9e282f4bfa498d92987c63ec58c571 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 07:27:30.573062 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285f57bc-24a2-4aef-a88a-92eac4da004d service neutron] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:27:30.582996 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285f57bc-24a2-4aef-a88a-92eac4da004d service neutron] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:27:30.643657 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42f0377-057b-48d8-b473-34b1d0f0b019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:27:30.644653 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42f0377-057b-48d8-b473-34b1d0f0b019 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:27:30.645094 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42f0377-057b-48d8-b473-34b1d0f0b019 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:27:30.645559 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42f0377-057b-48d8-b473-34b1d0f0b019 admin admin] PATH_INFO: `/v3/users/f844fe148d9b4ec1b1ae117f2c37a403` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:27:30.647376 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42f0377-057b-48d8-b473-34b1d0f0b019 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f844fe148d9b4ec1b1ae117f2c37a403)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:27:30.650496 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42f0377-057b-48d8-b473-34b1d0f0b019 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:27:30.698793 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-e42f0377-057b-48d8-b473-34b1d0f0b019 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f844fe148d9b4ec1b1ae117f2c37a403'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:27:30.699441 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-e42f0377-057b-48d8-b473-34b1d0f0b019 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f844fe148d9b4ec1b1ae117f2c37a403'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:27:30.708534 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-e42f0377-057b-48d8-b473-34b1d0f0b019 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f844fe148d9b4ec1b1ae117f2c37a403'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:27:30.719788 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-e42f0377-057b-48d8-b473-34b1d0f0b019 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f844fe148d9b4ec1b1ae117f2c37a403'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:27:30.720528 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-e42f0377-057b-48d8-b473-34b1d0f0b019 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f844fe148d9b4ec1b1ae117f2c37a403'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:27:30.732382 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1422/2848] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Mar 30 07:27:30 2022] DELETE /identity/v3/users/f844fe148d9b4ec1b1ae117f2c37a403 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:27:31.049529 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf98943f-42b1-4fc9-b0f1-4aab9c01a07e admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:27:31.051112 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-bf98943f-42b1-4fc9-b0f1-4aab9c01a07e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:27:31.065208 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf98943f-42b1-4fc9-b0f1-4aab9c01a07e admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:27:31.126459 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ef915a-1148-4f19-a2b8-74b2bee496db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:27:31.127600 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ef915a-1148-4f19-a2b8-74b2bee496db admin admin] REQUEST_METHOD: `DELETE` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:27:31.128019 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ef915a-1148-4f19-a2b8-74b2bee496db admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:27:31.128368 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ef915a-1148-4f19-a2b8-74b2bee496db admin admin] PATH_INFO: `/v3/projects/219b88c6556e40da927768c4994d117c` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:27:31.130231 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ef915a-1148-4f19-a2b8-74b2bee496db admin admin] RBAC: Authorizing `identity:delete_project(project_id=219b88c6556e40da927768c4994d117c)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:27:31.132436 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ef915a-1148-4f19-a2b8-74b2bee496db admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:27:31.191172 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-d4ef915a-1148-4f19-a2b8-74b2bee496db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '219b88c6556e40da927768c4994d117c', 'request_id': 'req-d4ef915a-1148-4f19-a2b8-74b2bee496db'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:27:31.199535 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-d4ef915a-1148-4f19-a2b8-74b2bee496db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '219b88c6556e40da927768c4994d117c', 'request_id': 'req-d4ef915a-1148-4f19-a2b8-74b2bee496db'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:27:31.211985 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-d4ef915a-1148-4f19-a2b8-74b2bee496db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '219b88c6556e40da927768c4994d117c', 'request_id': 'req-d4ef915a-1148-4f19-a2b8-74b2bee496db'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:27:31.224015 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-d4ef915a-1148-4f19-a2b8-74b2bee496db admin admin] The token cache is being invalidate because project 219b88c6556e40da927768c4994d117c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79961) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 07:27:31.224298 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-d4ef915a-1148-4f19-a2b8-74b2bee496db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:27:31.224926 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-d4ef915a-1148-4f19-a2b8-74b2bee496db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:27:31.226475 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1427/2849] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Mar 30 07:27:31 2022] DELETE /identity/v3/projects/219b88c6556e40da927768c4994d117c => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:27:31.231959 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddd3d5f-3b45-4903-b89e-1f3244ae10fd None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:27:31.232252 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddd3d5f-3b45-4903-b89e-1f3244ae10fd None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:27:31.232529 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddd3d5f-3b45-4903-b89e-1f3244ae10fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:27:31.251010 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-2ddd3d5f-3b45-4903-b89e-1f3244ae10fd None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:27:31.252369 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-2ddd3d5f-3b45-4903-b89e-1f3244ae10fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:27:31.319416 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1423/2850] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:27:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:27:31.330421 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd48c6e6-ef52-4aa7-b632-0f9005abc638 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:27:31.330706 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd48c6e6-ef52-4aa7-b632-0f9005abc638 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:27:31.330982 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd48c6e6-ef52-4aa7-b632-0f9005abc638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:27:31.357228 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-fd48c6e6-ef52-4aa7-b632-0f9005abc638 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:27:31.358983 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-fd48c6e6-ef52-4aa7-b632-0f9005abc638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:27:31.368068 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1428/2851] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:27:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:27:31.372908 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddd3d5f-3b45-4903-b89e-1f3244ae10fd None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:27:31.388039 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddd3d5f-3b45-4903-b89e-1f3244ae10fd None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:27:31.395059 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165cb891-56cf-44e6-a5e7-562874c0b48c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:27:31.395707 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165cb891-56cf-44e6-a5e7-562874c0b48c admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:27:31.396019 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165cb891-56cf-44e6-a5e7-562874c0b48c admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:27:31.396287 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165cb891-56cf-44e6-a5e7-562874c0b48c admin admin] PATH_INFO: `/v3/domains` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:27:31.397004 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165cb891-56cf-44e6-a5e7-562874c0b48c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79960) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:27:31.397316 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165cb891-56cf-44e6-a5e7-562874c0b48c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:27:31.398923 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165cb891-56cf-44e6-a5e7-562874c0b48c admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:27:31.410943 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1424/2852] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Mar 30 07:27:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:27:31.415370 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd48c6e6-ef52-4aa7-b632-0f9005abc638 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:27:31.425437 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd48c6e6-ef52-4aa7-b632-0f9005abc638 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:27:31.431361 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0d8ec5-af6a-4661-afc8-7c9eec7b05f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:27:31.432053 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0d8ec5-af6a-4661-afc8-7c9eec7b05f2 admin admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:27:31.432335 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0d8ec5-af6a-4661-afc8-7c9eec7b05f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:27:31.432585 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0d8ec5-af6a-4661-afc8-7c9eec7b05f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:27:31.433291 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0d8ec5-af6a-4661-afc8-7c9eec7b05f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:27:31.435205 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0d8ec5-af6a-4661-afc8-7c9eec7b05f2 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:27:31.468874 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1429/2853] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Mar 30 07:27:31 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:27:31.473536 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165cb891-56cf-44e6-a5e7-562874c0b48c admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:27:31.484281 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165cb891-56cf-44e6-a5e7-562874c0b48c admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:27:31.541170 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ae2778-ee8d-4c20-b811-0e4803a28c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:27:31.541834 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ae2778-ee8d-4c20-b811-0e4803a28c0a admin admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:27:31.542116 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ae2778-ee8d-4c20-b811-0e4803a28c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:27:31.542388 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ae2778-ee8d-4c20-b811-0e4803a28c0a admin admin] PATH_INFO: `/v3/users` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:27:31.543082 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ae2778-ee8d-4c20-b811-0e4803a28c0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:27:31.545051 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ae2778-ee8d-4c20-b811-0e4803a28c0a admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:27:31.567985 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1425/2854] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Mar 30 07:27:31 2022] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:27:31.572148 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0d8ec5-af6a-4661-afc8-7c9eec7b05f2 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:27:31.582418 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0d8ec5-af6a-4661-afc8-7c9eec7b05f2 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:27:31.587270 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c74da61-7109-4d07-a237-ac9cabf3202d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:27:31.587948 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c74da61-7109-4d07-a237-ac9cabf3202d admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:27:31.588229 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c74da61-7109-4d07-a237-ac9cabf3202d admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:27:31.588504 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c74da61-7109-4d07-a237-ac9cabf3202d admin admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:27:31.589240 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c74da61-7109-4d07-a237-ac9cabf3202d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:27:31.590876 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c74da61-7109-4d07-a237-ac9cabf3202d admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:27:31.603687 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1430/2855] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:27:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:27:31.607617 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ae2778-ee8d-4c20-b811-0e4803a28c0a admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:27:31.618458 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ae2778-ee8d-4c20-b811-0e4803a28c0a admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:27:31.623419 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ae4308-fdb4-482b-9798-98a004f7794c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:27:31.624116 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ae4308-fdb4-482b-9798-98a004f7794c admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:27:31.624393 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ae4308-fdb4-482b-9798-98a004f7794c admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:27:31.624648 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ae4308-fdb4-482b-9798-98a004f7794c admin admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:27:31.625364 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ae4308-fdb4-482b-9798-98a004f7794c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:27:31.627059 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ae4308-fdb4-482b-9798-98a004f7794c admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:27:31.638924 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1426/2856] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:27:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:27:31.643042 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c74da61-7109-4d07-a237-ac9cabf3202d admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:27:31.653315 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c74da61-7109-4d07-a237-ac9cabf3202d admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:27:31.658773 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486ae6ed-30de-40e1-b1e3-e0a9f64fc8aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:27:31.659651 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ae6ed-30de-40e1-b1e3-e0a9f64fc8aa admin admin] REQUEST_METHOD: `PUT` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:27:31.659959 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ae6ed-30de-40e1-b1e3-e0a9f64fc8aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:27:31.660215 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ae6ed-30de-40e1-b1e3-e0a9f64fc8aa admin admin] PATH_INFO: `/v3/projects/de1e91103acd44cca93690db39d7eaa7/users/d3bf2aac6aba4e0abfb3ea03258055ce/roles/5d79031a64754b57ba120367465e2252` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:27:31.680972 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486ae6ed-30de-40e1-b1e3-e0a9f64fc8aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=de1e91103acd44cca93690db39d7eaa7, user_id=d3bf2aac6aba4e0abfb3ea03258055ce, role_id=5d79031a64754b57ba120367465e2252)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:27:31.685011 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486ae6ed-30de-40e1-b1e3-e0a9f64fc8aa admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:27:31.702393 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1431/2857] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:27:31 2022] PUT /identity/v3/projects/de1e91103acd44cca93690db39d7eaa7/users/d3bf2aac6aba4e0abfb3ea03258055ce/roles/5d79031a64754b57ba120367465e2252 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:27:31.713595 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829663e4-51ba-4b02-b371-168e921bad25 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:27:31.713884 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829663e4-51ba-4b02-b371-168e921bad25 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:27:31.714161 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829663e4-51ba-4b02-b371-168e921bad25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:27:31.743345 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-829663e4-51ba-4b02-b371-168e921bad25 None None] MFA Rules not processed for user `d3bf2aac6aba4e0abfb3ea03258055ce`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:27:31.744876 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-829663e4-51ba-4b02-b371-168e921bad25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:27:31.810977 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1427/2858] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:27:31 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:27:31.816064 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486ae6ed-30de-40e1-b1e3-e0a9f64fc8aa admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:27:31.884085 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486ae6ed-30de-40e1-b1e3-e0a9f64fc8aa admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:27:31.890310 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50c7a9f-0e30-4c5a-a9b7-235ca83253c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:27:31.890911 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50c7a9f-0e30-4c5a-a9b7-235ca83253c1 admin admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:27:31.891196 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50c7a9f-0e30-4c5a-a9b7-235ca83253c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:27:31.891468 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50c7a9f-0e30-4c5a-a9b7-235ca83253c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:27:31.892200 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50c7a9f-0e30-4c5a-a9b7-235ca83253c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:27:31.894240 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50c7a9f-0e30-4c5a-a9b7-235ca83253c1 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:27:31.921628 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1432/2859] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Mar 30 07:27:31 2022] POST /identity/v3/projects => generated 373 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:27:31.925966 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829663e4-51ba-4b02-b371-168e921bad25 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:27:31.936902 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829663e4-51ba-4b02-b371-168e921bad25 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:27:31.992254 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7544f8-b65c-4afe-9728-232ff273c50a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:27:31.992897 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7544f8-b65c-4afe-9728-232ff273c50a admin admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:27:31.993196 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7544f8-b65c-4afe-9728-232ff273c50a admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:27:31.993470 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7544f8-b65c-4afe-9728-232ff273c50a admin admin] PATH_INFO: `/v3/users` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:27:31.994152 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7544f8-b65c-4afe-9728-232ff273c50a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:27:31.996118 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7544f8-b65c-4afe-9728-232ff273c50a admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:27:32.020944 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1428/2860] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Mar 30 07:27:31 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:27:32.025714 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50c7a9f-0e30-4c5a-a9b7-235ca83253c1 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:27:32.042853 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50c7a9f-0e30-4c5a-a9b7-235ca83253c1 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:27:32.050495 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69569fe-a0c7-433a-80ce-226d19f33b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:27:32.051157 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69569fe-a0c7-433a-80ce-226d19f33b8f admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:27:32.051441 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69569fe-a0c7-433a-80ce-226d19f33b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:27:32.051880 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69569fe-a0c7-433a-80ce-226d19f33b8f admin admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:27:32.052610 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69569fe-a0c7-433a-80ce-226d19f33b8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:27:32.054215 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69569fe-a0c7-433a-80ce-226d19f33b8f admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:27:32.065473 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1433/2861] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:27:32 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:27:32.069631 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7544f8-b65c-4afe-9728-232ff273c50a admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:27:32.080958 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7544f8-b65c-4afe-9728-232ff273c50a admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:27:32.086870 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0d9cf3-baf1-4d78-ba95-e136abfab035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:27:32.087754 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d9cf3-baf1-4d78-ba95-e136abfab035 admin admin] REQUEST_METHOD: `PUT` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:27:32.088064 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d9cf3-baf1-4d78-ba95-e136abfab035 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:27:32.088333 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d9cf3-baf1-4d78-ba95-e136abfab035 admin admin] PATH_INFO: `/v3/projects/3ace8f8251cd413c9540cf6ca82c4411/users/f1d45dc839a14771882d41bd531fe5f5/roles/1c39b9ab8cfd4c0ea71845831920a845` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:27:32.106037 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0d9cf3-baf1-4d78-ba95-e136abfab035 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ace8f8251cd413c9540cf6ca82c4411, user_id=f1d45dc839a14771882d41bd531fe5f5, role_id=1c39b9ab8cfd4c0ea71845831920a845)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:27:32.108738 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0d9cf3-baf1-4d78-ba95-e136abfab035 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:27:32.123466 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1429/2862] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:27:32 2022] PUT /identity/v3/projects/3ace8f8251cd413c9540cf6ca82c4411/users/f1d45dc839a14771882d41bd531fe5f5/roles/1c39b9ab8cfd4c0ea71845831920a845 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:27:32.127489 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69569fe-a0c7-433a-80ce-226d19f33b8f admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:27:32.138027 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69569fe-a0c7-433a-80ce-226d19f33b8f admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:27:32.198825 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61396bd3-400a-4445-b472-f09ff8730fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:27:32.199422 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61396bd3-400a-4445-b472-f09ff8730fda admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:27:32.199695 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61396bd3-400a-4445-b472-f09ff8730fda admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:27:32.200011 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61396bd3-400a-4445-b472-f09ff8730fda admin admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:27:32.200731 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61396bd3-400a-4445-b472-f09ff8730fda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:27:32.202345 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61396bd3-400a-4445-b472-f09ff8730fda admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:27:32.213442 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1434/2863] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:27:32 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:27:32.219784 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0d9cf3-baf1-4d78-ba95-e136abfab035 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:27:32.231032 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0d9cf3-baf1-4d78-ba95-e136abfab035 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:27:32.237133 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f169c7a-e04e-4ed5-b000-0f25b017a7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:27:32.238010 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f169c7a-e04e-4ed5-b000-0f25b017a7aa admin admin] REQUEST_METHOD: `PUT` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:27:32.238287 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f169c7a-e04e-4ed5-b000-0f25b017a7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:27:32.238555 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f169c7a-e04e-4ed5-b000-0f25b017a7aa admin admin] PATH_INFO: `/v3/projects/3ace8f8251cd413c9540cf6ca82c4411/users/f1d45dc839a14771882d41bd531fe5f5/roles/1c39b9ab8cfd4c0ea71845831920a845` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:27:32.240842 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f169c7a-e04e-4ed5-b000-0f25b017a7aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ace8f8251cd413c9540cf6ca82c4411, user_id=f1d45dc839a14771882d41bd531fe5f5, role_id=1c39b9ab8cfd4c0ea71845831920a845)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:27:32.243484 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f169c7a-e04e-4ed5-b000-0f25b017a7aa admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:27:32.254732 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1430/2864] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:27:32 2022] PUT /identity/v3/projects/3ace8f8251cd413c9540cf6ca82c4411/users/f1d45dc839a14771882d41bd531fe5f5/roles/1c39b9ab8cfd4c0ea71845831920a845 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:27:32.318621 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36af91e9-3845-4055-be93-9fe2e03e63a8 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:27:32.319012 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36af91e9-3845-4055-be93-9fe2e03e63a8 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:27:32.319359 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36af91e9-3845-4055-be93-9fe2e03e63a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:27:32.357581 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-36af91e9-3845-4055-be93-9fe2e03e63a8 None None] MFA Rules not processed for user `f1d45dc839a14771882d41bd531fe5f5`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:27:32.358785 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-36af91e9-3845-4055-be93-9fe2e03e63a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:27:32.433178 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1435/2865] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:27:32 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:27:32.444165 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f169c7a-e04e-4ed5-b000-0f25b017a7aa admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:27:32.446044 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-8f169c7a-e04e-4ed5-b000-0f25b017a7aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:27:32.507901 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f169c7a-e04e-4ed5-b000-0f25b017a7aa admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:27:32.512162 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f35bb2d-0749-47ee-837c-98bc10e88703 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e2fda180e8d448d895c40cdad34bc4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:27:32.512802 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f35bb2d-0749-47ee-837c-98bc10e88703 service cinder] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:27:32.513080 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f35bb2d-0749-47ee-837c-98bc10e88703 service cinder] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:27:32.513346 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f35bb2d-0749-47ee-837c-98bc10e88703 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:27:32.568497 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f35bb2d-0749-47ee-837c-98bc10e88703 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:27:32.569955 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f35bb2d-0749-47ee-837c-98bc10e88703 service cinder] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:27:32.578863 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1431/2866] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:27:32 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:27:35.131206 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36af91e9-3845-4055-be93-9fe2e03e63a8 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:27:35.199714 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36af91e9-3845-4055-be93-9fe2e03e63a8 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:27:35.206614 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2db3f5-f925-4c5c-9a65-58632c2ceaa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:27:35.207510 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2db3f5-f925-4c5c-9a65-58632c2ceaa4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:27:35.207794 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2db3f5-f925-4c5c-9a65-58632c2ceaa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:27:35.208097 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2db3f5-f925-4c5c-9a65-58632c2ceaa4 admin admin] PATH_INFO: `/v3/users/d3bf2aac6aba4e0abfb3ea03258055ce` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:27:35.210086 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2db3f5-f925-4c5c-9a65-58632c2ceaa4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3bf2aac6aba4e0abfb3ea03258055ce)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:27:35.212075 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2db3f5-f925-4c5c-9a65-58632c2ceaa4 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:27:35.265048 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-7f2db3f5-f925-4c5c-9a65-58632c2ceaa4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3bf2aac6aba4e0abfb3ea03258055ce'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:27:35.266004 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-7f2db3f5-f925-4c5c-9a65-58632c2ceaa4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3bf2aac6aba4e0abfb3ea03258055ce'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:27:35.267019 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-7f2db3f5-f925-4c5c-9a65-58632c2ceaa4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3bf2aac6aba4e0abfb3ea03258055ce'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:27:35.277721 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-7f2db3f5-f925-4c5c-9a65-58632c2ceaa4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3bf2aac6aba4e0abfb3ea03258055ce'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:27:35.285086 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-7f2db3f5-f925-4c5c-9a65-58632c2ceaa4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3bf2aac6aba4e0abfb3ea03258055ce'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:27:35.301977 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1436/2867] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Mar 30 07:27:35 2022] DELETE /identity/v3/users/d3bf2aac6aba4e0abfb3ea03258055ce => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:27:35.306685 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad6fc7f-12ac-442a-842b-77be1883d8ed None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:27:35.307193 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad6fc7f-12ac-442a-842b-77be1883d8ed None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:27:35.307294 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad6fc7f-12ac-442a-842b-77be1883d8ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:27:35.325138 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-5ad6fc7f-12ac-442a-842b-77be1883d8ed None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:27:35.326330 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-5ad6fc7f-12ac-442a-842b-77be1883d8ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:27:35.389123 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1432/2868] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:27:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:27:35.398877 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2db3f5-f925-4c5c-9a65-58632c2ceaa4 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:27:35.400306 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-7f2db3f5-f925-4c5c-9a65-58632c2ceaa4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:27:35.458858 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2db3f5-f925-4c5c-9a65-58632c2ceaa4 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:27:35.462583 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1627f5b8-b226-41f2-b060-7cf97f2e654a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3802cb341445f994b9204744060ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:27:35.463222 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1627f5b8-b226-41f2-b060-7cf97f2e654a service neutron] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:27:35.463498 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1627f5b8-b226-41f2-b060-7cf97f2e654a service neutron] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:27:35.463767 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1627f5b8-b226-41f2-b060-7cf97f2e654a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:27:35.473022 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1627f5b8-b226-41f2-b060-7cf97f2e654a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:27:35.474441 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1627f5b8-b226-41f2-b060-7cf97f2e654a service neutron] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:27:35.486000 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1437/2869] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:27:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:27:35.762816 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad6fc7f-12ac-442a-842b-77be1883d8ed None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:27:35.765501 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-5ad6fc7f-12ac-442a-842b-77be1883d8ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:27:35.778721 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad6fc7f-12ac-442a-842b-77be1883d8ed None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:27:35.783612 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc102b9-8fe1-403c-8201-898edb308e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:27:35.784728 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc102b9-8fe1-403c-8201-898edb308e8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:27:35.785195 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc102b9-8fe1-403c-8201-898edb308e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:27:35.785473 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc102b9-8fe1-403c-8201-898edb308e8f admin admin] PATH_INFO: `/v3/projects/de1e91103acd44cca93690db39d7eaa7` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:27:35.786688 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc102b9-8fe1-403c-8201-898edb308e8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=de1e91103acd44cca93690db39d7eaa7)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:27:35.788611 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc102b9-8fe1-403c-8201-898edb308e8f admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:27:35.845574 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-ecc102b9-8fe1-403c-8201-898edb308e8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de1e91103acd44cca93690db39d7eaa7', 'request_id': 'req-ecc102b9-8fe1-403c-8201-898edb308e8f'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:27:35.856926 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-ecc102b9-8fe1-403c-8201-898edb308e8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de1e91103acd44cca93690db39d7eaa7', 'request_id': 'req-ecc102b9-8fe1-403c-8201-898edb308e8f'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:27:35.865131 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-ecc102b9-8fe1-403c-8201-898edb308e8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de1e91103acd44cca93690db39d7eaa7', 'request_id': 'req-ecc102b9-8fe1-403c-8201-898edb308e8f'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:27:35.876874 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-ecc102b9-8fe1-403c-8201-898edb308e8f admin admin] The token cache is being invalidate because project de1e91103acd44cca93690db39d7eaa7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79960) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 07:27:35.877209 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-ecc102b9-8fe1-403c-8201-898edb308e8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:27:35.877918 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-ecc102b9-8fe1-403c-8201-898edb308e8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:27:35.879503 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1433/2870] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Mar 30 07:27:35 2022] DELETE /identity/v3/projects/de1e91103acd44cca93690db39d7eaa7 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:27:35.883698 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1627f5b8-b226-41f2-b060-7cf97f2e654a service neutron] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:27:35.893495 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1627f5b8-b226-41f2-b060-7cf97f2e654a service neutron] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:27:35.958989 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5409989-87d7-4ccd-9202-5d88874c9858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:27:35.959774 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5409989-87d7-4ccd-9202-5d88874c9858 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:27:35.960092 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5409989-87d7-4ccd-9202-5d88874c9858 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:27:35.960367 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5409989-87d7-4ccd-9202-5d88874c9858 admin admin] PATH_INFO: `/v3/users/f1d45dc839a14771882d41bd531fe5f5` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:27:35.961569 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5409989-87d7-4ccd-9202-5d88874c9858 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1d45dc839a14771882d41bd531fe5f5)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:27:35.963496 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5409989-87d7-4ccd-9202-5d88874c9858 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:27:36.010615 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-b5409989-87d7-4ccd-9202-5d88874c9858 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1d45dc839a14771882d41bd531fe5f5'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:27:36.011331 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-b5409989-87d7-4ccd-9202-5d88874c9858 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1d45dc839a14771882d41bd531fe5f5'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:27:36.012030 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-b5409989-87d7-4ccd-9202-5d88874c9858 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1d45dc839a14771882d41bd531fe5f5'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:27:36.019654 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-b5409989-87d7-4ccd-9202-5d88874c9858 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1d45dc839a14771882d41bd531fe5f5'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:27:36.026297 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-b5409989-87d7-4ccd-9202-5d88874c9858 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1d45dc839a14771882d41bd531fe5f5'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:27:36.046330 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1438/2871] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Mar 30 07:27:35 2022] DELETE /identity/v3/users/f1d45dc839a14771882d41bd531fe5f5 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:27:36.343948 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc102b9-8fe1-403c-8201-898edb308e8f admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:27:36.345477 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-ecc102b9-8fe1-403c-8201-898edb308e8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:27:36.358922 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc102b9-8fe1-403c-8201-898edb308e8f admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:27:36.417118 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7537704-af80-4537-bd07-0cab8bcd6cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:27:36.417995 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7537704-af80-4537-bd07-0cab8bcd6cca admin admin] REQUEST_METHOD: `DELETE` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:27:36.418262 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7537704-af80-4537-bd07-0cab8bcd6cca admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:27:36.418529 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7537704-af80-4537-bd07-0cab8bcd6cca admin admin] PATH_INFO: `/v3/projects/3ace8f8251cd413c9540cf6ca82c4411` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:27:36.419721 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7537704-af80-4537-bd07-0cab8bcd6cca admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ace8f8251cd413c9540cf6ca82c4411)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:27:36.421666 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7537704-af80-4537-bd07-0cab8bcd6cca admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:27:36.479668 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-a7537704-af80-4537-bd07-0cab8bcd6cca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ace8f8251cd413c9540cf6ca82c4411', 'request_id': 'req-a7537704-af80-4537-bd07-0cab8bcd6cca'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:27:36.489967 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-a7537704-af80-4537-bd07-0cab8bcd6cca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ace8f8251cd413c9540cf6ca82c4411', 'request_id': 'req-a7537704-af80-4537-bd07-0cab8bcd6cca'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:27:36.495216 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-a7537704-af80-4537-bd07-0cab8bcd6cca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ace8f8251cd413c9540cf6ca82c4411', 'request_id': 'req-a7537704-af80-4537-bd07-0cab8bcd6cca'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:27:36.505944 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-a7537704-af80-4537-bd07-0cab8bcd6cca admin admin] The token cache is being invalidate because project 3ace8f8251cd413c9540cf6ca82c4411 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79960) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 07:27:36.506227 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-a7537704-af80-4537-bd07-0cab8bcd6cca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:27:36.506860 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-a7537704-af80-4537-bd07-0cab8bcd6cca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:27:36.508445 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1434/2872] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Mar 30 07:27:36 2022] DELETE /identity/v3/projects/3ace8f8251cd413c9540cf6ca82c4411 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:27:36.515005 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3e4e3b-e307-4dbe-9a56-6bc0d44cd0e6 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:27:36.515491 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3e4e3b-e307-4dbe-9a56-6bc0d44cd0e6 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:27:36.515585 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3e4e3b-e307-4dbe-9a56-6bc0d44cd0e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:27:36.534822 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-2e3e4e3b-e307-4dbe-9a56-6bc0d44cd0e6 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:27:36.536068 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-2e3e4e3b-e307-4dbe-9a56-6bc0d44cd0e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:27:36.602663 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1439/2873] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:27:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:27:36.610746 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee7acc3-b0e2-46e1-864e-73df20e6c906 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:27:36.611035 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee7acc3-b0e2-46e1-864e-73df20e6c906 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:27:36.611325 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee7acc3-b0e2-46e1-864e-73df20e6c906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:27:36.631209 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-6ee7acc3-b0e2-46e1-864e-73df20e6c906 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:27:36.632426 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-6ee7acc3-b0e2-46e1-864e-73df20e6c906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:27:36.641760 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1435/2874] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:27:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:27:36.647633 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3e4e3b-e307-4dbe-9a56-6bc0d44cd0e6 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:27:36.659648 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3e4e3b-e307-4dbe-9a56-6bc0d44cd0e6 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:27:36.665626 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd17ec68-f4fe-4306-8220-85e7b8353c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:27:36.666291 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd17ec68-f4fe-4306-8220-85e7b8353c4b admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:27:36.666568 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd17ec68-f4fe-4306-8220-85e7b8353c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:27:36.666850 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd17ec68-f4fe-4306-8220-85e7b8353c4b admin admin] PATH_INFO: `/v3/domains` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:27:36.667564 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd17ec68-f4fe-4306-8220-85e7b8353c4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79961) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 30 07:27:36.667892 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd17ec68-f4fe-4306-8220-85e7b8353c4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:27:36.669488 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd17ec68-f4fe-4306-8220-85e7b8353c4b admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:27:36.681762 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1440/2875] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Mar 30 07:27:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 30 07:27:36.686253 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee7acc3-b0e2-46e1-864e-73df20e6c906 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:27:36.696078 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee7acc3-b0e2-46e1-864e-73df20e6c906 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:27:36.702051 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e344e46-3cb2-4b1d-bcc9-cf901d258a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:27:36.702703 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e344e46-3cb2-4b1d-bcc9-cf901d258a44 admin admin] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:27:36.702984 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e344e46-3cb2-4b1d-bcc9-cf901d258a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:27:36.703278 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e344e46-3cb2-4b1d-bcc9-cf901d258a44 admin admin] PATH_INFO: `/v3/projects` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:27:36.704026 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e344e46-3cb2-4b1d-bcc9-cf901d258a44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:27:36.706123 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e344e46-3cb2-4b1d-bcc9-cf901d258a44 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:27:36.736277 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1436/2876] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Mar 30 07:27:36 2022] POST /identity/v3/projects => generated 399 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:27:36.740430 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd17ec68-f4fe-4306-8220-85e7b8353c4b admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:27:36.752250 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd17ec68-f4fe-4306-8220-85e7b8353c4b admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:27:36.816413 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e2191b-ff61-44af-94be-83bef2ff3162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:27:36.817081 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e2191b-ff61-44af-94be-83bef2ff3162 admin admin] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:27:36.817358 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e2191b-ff61-44af-94be-83bef2ff3162 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:27:36.817626 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e2191b-ff61-44af-94be-83bef2ff3162 admin admin] PATH_INFO: `/v3/users` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:27:36.818303 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e2191b-ff61-44af-94be-83bef2ff3162 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:27:36.820321 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e2191b-ff61-44af-94be-83bef2ff3162 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:27:36.842805 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1441/2877] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Mar 30 07:27:36 2022] POST /identity/v3/users => generated 300 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 30 07:27:36.848384 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e344e46-3cb2-4b1d-bcc9-cf901d258a44 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:27:36.859061 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e344e46-3cb2-4b1d-bcc9-cf901d258a44 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:27:36.863802 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52a1f98-04e4-4eb1-a382-d2035fd9e533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:27:36.864482 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a1f98-04e4-4eb1-a382-d2035fd9e533 admin admin] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:27:36.864759 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a1f98-04e4-4eb1-a382-d2035fd9e533 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:27:36.865028 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a1f98-04e4-4eb1-a382-d2035fd9e533 admin admin] PATH_INFO: `/v3/roles` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:27:36.865771 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52a1f98-04e4-4eb1-a382-d2035fd9e533 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:27:36.867367 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52a1f98-04e4-4eb1-a382-d2035fd9e533 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:27:36.878828 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1437/2878] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:27:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:27:36.883060 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e2191b-ff61-44af-94be-83bef2ff3162 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:27:36.894802 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e2191b-ff61-44af-94be-83bef2ff3162 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:27:36.900400 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665f1a8e-e855-479d-9845-9c315be3a4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:27:36.901193 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665f1a8e-e855-479d-9845-9c315be3a4d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:27:36.901560 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665f1a8e-e855-479d-9845-9c315be3a4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:27:36.901937 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665f1a8e-e855-479d-9845-9c315be3a4d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:27:36.902767 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665f1a8e-e855-479d-9845-9c315be3a4d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:27:36.904587 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665f1a8e-e855-479d-9845-9c315be3a4d5 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:27:36.916938 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1442/2879] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Mar 30 07:27:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 30 07:27:36.921736 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52a1f98-04e4-4eb1-a382-d2035fd9e533 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:27:36.936185 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52a1f98-04e4-4eb1-a382-d2035fd9e533 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:27:36.942124 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13980276-bd8c-4474-84ea-0601e2e9c5d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:27:36.942991 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13980276-bd8c-4474-84ea-0601e2e9c5d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:27:36.943240 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13980276-bd8c-4474-84ea-0601e2e9c5d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:27:36.943538 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13980276-bd8c-4474-84ea-0601e2e9c5d8 admin admin] PATH_INFO: `/v3/projects/90ce0d5e4d1a4a29b3cd664fc81891c4/users/5389d6073e5f4e8a86726b25bb837a8c/roles/5d79031a64754b57ba120367465e2252` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:27:36.963490 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13980276-bd8c-4474-84ea-0601e2e9c5d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90ce0d5e4d1a4a29b3cd664fc81891c4, user_id=5389d6073e5f4e8a86726b25bb837a8c, role_id=5d79031a64754b57ba120367465e2252)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:27:36.968098 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13980276-bd8c-4474-84ea-0601e2e9c5d8 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:27:36.988011 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1438/2880] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Mar 30 07:27:36 2022] PUT /identity/v3/projects/90ce0d5e4d1a4a29b3cd664fc81891c4/users/5389d6073e5f4e8a86726b25bb837a8c/roles/5d79031a64754b57ba120367465e2252 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 30 07:27:36.998681 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0b7368-02ed-4ce8-867a-c51971d56260 None None] REQUEST_METHOD: `POST` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:27:36.998985 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0b7368-02ed-4ce8-867a-c51971d56260 None None] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:27:36.999255 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0b7368-02ed-4ce8-867a-c51971d56260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:27:37.027498 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.auth.core [None req-df0b7368-02ed-4ce8-867a-c51971d56260 None None] MFA Rules not processed for user `5389d6073e5f4e8a86726b25bb837a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=79961) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:27:37.028721 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-df0b7368-02ed-4ce8-867a-c51971d56260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:27:37.096942 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1443/2881] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:27:36 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:27:37.112064 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13980276-bd8c-4474-84ea-0601e2e9c5d8 admin admin] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:27:37.114304 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-13980276-bd8c-4474-84ea-0601e2e9c5d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:27:37.183924 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13980276-bd8c-4474-84ea-0601e2e9c5d8 admin admin] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:27:37.188518 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e028a4-226b-49ea-9f14-f700e1b8964f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e2fda180e8d448d895c40cdad34bc4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:27:37.189163 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e028a4-226b-49ea-9f14-f700e1b8964f service cinder] REQUEST_METHOD: `GET` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:27:37.189446 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e028a4-226b-49ea-9f14-f700e1b8964f service cinder] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:27:37.189737 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e028a4-226b-49ea-9f14-f700e1b8964f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:27:37.198317 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e028a4-226b-49ea-9f14-f700e1b8964f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:27:37.199745 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e028a4-226b-49ea-9f14-f700e1b8964f service cinder] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:27:37.208986 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1439/2882] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:27:37 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:27:44.300310 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0b7368-02ed-4ce8-867a-c51971d56260 None None] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:27:44.375719 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0b7368-02ed-4ce8-867a-c51971d56260 None None] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:27:44.380720 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19143f22-da48-408d-9fb5-b449602662b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:27:44.381582 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19143f22-da48-408d-9fb5-b449602662b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:27:44.381858 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19143f22-da48-408d-9fb5-b449602662b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:27:44.382263 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19143f22-da48-408d-9fb5-b449602662b2 admin admin] PATH_INFO: `/v3/users/5389d6073e5f4e8a86726b25bb837a8c` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:27:44.383575 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19143f22-da48-408d-9fb5-b449602662b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5389d6073e5f4e8a86726b25bb837a8c)` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:27:44.385549 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19143f22-da48-408d-9fb5-b449602662b2 admin admin] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:27:44.434857 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-19143f22-da48-408d-9fb5-b449602662b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5389d6073e5f4e8a86726b25bb837a8c'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:27:44.435507 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-19143f22-da48-408d-9fb5-b449602662b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5389d6073e5f4e8a86726b25bb837a8c'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:27:44.436130 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-19143f22-da48-408d-9fb5-b449602662b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5389d6073e5f4e8a86726b25bb837a8c'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:27:44.443973 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-19143f22-da48-408d-9fb5-b449602662b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5389d6073e5f4e8a86726b25bb837a8c'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:27:44.450791 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.notifications [None req-19143f22-da48-408d-9fb5-b449602662b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5389d6073e5f4e8a86726b25bb837a8c'} {{(pid=79961) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:27:44.468575 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1444/2883] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Mar 30 07:27:44 2022] DELETE /identity/v3/users/5389d6073e5f4e8a86726b25bb837a8c => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:27:44.473321 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c6591-78c4-40a0-acfb-1498c3d62470 None None] REQUEST_METHOD: `POST` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:27:44.473844 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c6591-78c4-40a0-acfb-1498c3d62470 None None] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:27:44.473844 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c6591-78c4-40a0-acfb-1498c3d62470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:27:44.492539 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.auth.core [None req-ab0c6591-78c4-40a0-acfb-1498c3d62470 None None] MFA Rules not processed for user `3226f67e8def44ad8010bab402b41414`. Rule list: `[]` (Enabled: `True`). {{(pid=79960) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 30 07:27:44.493742 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-ab0c6591-78c4-40a0-acfb-1498c3d62470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:27:44.557684 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1440/2884] 10.222.0.20 () {58 vars in 957 bytes} [Wed Mar 30 07:27:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 30 07:27:44.568317 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19143f22-da48-408d-9fb5-b449602662b2 admin admin] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:27:44.571114 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-19143f22-da48-408d-9fb5-b449602662b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:27:44.633581 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19143f22-da48-408d-9fb5-b449602662b2 admin admin] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:27:44.637843 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61731605-5d4f-40df-ac08-0687f5dd7b95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3802cb341445f994b9204744060ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:27:44.638482 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61731605-5d4f-40df-ac08-0687f5dd7b95 service neutron] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:27:44.638754 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61731605-5d4f-40df-ac08-0687f5dd7b95 service neutron] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:27:44.639021 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61731605-5d4f-40df-ac08-0687f5dd7b95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:27:44.648576 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61731605-5d4f-40df-ac08-0687f5dd7b95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:27:44.650001 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61731605-5d4f-40df-ac08-0687f5dd7b95 service neutron] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:27:44.661778 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1445/2885] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:27:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 30 07:27:44.926656 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0c6591-78c4-40a0-acfb-1498c3d62470 None None] Authenticating user token {{(pid=79960) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:27:44.928151 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.fernet_utils [None req-ab0c6591-78c4-40a0-acfb-1498c3d62470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79960) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:27:44.940488 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0c6591-78c4-40a0-acfb-1498c3d62470 None None] Validating token access rules against request {{(pid=79960) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:27:44.946329 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4989a9-4db9-4d5f-825f-9514e8e95ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3226f67e8def44ad8010bab402b41414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0c9fc0b60d1476cbb305fe8a9512169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79960) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:27:44.947173 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4989a9-4db9-4d5f-825f-9514e8e95ad1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:27:44.947452 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4989a9-4db9-4d5f-825f-9514e8e95ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:27:44.947718 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4989a9-4db9-4d5f-825f-9514e8e95ad1 admin admin] PATH_INFO: `/v3/projects/90ce0d5e4d1a4a29b3cd664fc81891c4` {{(pid=79960) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:27:44.949053 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4989a9-4db9-4d5f-825f-9514e8e95ad1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90ce0d5e4d1a4a29b3cd664fc81891c4)` {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:27:44.950980 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4989a9-4db9-4d5f-825f-9514e8e95ad1 admin admin] RBAC: Authorization granted {{(pid=79960) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:27:44.998652 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-bf4989a9-4db9-4d5f-825f-9514e8e95ad1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90ce0d5e4d1a4a29b3cd664fc81891c4', 'request_id': 'req-bf4989a9-4db9-4d5f-825f-9514e8e95ad1'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:27:45.007200 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-bf4989a9-4db9-4d5f-825f-9514e8e95ad1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90ce0d5e4d1a4a29b3cd664fc81891c4', 'request_id': 'req-bf4989a9-4db9-4d5f-825f-9514e8e95ad1'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:27:45.013218 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-bf4989a9-4db9-4d5f-825f-9514e8e95ad1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90ce0d5e4d1a4a29b3cd664fc81891c4', 'request_id': 'req-bf4989a9-4db9-4d5f-825f-9514e8e95ad1'} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:27:45.024932 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-bf4989a9-4db9-4d5f-825f-9514e8e95ad1 admin admin] The token cache is being invalidate because project 90ce0d5e4d1a4a29b3cd664fc81891c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79960) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 30 07:27:45.025228 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-bf4989a9-4db9-4d5f-825f-9514e8e95ad1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:27:45.025944 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: DEBUG keystone.notifications [None req-bf4989a9-4db9-4d5f-825f-9514e8e95ad1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79960) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 30 07:27:45.027573 dv-cinder-835778-2-iscsi devstack@keystone.service[79960]: [pid: 79960|app: 0|req: 1441/2886] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Mar 30 07:27:44 2022] DELETE /identity/v3/projects/90ce0d5e4d1a4a29b3cd664fc81891c4 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 30 07:29:41.399839 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61731605-5d4f-40df-ac08-0687f5dd7b95 service neutron] Authenticating user token {{(pid=79961) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 30 07:29:41.401500 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-61731605-5d4f-40df-ac08-0687f5dd7b95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:29:41.568856 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61731605-5d4f-40df-ac08-0687f5dd7b95 service neutron] Validating token access rules against request {{(pid=79961) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 30 07:29:41.632796 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d363e4e4-6718-4383-a00b-6dd4b78b8cc6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd634743546e8456fac2f6ab1aaee09ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4eda4c5cd84307b36a5b48642e816f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79961) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 30 07:29:41.633445 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d363e4e4-6718-4383-a00b-6dd4b78b8cc6 service placement] REQUEST_METHOD: `GET` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 30 07:29:41.633706 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d363e4e4-6718-4383-a00b-6dd4b78b8cc6 service placement] SCRIPT_NAME: `/identity` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 30 07:29:41.634004 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d363e4e4-6718-4383-a00b-6dd4b78b8cc6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79961) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 30 07:29:41.636379 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.fernet_utils [None req-d363e4e4-6718-4383-a00b-6dd4b78b8cc6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79961) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 30 07:29:41.648461 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d363e4e4-6718-4383-a00b-6dd4b78b8cc6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 30 07:29:41.650047 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d363e4e4-6718-4383-a00b-6dd4b78b8cc6 service placement] RBAC: Authorization granted {{(pid=79961) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 30 07:29:41.659963 dv-cinder-835778-2-iscsi devstack@keystone.service[79961]: [pid: 79961|app: 0|req: 1446/2887] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Mar 30 07:29:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)